2023-10-08T13:04:51.652 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T13:04:51.653 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/orig.config.yaml 2023-10-08T13:04:51.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T13:04:51.799 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973 branch: wip-batrick-testing-20231007.154158 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417973' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T13:04:51.800 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T13:04:51.800 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T13:04:51.801 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T13:04:51.802 INFO:teuthology.task.internal:Checking packages... 2023-10-08T13:04:51.826 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T13:04:51.826 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T13:04:51.826 INFO:teuthology.packaging:ref: None 2023-10-08T13:04:51.826 INFO:teuthology.packaging:tag: None 2023-10-08T13:04:51.826 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T13:04:51.826 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:04:51.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T13:04:51.972 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T13:04:51.972 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T13:04:51.979 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T13:04:51.979 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T13:04:51.985 INFO:teuthology.task.internal:Saving configuration 2023-10-08T13:04:52.006 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T13:04:52.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:04:52.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.950319', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:04:52.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.952343', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:04:52.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.954866', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:04:52.084 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T13:04:52.090 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-08T13:04:52.090 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-08T13:04:52.090 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-08T13:04:52.090 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T13:04:52.189 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3773faab80>, signals=[15]) 2023-10-08T13:04:52.190 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T13:04:52.196 INFO:teuthology.task.internal:Opening connections... 2023-10-08T13:04:52.196 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:04:52.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:04:52.265 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-10-08T13:04:52.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:04:52.335 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-10-08T13:04:52.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:04:52.400 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T13:04:52.407 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-10-08T13:04:52.428 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-10-08T13:04:52.428 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-08T13:04:52.488 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T13:04:52.488 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T13:04:52.488 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-10-08T13:04:52.488 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-10-08T13:04:52.488 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T13:04:52.489 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:04:52.490 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T13:04:52.490 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T13:04:52.490 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T13:04:52.490 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T13:04:52.490 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-08T13:04:52.509 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-10-08T13:04:52.529 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-10-08T13:04:52.529 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6" 2023-10-08T13:04:52.588 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T13:04:52.589 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T13:04:52.590 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-08T13:04:52.609 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-08T13:04:52.628 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-08T13:04:52.628 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-10-08T13:04:52.686 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T13:04:52.687 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T13:04:52.688 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-08T13:04:52.708 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T13:04:52.718 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T13:04:52.723 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T13:04:52.724 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2023-10-08T13:04:52.727 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-10-08T13:04:52.729 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-10-08T13:04:52.746 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T13:04:52.752 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T13:04:52.752 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2023-10-08T13:04:52.784 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-10-08T13:04:52.787 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-10-08T13:04:52.824 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T13:04:52.900 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T13:04:52.918 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T13:04:52.918 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-08T13:04:52.919 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-08T13:04:52.919 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T13:04:52.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:04:52.936 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2023-10-08T13:04:52.994 INFO:teuthology.orchestra.run.smithi139.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T13:04:52.994 INFO:teuthology.task.kernel:Running kernel on smithi139: 4.18.0-372.9.1.el8.x86_64 2023-10-08T13:04:52.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2023-10-08T13:04:54.234 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:04:54.234 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-10-08T13:04:55.716 INFO:teuthology.orchestra.run.smithi139.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-08T13:04:56.409 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-10-08T13:04:59.926 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 361 kB/s | 24 kB 00:00 2023-10-08T13:05:00.620 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T13:05:00.664 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-10-08T13:05:00.665 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2023-10-08T13:05:00.665 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-10-08T13:05:00.767 DEBUG:teuthology.orchestra.run.smithi139:> echo no | sudo yum reinstall kernel || true 2023-10-08T13:05:01.098 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:05:01.098 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-10-08T13:05:01.369 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 01:04:59 PM UTC. 2023-10-08T13:05:01.413 INFO:teuthology.orchestra.run.smithi139.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T13:05:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:Error: No packages marked for reinstall. 2023-10-08T13:05:01.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum reinstall -y kernel || true 2023-10-08T13:05:01.832 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:05:01.832 INFO:teuthology.orchestra.run.smithi139.stdout:Unable to read consumer identity 2023-10-08T13:05:02.095 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 01:04:59 PM UTC. 2023-10-08T13:05:02.134 INFO:teuthology.orchestra.run.smithi139.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T13:05:02.164 INFO:teuthology.orchestra.run.smithi139.stderr:Error: No packages marked for reinstall. 2023-10-08T13:05:02.215 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T13:05:02.296 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T13:05:02.296 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T13:05:02.296 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T13:05:02.296 DEBUG:teuthology.parallel:result is None 2023-10-08T13:05:02.297 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T13:05:02.304 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T13:05:02.304 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T13:05:02.306 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T13:05:02.309 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T13:05:02.544 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T13:05:02.551 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T13:05:02.559 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T13:05:02.559 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T13:05:02.561 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T13:05:02.563 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T13:05:02.672 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T13:05:02.678 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T13:05:02.679 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T13:05:02.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:05:02.698 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T13:05:02.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:05:02.717 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T13:05:02.719 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T13:05:02.740 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T13:05:02.767 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.803 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.806 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.821 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.833 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.853 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T13:05:02.855 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T13:05:02.861 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T13:05:02.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T13:05:02.863 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T13:05:02.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T13:05:02.898 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T13:05:02.906 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T13:05:02.906 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T13:05:02.930 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T13:05:02.935 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T13:05:02.955 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.078 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.202 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:05:03.202 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T13:05:03.272 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.398 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.485 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:05:03.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T13:05:03.553 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T13:05:03.652 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T13:05:03.781 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:05:03.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T13:05:03.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2023-10-08T13:05:03.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-10-08T13:05:03.860 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-10-08T13:05:03.907 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:05:03.917 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:05:03.961 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:05:04.396 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T13:05:04.408 INFO:teuthology.task.internal:Starting timer... 2023-10-08T13:05:04.409 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T13:05:04.418 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T13:05:04.426 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T13:05:04.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2023-10-08T13:05:04.487 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2023-10-08T13:05:04.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-10-08T13:05:04.553 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2023-10-08T13:05:04.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-10-08T13:05:04.618 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-10-08T13:05:04.620 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T13:05:04.621 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2023-10-08T13:05:04.648 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2023-10-08T13:05:04.649 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-10-08T13:05:04.666 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-10-08T13:05:04.666 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-10-08T13:05:04.689 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-10-08T13:05:04.690 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2023-10-08T13:05:04.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:05:04.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:05:04.717 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:05:04.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:05:04.745 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:05:04.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:05:04.771 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T13:05:04.772 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2023-10-08T13:05:04.798 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-10-08T13:05:04.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-10-08T13:05:04.867 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T13:05:04.877 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T13:05:04.877 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T13:05:04.893 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T13:05:04.894 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi139.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T13:14:36.016 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-10-08T13:14:36.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-08T13:14:36.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:14:36.088 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-10-08T13:14:36.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-08T13:14:36.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-08T13:14:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:14:36.182 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-08T13:14:36.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-08T13:14:36.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-08T13:14:36.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T13:14:36.277 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-08T13:14:36.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-08T13:14:36.349 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T13:14:36.510 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T13:14:36.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T13:14:36.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:36.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T13:14:36.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:36.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T13:14:36.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:14:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T13:14:36.549 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T13:14:36.549 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T13:14:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T13:14:36.564 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T13:14:36.564 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T13:14:36.634 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2023-10-08T13:14:36.637 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-10-08T13:14:36.645 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2023-10-08T13:14:36.649 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-10-08T13:14:36.649 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-10-08T13:14:36.660 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T13:14:36.662 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-10-08T13:14:36.663 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T13:14:36.675 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T13:14:36.676 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T13:14:36.677 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T13:14:36.690 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T13:14:36.738 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.741 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.745 INFO:teuthology.orchestra.run.smithi139.stderr:bash: ntpq: command not found 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.768 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-08T13:14:36.772 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:14:36.773 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-08T13:14:36.773 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.773 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.773 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.773 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:14:36.773 INFO:teuthology.run_tasks:Running task pexec... 2023-10-08T13:14:36.784 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-08T13:14:36.784 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:14:36.784 DEBUG:teuthology.orchestra.run.smithi139:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T13:14:36.785 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi155.front.sepia.ceph.com 2023-10-08T13:14:36.785 DEBUG:teuthology.orchestra.run.smithi155:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T13:14:36.785 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi187.front.sepia.ceph.com 2023-10-08T13:14:36.785 DEBUG:teuthology.orchestra.run.smithi187:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T13:14:37.156 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:37.162 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:37.186 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:38.002 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:35 ago on Sun 08 Oct 2023 01:13:02 PM UTC. 2023-10-08T13:14:38.005 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:31 ago on Sun 08 Oct 2023 01:13:06 PM UTC. 2023-10-08T13:14:38.013 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:40 ago on Sun 08 Oct 2023 01:12:57 PM UTC. 2023-10-08T13:14:39.727 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-10-08T13:14:39.727 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-08T13:14:39.728 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-10-08T13:14:39.728 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2023-10-08T13:14:39.728 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-10-08T13:14:39.728 INFO:teuthology.orchestra.run.smithi187.stdout:Resetting modules: 2023-10-08T13:14:39.728 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools 2023-10-08T13:14:39.729 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:39.729 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-10-08T13:14:39.729 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-10-08T13:14:39.729 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:39.729 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout:Resetting modules: 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-08T13:14:39.730 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2023-10-08T13:14:39.731 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:39.888 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-10-08T13:14:39.889 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-10-08T13:14:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2023-10-08T13:14:39.889 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout:Resetting modules: 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: container-tools 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2023-10-08T13:14:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:40.687 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:38 ago on Sun 08 Oct 2023 01:13:02 PM UTC. 2023-10-08T13:14:40.715 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:34 ago on Sun 08 Oct 2023 01:13:06 PM UTC. 2023-10-08T13:14:40.868 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:43 ago on Sun 08 Oct 2023 01:12:57 PM UTC. 2023-10-08T13:14:43.325 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-10-08T13:14:43.385 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-08T13:14:43.549 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-10-08T13:14:43.798 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:43.996 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:44.016 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:44.576 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:42 ago on Sun 08 Oct 2023 01:13:02 PM UTC. 2023-10-08T13:14:44.784 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:38 ago on Sun 08 Oct 2023 01:13:06 PM UTC. 2023-10-08T13:14:44.861 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:47 ago on Sun 08 Oct 2023 01:12:57 PM UTC. 2023-10-08T13:14:46.319 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout:Installing group/module packages: 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T13:14:46.415 INFO:teuthology.orchestra.run.smithi187.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout:Installing module profiles: 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools/common 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools rhel8 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-10-08T13:14:46.416 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-10-08T13:14:46.417 INFO:teuthology.orchestra.run.smithi187.stdout:Install 10 Packages 2023-10-08T13:14:46.417 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:46.417 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 18 M 2023-10-08T13:14:46.417 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 65 M 2023-10-08T13:14:46.417 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-10-08T13:14:46.500 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-08T13:14:46.505 INFO:teuthology.orchestra.run.smithi187.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2023-10-08T13:14:46.530 INFO:teuthology.orchestra.run.smithi187.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 220 kB/s | 25 kB 00:00 2023-10-08T13:14:46.547 INFO:teuthology.orchestra.run.smithi187.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 314 kB/s | 41 kB 00:00 2023-10-08T13:14:46.564 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-10-08T13:14:46.572 INFO:teuthology.orchestra.run.smithi187.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 738 kB/s | 49 kB 00:00 2023-10-08T13:14:46.592 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================================ 2023-10-08T13:14:46.592 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-08T13:14:46.592 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================================ 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout:Installing group/module packages: 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T13:14:46.593 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T13:14:46.594 INFO:teuthology.orchestra.run.smithi155.stdout:Installing module profiles: 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools/common 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling module streams: 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout: container-tools rhel8 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-08T13:14:46.595 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================================ 2023-10-08T13:14:46.596 INFO:teuthology.orchestra.run.smithi155.stdout:Install 10 Packages 2023-10-08T13:14:46.596 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:46.597 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 18 M 2023-10-08T13:14:46.597 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 65 M 2023-10-08T13:14:46.597 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-08T13:14:46.606 INFO:teuthology.orchestra.run.smithi187.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-10-08T13:14:46.623 INFO:teuthology.orchestra.run.smithi187.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================================ 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================================ 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout:Installing group/module packages: 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T13:14:46.660 INFO:teuthology.orchestra.run.smithi139.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-10-08T13:14:46.661 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout:Installing module profiles: 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: container-tools/common 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling module streams: 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: container-tools rhel8 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-10-08T13:14:46.662 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================================ 2023-10-08T13:14:46.663 INFO:teuthology.orchestra.run.smithi139.stdout:Install 10 Packages 2023-10-08T13:14:46.663 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:46.663 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 18 M 2023-10-08T13:14:46.663 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 65 M 2023-10-08T13:14:46.663 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-10-08T13:14:46.690 INFO:teuthology.orchestra.run.smithi187.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.5 MB/s | 213 kB 00:00 2023-10-08T13:14:46.723 INFO:teuthology.orchestra.run.smithi139.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.5 MB/s | 94 kB 00:00 2023-10-08T13:14:46.778 INFO:teuthology.orchestra.run.smithi139.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 214 kB/s | 25 kB 00:00 2023-10-08T13:14:46.791 INFO:teuthology.orchestra.run.smithi155.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 126 kB/s | 25 kB 00:00 2023-10-08T13:14:46.807 INFO:teuthology.orchestra.run.smithi139.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 282 kB/s | 41 kB 00:00 2023-10-08T13:14:46.814 INFO:teuthology.orchestra.run.smithi155.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 186 kB/s | 41 kB 00:00 2023-10-08T13:14:46.823 INFO:teuthology.orchestra.run.smithi187.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 29 MB/s | 8.0 MB 00:00 2023-10-08T13:14:46.832 INFO:teuthology.orchestra.run.smithi139.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 454 kB/s | 49 kB 00:00 2023-10-08T13:14:46.839 INFO:teuthology.orchestra.run.smithi155.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 384 kB/s | 94 kB 00:00 2023-10-08T13:14:46.864 INFO:teuthology.orchestra.run.smithi155.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 679 kB/s | 49 kB 00:00 2023-10-08T13:14:46.866 INFO:teuthology.orchestra.run.smithi139.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.9 MB/s | 524 kB 00:00 2023-10-08T13:14:46.882 INFO:teuthology.orchestra.run.smithi187.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-10-08T13:14:46.891 INFO:teuthology.orchestra.run.smithi139.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-08T13:14:46.898 INFO:teuthology.orchestra.run.smithi155.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-10-08T13:14:46.923 INFO:teuthology.orchestra.run.smithi155.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-10-08T13:14:46.924 INFO:teuthology.orchestra.run.smithi139.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-10-08T13:14:46.940 INFO:teuthology.orchestra.run.smithi155.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 5.0 MB/s | 213 kB 00:00 2023-10-08T13:14:46.965 INFO:teuthology.orchestra.run.smithi187.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 21 MB/s | 7.0 MB 00:00 2023-10-08T13:14:46.966 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:14:46.966 INFO:teuthology.orchestra.run.smithi187.stdout:Total 33 MB/s | 18 MB 00:00 2023-10-08T13:14:47.016 INFO:teuthology.orchestra.run.smithi139.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 24 MB/s | 2.2 MB 00:00 2023-10-08T13:14:47.040 INFO:teuthology.orchestra.run.smithi155.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-10-08T13:14:47.133 INFO:teuthology.orchestra.run.smithi139.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 29 MB/s | 7.0 MB 00:00 2023-10-08T13:14:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-10-08T13:14:47.166 INFO:teuthology.orchestra.run.smithi155.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 29 MB/s | 7.0 MB 00:00 2023-10-08T13:14:47.184 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-10-08T13:14:47.184 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-10-08T13:14:47.250 INFO:teuthology.orchestra.run.smithi139.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-10-08T13:14:47.251 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:14:47.251 INFO:teuthology.orchestra.run.smithi139.stdout:Total 31 MB/s | 18 MB 00:00 2023-10-08T13:14:47.266 INFO:teuthology.orchestra.run.smithi155.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-10-08T13:14:47.266 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:14:47.266 INFO:teuthology.orchestra.run.smithi155.stdout:Total 27 MB/s | 18 MB 00:00 2023-10-08T13:14:47.365 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-10-08T13:14:47.369 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-10-08T13:14:47.451 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-10-08T13:14:47.470 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-10-08T13:14:47.470 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-10-08T13:14:47.471 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-08T13:14:47.489 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-08T13:14:47.490 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-08T13:14:47.650 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-10-08T13:14:47.654 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-10-08T13:14:47.671 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-08T13:14:47.675 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-08T13:14:47.895 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-10-08T13:14:48.090 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T13:14:48.164 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-08T13:14:48.190 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-10-08T13:14:48.310 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:48.397 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T13:14:48.400 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T13:14:48.496 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T13:14:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:48.578 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:48.687 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T13:14:48.720 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T13:14:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T13:14:48.939 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T13:14:48.966 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T13:14:49.039 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T13:14:49.271 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T13:14:49.324 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T13:14:49.811 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T13:14:50.026 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T13:14:50.094 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T13:14:50.703 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T13:14:50.890 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T13:14:50.940 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T13:14:50.974 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T13:14:51.080 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T13:14:51.092 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T13:14:51.189 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T13:14:51.261 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.283 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T13:14:51.402 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T13:14:51.460 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T13:14:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:51.515 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T13:14:51.516 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T13:14:51.587 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.730 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.730 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T13:14:51.731 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T13:14:51.839 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T13:14:51.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T13:14:51.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T13:14:51.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T13:14:51.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T13:14:52.667 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T13:14:52.668 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:50 ago on Sun 08 Oct 2023 01:13:02 PM UTC. 2023-10-08T13:14:52.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T13:14:52.840 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:55 ago on Sun 08 Oct 2023 01:12:57 PM UTC. 2023-10-08T13:14:52.973 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T13:14:52.973 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:46 ago on Sun 08 Oct 2023 01:13:06 PM UTC. 2023-10-08T13:14:55.542 INFO:teuthology.orchestra.run.smithi187.stdout:Installed products updated. 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T13:14:55.735 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:14:55.736 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-10-08T13:14:55.874 DEBUG:teuthology.parallel:result is None 2023-10-08T13:14:55.961 INFO:teuthology.orchestra.run.smithi139.stdout:Installed products updated. 2023-10-08T13:14:55.992 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-08T13:14:56.154 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:56.154 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-10-08T13:14:56.154 INFO:teuthology.orchestra.run.smithi139.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.154 INFO:teuthology.orchestra.run.smithi139.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:14:56.155 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-10-08T13:14:56.193 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T13:14:56.194 INFO:teuthology.orchestra.run.smithi155.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T13:14:56.195 INFO:teuthology.orchestra.run.smithi155.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T13:14:56.195 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:14:56.195 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-08T13:14:56.293 DEBUG:teuthology.parallel:result is None 2023-10-08T13:14:56.348 DEBUG:teuthology.parallel:result is None 2023-10-08T13:14:56.348 INFO:teuthology.run_tasks:Running task install... 2023-10-08T13:14:56.358 DEBUG:teuthology.task.install:project ceph 2023-10-08T13:14:56.358 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T13:14:56.358 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T13:14:56.359 INFO:teuthology.task.install:Using flavor: default 2023-10-08T13:14:56.367 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T13:14:56.367 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T13:14:56.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T13:14:56.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:14:56.370 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T13:14:56.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:14:56.371 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T13:14:56.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:14:56.591 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T13:14:56.591 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T13:14:56.601 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T13:14:56.601 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T13:14:56.602 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T13:14:56.602 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T13:14:56.714 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T13:14:56.714 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:14:56.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T13:14:56.723 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T13:14:56.723 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:14:56.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T13:14:56.742 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T13:14:56.743 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T13:14:56.754 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T13:14:56.754 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T13:14:56.765 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T13:14:56.765 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:14:56.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T13:14:56.795 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T13:14:56.795 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T13:14:56.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T13:14:56.826 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T13:14:56.865 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T13:14:56.886 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T13:14:56.906 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T13:14:56.944 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T13:14:56.952 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-10-08T13:14:56.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-10-08T13:14:56.973 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-10-08T13:14:56.974 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-10-08T13:14:57.011 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2023-10-08T13:14:57.012 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2023-10-08T13:14:57.327 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:57.348 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:57.383 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:57.618 INFO:teuthology.orchestra.run.smithi155.stdout:44 files removed 2023-10-08T13:14:57.659 INFO:teuthology.orchestra.run.smithi187.stdout:44 files removed 2023-10-08T13:14:57.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T13:14:57.676 INFO:teuthology.orchestra.run.smithi139.stdout:44 files removed 2023-10-08T13:14:57.706 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T13:14:57.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T13:14:57.997 INFO:teuthology.orchestra.run.smithi155.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:58.038 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:58.054 INFO:teuthology.orchestra.run.smithi139.stdout:Updating Subscription Management repositories. 2023-10-08T13:14:58.732 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 239 kB/s | 81 kB 00:00 2023-10-08T13:14:58.750 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 264 kB/s | 81 kB 00:00 2023-10-08T13:14:58.843 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 213 kB/s | 81 kB 00:00 2023-10-08T13:14:59.025 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-10-08T13:14:59.042 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-10-08T13:14:59.177 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 31 kB/s | 9.4 kB 00:00 2023-10-08T13:14:59.293 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-10-08T13:14:59.367 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-08T13:14:59.452 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-08T13:14:59.494 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-08T13:14:59.568 INFO:teuthology.orchestra.run.smithi155.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-08T13:14:59.645 INFO:teuthology.orchestra.run.smithi139.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-08T13:15:00.435 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-08T13:15:00.798 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T13:15:01.428 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-10-08T13:15:03.918 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 603 kB/s | 24 kB 00:00 2023-10-08T13:15:04.246 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 405 kB/s | 24 kB 00:00 2023-10-08T13:15:04.820 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-10-08T13:15:04.961 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 387 kB/s | 24 kB 00:00 2023-10-08T13:15:05.189 INFO:teuthology.orchestra.run.smithi139.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-08T13:15:05.829 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-08T13:15:13.071 INFO:teuthology.orchestra.run.smithi155.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-10-08T13:15:13.312 INFO:teuthology.orchestra.run.smithi139.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-10-08T13:15:13.697 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-10-08T13:15:24.137 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:24.137 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:24.152 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.153 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.154 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T13:15:24.156 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T13:15:24.158 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T13:15:24.161 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.162 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T13:15:24.298 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-10-08T13:15:24.310 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T13:15:24.311 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T13:15:24.312 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T13:15:24.313 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T13:15:24.314 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T13:15:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T13:15:24.316 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T13:15:24.317 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T13:15:24.318 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T13:15:24.319 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T13:15:24.320 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T13:15:24.321 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T13:15:24.322 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout:Enabling module streams: 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql 10 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout:=========================================================================================================================== 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout:Install 128 Packages 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 3 Packages 2023-10-08T13:15:24.323 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:15:24.324 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 209 M 2023-10-08T13:15:24.324 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-10-08T13:15:24.413 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:24.414 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:24.428 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.429 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.430 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T13:15:24.431 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T13:15:24.433 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T13:15:24.436 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T13:15:24.438 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T13:15:24.538 INFO:teuthology.orchestra.run.smithi155.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-10-08T13:15:24.572 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T13:15:24.584 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T13:15:24.585 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T13:15:24.586 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T13:15:24.587 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T13:15:24.588 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T13:15:24.589 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T13:15:24.590 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T13:15:24.591 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T13:15:24.592 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T13:15:24.593 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T13:15:24.594 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling module streams: 2023-10-08T13:15:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql 10 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:=========================================================================================================================== 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:Install 128 Packages 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 3 Packages 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:15:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 209 M 2023-10-08T13:15:24.597 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2023-10-08T13:15:24.722 INFO:teuthology.orchestra.run.smithi155.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 4.9 MB/s | 918 kB 00:00 2023-10-08T13:15:24.772 INFO:teuthology.orchestra.run.smithi155.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 3.3 MB/s | 167 kB 00:00 2023-10-08T13:15:24.890 INFO:teuthology.orchestra.run.smithi139.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 46 kB/s | 6.4 kB 00:00 2023-10-08T13:15:25.055 INFO:teuthology.orchestra.run.smithi155.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 8.2 MB/s | 2.3 MB 00:00 2023-10-08T13:15:25.120 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:25.121 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T13:15:25.122 INFO:teuthology.orchestra.run.smithi155.stdout:(5/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 7.6 MB/s | 5.4 MB 00:00 2023-10-08T13:15:25.136 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:25.137 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T13:15:25.139 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T13:15:25.140 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T13:15:25.142 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T13:15:25.146 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T13:15:25.147 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T13:15:25.283 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T13:15:25.295 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T13:15:25.296 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T13:15:25.297 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T13:15:25.298 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T13:15:25.299 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T13:15:25.300 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T13:15:25.301 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T13:15:25.302 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:25.303 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T13:15:25.304 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T13:15:25.305 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T13:15:25.306 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql 10 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Install 128 Packages 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 3 Packages 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:15:25.307 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 209 M 2023-10-08T13:15:25.308 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-10-08T13:15:25.331 INFO:teuthology.orchestra.run.smithi155.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 5.9 MB/s | 1.6 MB 00:00 2023-10-08T13:15:25.478 INFO:teuthology.orchestra.run.smithi139.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.5 MB/s | 918 kB 00:00 2023-10-08T13:15:25.633 INFO:teuthology.orchestra.run.smithi139.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.1 MB/s | 167 kB 00:00 2023-10-08T13:15:25.664 INFO:teuthology.orchestra.run.smithi155.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 8.5 MB/s | 4.6 MB 00:00 2023-10-08T13:15:25.955 INFO:teuthology.orchestra.run.smithi187.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-08T13:15:26.732 INFO:teuthology.orchestra.run.smithi139.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-08T13:15:27.106 INFO:teuthology.orchestra.run.smithi187.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 799 kB/s | 918 kB 00:01 2023-10-08T13:15:27.175 INFO:teuthology.orchestra.run.smithi139.stdout:(5/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-10-08T13:15:27.308 INFO:teuthology.orchestra.run.smithi139.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-10-08T13:15:27.322 INFO:teuthology.orchestra.run.smithi187.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 773 kB/s | 167 kB 00:00 2023-10-08T13:15:27.965 INFO:teuthology.orchestra.run.smithi155.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 6.0 MB/s | 14 MB 00:02 2023-10-08T13:15:28.081 INFO:teuthology.orchestra.run.smithi155.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 208 kB/s | 24 kB 00:00 2023-10-08T13:15:28.198 INFO:teuthology.orchestra.run.smithi187.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-10-08T13:15:28.342 INFO:teuthology.orchestra.run.smithi139.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 4.0 MB/s | 4.6 MB 00:01 2023-10-08T13:15:28.889 INFO:teuthology.orchestra.run.smithi187.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 2.3 MB/s | 1.6 MB 00:00 2023-10-08T13:15:29.115 INFO:teuthology.orchestra.run.smithi155.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 4.7 MB/s | 18 MB 00:03 2023-10-08T13:15:29.257 INFO:teuthology.orchestra.run.smithi155.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.8 MB/s | 261 kB 00:00 2023-10-08T13:15:29.332 INFO:teuthology.orchestra.run.smithi155.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 414 kB/s | 31 kB 00:00 2023-10-08T13:15:29.616 INFO:teuthology.orchestra.run.smithi155.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 2.9 MB/s | 840 kB 00:00 2023-10-08T13:15:29.666 INFO:teuthology.orchestra.run.smithi155.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 3.6 MB/s | 184 kB 00:00 2023-10-08T13:15:29.708 INFO:teuthology.orchestra.run.smithi139.stdout:(8/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x86 7.5 MB/s | 18 MB 00:02 2023-10-08T13:15:29.733 INFO:teuthology.orchestra.run.smithi155.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.0 MB/s | 139 kB 00:00 2023-10-08T13:15:29.775 INFO:teuthology.orchestra.run.smithi139.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 366 kB/s | 24 kB 00:00 2023-10-08T13:15:29.925 INFO:teuthology.orchestra.run.smithi155.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.6 MB/s | 518 kB 00:00 2023-10-08T13:15:30.098 INFO:teuthology.orchestra.run.smithi187.stdout:(6/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 854 kB/s | 2.3 MB 00:02 2023-10-08T13:15:30.423 INFO:teuthology.orchestra.run.smithi187.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 3.0 MB/s | 4.6 MB 00:01 2023-10-08T13:15:32.209 INFO:teuthology.orchestra.run.smithi155.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 3.0 MB/s | 6.9 MB 00:02 2023-10-08T13:15:32.300 INFO:teuthology.orchestra.run.smithi155.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 490 kB/s | 45 kB 00:00 2023-10-08T13:15:32.392 INFO:teuthology.orchestra.run.smithi155.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.3 MB/s | 125 kB 00:00 2023-10-08T13:15:32.601 INFO:teuthology.orchestra.run.smithi155.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 945 kB/s | 197 kB 00:00 2023-10-08T13:15:32.760 INFO:teuthology.orchestra.run.smithi155.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.3 MB/s | 371 kB 00:00 2023-10-08T13:15:32.893 INFO:teuthology.orchestra.run.smithi155.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 2.7 MB/s | 365 kB 00:00 2023-10-08T13:15:32.925 INFO:teuthology.orchestra.run.smithi139.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 3.0 MB/s | 14 MB 00:04 2023-10-08T13:15:33.100 INFO:teuthology.orchestra.run.smithi139.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 1.5 MB/s | 261 kB 00:00 2023-10-08T13:15:33.152 INFO:teuthology.orchestra.run.smithi155.stdout:(23/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.6 MB/s | 23 MB 00:08 2023-10-08T13:15:33.177 INFO:teuthology.orchestra.run.smithi155.stdout:(24/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 376 kB/s | 107 kB 00:00 2023-10-08T13:15:33.184 INFO:teuthology.orchestra.run.smithi139.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 373 kB/s | 31 kB 00:00 2023-10-08T13:15:33.902 INFO:teuthology.orchestra.run.smithi155.stdout:(25/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 126 kB/s | 94 kB 00:00 2023-10-08T13:15:33.988 INFO:teuthology.orchestra.run.smithi139.stdout:(13/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.4 MB/s | 23 MB 00:09 2023-10-08T13:15:34.126 INFO:teuthology.orchestra.run.smithi139.stdout:(14/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 891 kB/s | 840 kB 00:00 2023-10-08T13:15:34.228 INFO:teuthology.orchestra.run.smithi155.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 550 kB/s | 179 kB 00:00 2023-10-08T13:15:34.293 INFO:teuthology.orchestra.run.smithi139.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 836 kB/s | 139 kB 00:00 2023-10-08T13:15:34.320 INFO:teuthology.orchestra.run.smithi155.stdout:(27/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.1 MB/s | 3.6 MB 00:01 2023-10-08T13:15:34.343 INFO:teuthology.orchestra.run.smithi139.stdout:(16/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 520 kB/s | 184 kB 00:00 2023-10-08T13:15:34.361 INFO:teuthology.orchestra.run.smithi155.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6639.g 173 kB/s | 23 kB 00:00 2023-10-08T13:15:34.412 INFO:teuthology.orchestra.run.smithi155.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.4 MB/s | 132 kB 00:00 2023-10-08T13:15:34.751 INFO:teuthology.orchestra.run.smithi139.stdout:(17/131): libradosstriper1-18.0.0-6639.g7b3143b 1.1 MB/s | 518 kB 00:00 2023-10-08T13:15:34.844 INFO:teuthology.orchestra.run.smithi139.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 482 kB/s | 45 kB 00:00 2023-10-08T13:15:35.003 INFO:teuthology.orchestra.run.smithi139.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 794 kB/s | 125 kB 00:00 2023-10-08T13:15:35.236 INFO:teuthology.orchestra.run.smithi139.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 844 kB/s | 197 kB 00:00 2023-10-08T13:15:35.628 INFO:teuthology.orchestra.run.smithi139.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 948 kB/s | 371 kB 00:00 2023-10-08T13:15:36.021 INFO:teuthology.orchestra.run.smithi139.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 932 kB/s | 365 kB 00:00 2023-10-08T13:15:36.187 INFO:teuthology.orchestra.run.smithi139.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 641 kB/s | 107 kB 00:00 2023-10-08T13:15:36.371 INFO:teuthology.orchestra.run.smithi139.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 514 kB/s | 94 kB 00:00 2023-10-08T13:15:36.645 INFO:teuthology.orchestra.run.smithi155.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-10-08T13:15:36.737 INFO:teuthology.orchestra.run.smithi155.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.6 MB/s | 242 kB 00:00 2023-10-08T13:15:36.812 INFO:teuthology.orchestra.run.smithi155.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 632 kB/s | 47 kB 00:00 2023-10-08T13:15:36.888 INFO:teuthology.orchestra.run.smithi155.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 194 kB/s | 15 kB 00:00 2023-10-08T13:15:37.054 INFO:teuthology.orchestra.run.smithi155.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.5 MB/s | 261 kB 00:00 2023-10-08T13:15:37.155 INFO:teuthology.orchestra.run.smithi155.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.9 MB/s | 190 kB 00:00 2023-10-08T13:15:37.238 INFO:teuthology.orchestra.run.smithi155.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 217 kB/s | 18 kB 00:00 2023-10-08T13:15:37.282 INFO:teuthology.orchestra.run.smithi187.stdout:(8/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el8 2.0 MB/s | 14 MB 00:06 2023-10-08T13:15:37.357 INFO:teuthology.orchestra.run.smithi187.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 328 kB/s | 24 kB 00:00 2023-10-08T13:15:37.747 INFO:teuthology.orchestra.run.smithi155.stdout:(37/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 533 kB/s | 1.8 MB 00:03 2023-10-08T13:15:38.006 INFO:teuthology.orchestra.run.smithi155.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 399 kB/s | 306 kB 00:00 2023-10-08T13:15:38.139 INFO:teuthology.orchestra.run.smithi155.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 564 kB/s | 75 kB 00:00 2023-10-08T13:15:38.248 INFO:teuthology.orchestra.run.smithi155.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 117 kB/s | 59 kB 00:00 2023-10-08T13:15:38.312 INFO:teuthology.orchestra.run.smithi139.stdout:(25/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 5.7 MB/s | 49 MB 00:08 2023-10-08T13:15:38.390 INFO:teuthology.orchestra.run.smithi155.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-10-08T13:15:38.424 INFO:teuthology.orchestra.run.smithi155.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2023-10-08T13:15:38.463 INFO:teuthology.orchestra.run.smithi139.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.2 MB/s | 179 kB 00:00 2023-10-08T13:15:38.532 INFO:teuthology.orchestra.run.smithi155.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-08T13:15:38.538 INFO:teuthology.orchestra.run.smithi139.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 307 kB/s | 23 kB 00:00 2023-10-08T13:15:38.574 INFO:teuthology.orchestra.run.smithi155.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 220 kB/s | 33 kB 00:00 2023-10-08T13:15:38.621 INFO:teuthology.orchestra.run.smithi139.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.6 MB/s | 132 kB 00:00 2023-10-08T13:15:38.658 INFO:teuthology.orchestra.run.smithi155.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-08T13:15:38.805 INFO:teuthology.orchestra.run.smithi139.stdout:(29/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 1.5 MB/s | 3.6 MB 00:02 2023-10-08T13:15:38.841 INFO:teuthology.orchestra.run.smithi155.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-10-08T13:15:38.866 INFO:teuthology.orchestra.run.smithi155.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 591 kB/s | 173 kB 00:00 2023-10-08T13:15:38.967 INFO:teuthology.orchestra.run.smithi155.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 649 kB/s | 81 kB 00:00 2023-10-08T13:15:38.992 INFO:teuthology.orchestra.run.smithi155.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-10-08T13:15:39.138 INFO:teuthology.orchestra.run.smithi155.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 103 kB/s | 18 kB 00:00 2023-10-08T13:15:39.188 INFO:teuthology.orchestra.run.smithi139.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 3.1 MB/s | 1.8 MB 00:00 2023-10-08T13:15:39.276 INFO:teuthology.orchestra.run.smithi155.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 354 kB/s | 49 kB 00:00 2023-10-08T13:15:39.289 INFO:teuthology.orchestra.run.smithi139.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.4 MB/s | 242 kB 00:00 2023-10-08T13:15:39.381 INFO:teuthology.orchestra.run.smithi139.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 516 kB/s | 47 kB 00:00 2023-10-08T13:15:39.426 INFO:teuthology.orchestra.run.smithi155.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 392 kB/s | 59 kB 00:00 2023-10-08T13:15:39.464 INFO:teuthology.orchestra.run.smithi139.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 175 kB/s | 15 kB 00:00 2023-10-08T13:15:39.501 INFO:teuthology.orchestra.run.smithi155.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.3 MB/s | 1.2 MB 00:00 2023-10-08T13:15:39.569 INFO:teuthology.orchestra.run.smithi155.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 425 kB/s | 60 kB 00:00 2023-10-08T13:15:39.648 INFO:teuthology.orchestra.run.smithi139.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.4 MB/s | 261 kB 00:00 2023-10-08T13:15:39.669 INFO:teuthology.orchestra.run.smithi155.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-10-08T13:15:39.711 INFO:teuthology.orchestra.run.smithi155.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 110 kB/s | 16 kB 00:00 2023-10-08T13:15:39.757 INFO:teuthology.orchestra.run.smithi139.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.7 MB/s | 190 kB 00:00 2023-10-08T13:15:39.811 INFO:teuthology.orchestra.run.smithi155.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 237 kB/s | 34 kB 00:00 2023-10-08T13:15:39.840 INFO:teuthology.orchestra.run.smithi139.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 217 kB/s | 18 kB 00:00 2023-10-08T13:15:39.870 INFO:teuthology.orchestra.run.smithi155.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-10-08T13:15:39.953 INFO:teuthology.orchestra.run.smithi155.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 453 kB/s | 64 kB 00:00 2023-10-08T13:15:40.012 INFO:teuthology.orchestra.run.smithi155.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2023-10-08T13:15:40.437 INFO:teuthology.orchestra.run.smithi155.stdout:(61/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 4.0 MB/s | 49 MB 00:12 2023-10-08T13:15:40.462 INFO:teuthology.orchestra.run.smithi155.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 47 kB/s | 24 kB 00:00 2023-10-08T13:15:40.465 INFO:teuthology.orchestra.run.smithi139.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 490 kB/s | 306 kB 00:00 2023-10-08T13:15:40.487 INFO:teuthology.orchestra.run.smithi155.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 61 kB/s | 29 kB 00:00 2023-10-08T13:15:40.629 INFO:teuthology.orchestra.run.smithi155.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-10-08T13:15:40.632 INFO:teuthology.orchestra.run.smithi139.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-10-08T13:15:40.671 INFO:teuthology.orchestra.run.smithi155.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-10-08T13:15:40.758 INFO:teuthology.orchestra.run.smithi139.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 601 kB/s | 75 kB 00:00 2023-10-08T13:15:40.771 INFO:teuthology.orchestra.run.smithi155.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 431 kB/s | 61 kB 00:00 2023-10-08T13:15:40.813 INFO:teuthology.orchestra.run.smithi155.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 607 kB/s | 85 kB 00:00 2023-10-08T13:15:40.914 INFO:teuthology.orchestra.run.smithi155.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2023-10-08T13:15:40.939 INFO:teuthology.orchestra.run.smithi155.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T13:15:40.958 INFO:teuthology.orchestra.run.smithi139.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-08T13:15:40.964 INFO:teuthology.orchestra.run.smithi155.stdout:(70/131): python3-trustme-0.6.0-4.el8.noarch.rp 52 kB/s | 27 kB 00:00 2023-10-08T13:15:41.023 INFO:teuthology.orchestra.run.smithi155.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-10-08T13:15:41.048 INFO:teuthology.orchestra.run.smithi155.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2023-10-08T13:15:41.058 INFO:teuthology.orchestra.run.smithi139.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-10-08T13:15:41.074 INFO:teuthology.orchestra.run.smithi155.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 844 kB/s | 43 kB 00:00 2023-10-08T13:15:41.099 INFO:teuthology.orchestra.run.smithi155.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-08T13:15:41.124 INFO:teuthology.orchestra.run.smithi155.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 961 kB/s | 48 kB 00:00 2023-10-08T13:15:41.149 INFO:teuthology.orchestra.run.smithi155.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T13:15:41.175 INFO:teuthology.orchestra.run.smithi155.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-10-08T13:15:41.175 INFO:teuthology.orchestra.run.smithi139.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-08T13:15:41.216 INFO:teuthology.orchestra.run.smithi155.stdout:(78/131): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-10-08T13:15:41.242 INFO:teuthology.orchestra.run.smithi155.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-10-08T13:15:41.267 INFO:teuthology.orchestra.run.smithi139.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 360 kB/s | 33 kB 00:00 2023-10-08T13:15:41.275 INFO:teuthology.orchestra.run.smithi155.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-10-08T13:15:41.292 INFO:teuthology.orchestra.run.smithi155.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 418 kB/s | 19 kB 00:00 2023-10-08T13:15:41.326 INFO:teuthology.orchestra.run.smithi155.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-08T13:15:41.351 INFO:teuthology.orchestra.run.smithi139.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-10-08T13:15:41.359 INFO:teuthology.orchestra.run.smithi155.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-10-08T13:15:41.376 INFO:teuthology.orchestra.run.smithi155.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-10-08T13:15:41.410 INFO:teuthology.orchestra.run.smithi155.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-10-08T13:15:41.435 INFO:teuthology.orchestra.run.smithi155.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.8 MB/s | 605 kB 00:00 2023-10-08T13:15:41.461 INFO:teuthology.orchestra.run.smithi155.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-10-08T13:15:41.468 INFO:teuthology.orchestra.run.smithi139.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-10-08T13:15:41.486 INFO:teuthology.orchestra.run.smithi155.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-08T13:15:41.511 INFO:teuthology.orchestra.run.smithi155.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T13:15:41.536 INFO:teuthology.orchestra.run.smithi155.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-08T13:15:41.562 INFO:teuthology.orchestra.run.smithi155.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-08T13:15:41.587 INFO:teuthology.orchestra.run.smithi155.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T13:15:41.612 INFO:teuthology.orchestra.run.smithi155.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 773 kB/s | 39 kB 00:00 2023-10-08T13:15:41.646 INFO:teuthology.orchestra.run.smithi155.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-08T13:15:41.671 INFO:teuthology.orchestra.run.smithi155.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-10-08T13:15:41.696 INFO:teuthology.orchestra.run.smithi155.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-08T13:15:41.710 INFO:teuthology.orchestra.run.smithi139.stdout:(46/131): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-10-08T13:15:41.735 INFO:teuthology.orchestra.run.smithi139.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.4 MB/s | 384 kB 00:00 2023-10-08T13:15:41.746 INFO:teuthology.orchestra.run.smithi155.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.9 MB/s | 2.3 MB 00:00 2023-10-08T13:15:41.756 INFO:teuthology.orchestra.run.smithi187.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 1.5 MB/s | 18 MB 00:11 2023-10-08T13:15:41.771 INFO:teuthology.orchestra.run.smithi155.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-08T13:15:41.797 INFO:teuthology.orchestra.run.smithi155.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-08T13:15:41.822 INFO:teuthology.orchestra.run.smithi155.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-08T13:15:41.827 INFO:teuthology.orchestra.run.smithi139.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-10-08T13:15:41.856 INFO:teuthology.orchestra.run.smithi155.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-08T13:15:41.864 INFO:teuthology.orchestra.run.smithi187.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 2.4 MB/s | 261 kB 00:00 2023-10-08T13:15:41.881 INFO:teuthology.orchestra.run.smithi155.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-10-08T13:15:41.919 INFO:teuthology.orchestra.run.smithi139.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 192 kB/s | 18 kB 00:00 2023-10-08T13:15:41.923 INFO:teuthology.orchestra.run.smithi187.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 532 kB/s | 31 kB 00:00 2023-10-08T13:15:41.931 INFO:teuthology.orchestra.run.smithi155.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-10-08T13:15:41.965 INFO:teuthology.orchestra.run.smithi155.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-10-08T13:15:41.990 INFO:teuthology.orchestra.run.smithi155.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T13:15:42.024 INFO:teuthology.orchestra.run.smithi155.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-08T13:15:42.066 INFO:teuthology.orchestra.run.smithi155.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-08T13:15:42.069 INFO:teuthology.orchestra.run.smithi139.stdout:(50/131): python3-google-auth-1.1.1-10.el8.noar 226 kB/s | 81 kB 00:00 2023-10-08T13:15:42.116 INFO:teuthology.orchestra.run.smithi155.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 534 kB/s | 27 kB 00:00 2023-10-08T13:15:42.169 INFO:teuthology.orchestra.run.smithi139.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 4.7 MB/s | 1.2 MB 00:00 2023-10-08T13:15:42.190 INFO:teuthology.orchestra.run.smithi187.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 3.1 MB/s | 840 kB 00:00 2023-10-08T13:15:42.193 INFO:teuthology.orchestra.run.smithi155.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 4.1 MB/s | 320 kB 00:00 2023-10-08T13:15:42.195 INFO:teuthology.orchestra.run.smithi139.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-10-08T13:15:42.262 INFO:teuthology.orchestra.run.smithi139.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 638 kB/s | 59 kB 00:00 2023-10-08T13:15:42.267 INFO:teuthology.orchestra.run.smithi155.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-08T13:15:42.292 INFO:teuthology.orchestra.run.smithi155.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 446 kB/s | 44 kB 00:00 2023-10-08T13:15:42.298 INFO:teuthology.orchestra.run.smithi187.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 1.7 MB/s | 184 kB 00:00 2023-10-08T13:15:42.351 INFO:teuthology.orchestra.run.smithi155.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-10-08T13:15:42.353 INFO:teuthology.orchestra.run.smithi139.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 382 kB/s | 60 kB 00:00 2023-10-08T13:15:42.365 INFO:teuthology.orchestra.run.smithi187.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.0 MB/s | 139 kB 00:00 2023-10-08T13:15:42.387 INFO:teuthology.orchestra.run.smithi139.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-08T13:15:42.446 INFO:teuthology.orchestra.run.smithi139.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 168 kB/s | 16 kB 00:00 2023-10-08T13:15:42.480 INFO:teuthology.orchestra.run.smithi139.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2023-10-08T13:15:42.493 INFO:teuthology.orchestra.run.smithi155.stdout:(113/131): python3-scipy-1.0.0-21.module+el8.5. 17 MB/s | 14 MB 00:00 2023-10-08T13:15:42.560 INFO:teuthology.orchestra.run.smithi155.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 13 MB/s | 3.7 MB 00:00 2023-10-08T13:15:42.571 INFO:teuthology.orchestra.run.smithi139.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 700 kB/s | 64 kB 00:00 2023-10-08T13:15:42.574 INFO:teuthology.orchestra.run.smithi187.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 2.4 MB/s | 518 kB 00:00 2023-10-08T13:15:42.585 INFO:teuthology.orchestra.run.smithi155.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 698 kB/s | 64 kB 00:00 2023-10-08T13:15:42.610 INFO:teuthology.orchestra.run.smithi155.stdout:(116/131): python3-numpy-f2py-1.14.3-10.el8.x86 869 kB/s | 225 kB 00:00 2023-10-08T13:15:42.635 INFO:teuthology.orchestra.run.smithi155.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-10-08T13:15:42.655 INFO:teuthology.orchestra.run.smithi139.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 225 kB/s | 19 kB 00:00 2023-10-08T13:15:42.661 INFO:teuthology.orchestra.run.smithi155.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.2 MB/s | 126 kB 00:00 2023-10-08T13:15:42.681 INFO:teuthology.orchestra.run.smithi139.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 838 kB/s | 196 kB 00:00 2023-10-08T13:15:42.711 INFO:teuthology.orchestra.run.smithi155.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.0 MB/s | 103 kB 00:00 2023-10-08T13:15:42.764 INFO:teuthology.orchestra.run.smithi139.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-10-08T13:15:42.781 INFO:teuthology.orchestra.run.smithi139.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 292 kB/s | 29 kB 00:00 2023-10-08T13:15:42.890 INFO:teuthology.orchestra.run.smithi139.stdout:(63/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 829 kB/s | 6.9 MB 00:08 2023-10-08T13:15:42.907 INFO:teuthology.orchestra.run.smithi139.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 194 kB/s | 27 kB 00:00 2023-10-08T13:15:42.932 INFO:teuthology.orchestra.run.smithi139.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-10-08T13:15:42.961 INFO:teuthology.orchestra.run.smithi155.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 2.1 MB/s | 709 kB 00:00 2023-10-08T13:15:43.011 INFO:teuthology.orchestra.run.smithi155.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 659 kB/s | 198 kB 00:00 2023-10-08T13:15:43.024 INFO:teuthology.orchestra.run.smithi139.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 931 kB/s | 85 kB 00:00 2023-10-08T13:15:43.049 INFO:teuthology.orchestra.run.smithi139.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 430 kB/s | 61 kB 00:00 2023-10-08T13:15:43.070 INFO:teuthology.orchestra.run.smithi155.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-10-08T13:15:43.099 INFO:teuthology.orchestra.run.smithi139.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 306 kB/s | 23 kB 00:00 2023-10-08T13:15:43.150 INFO:teuthology.orchestra.run.smithi139.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T13:15:43.153 INFO:teuthology.orchestra.run.smithi155.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 9.9 MB/s | 4.9 MB 00:00 2023-10-08T13:15:43.187 INFO:teuthology.orchestra.run.smithi155.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-10-08T13:15:43.200 INFO:teuthology.orchestra.run.smithi139.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 942 kB/s | 47 kB 00:00 2023-10-08T13:15:43.242 INFO:teuthology.orchestra.run.smithi139.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-10-08T13:15:43.254 INFO:teuthology.orchestra.run.smithi155.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-08T13:15:43.284 INFO:teuthology.orchestra.run.smithi139.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-10-08T13:15:43.304 INFO:teuthology.orchestra.run.smithi155.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-08T13:15:43.309 INFO:teuthology.orchestra.run.smithi139.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2023-10-08T13:15:43.343 INFO:teuthology.orchestra.run.smithi139.stdout:(74/131): python3-webob-1.8.5-1.el8.1.noarch.rp 555 kB/s | 251 kB 00:00 2023-10-08T13:15:43.354 INFO:teuthology.orchestra.run.smithi155.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-10-08T13:15:43.368 INFO:teuthology.orchestra.run.smithi139.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 909 kB/s | 48 kB 00:00 2023-10-08T13:15:43.402 INFO:teuthology.orchestra.run.smithi139.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-08T13:15:43.427 INFO:teuthology.orchestra.run.smithi139.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 803 kB/s | 43 kB 00:00 2023-10-08T13:15:43.447 INFO:teuthology.orchestra.run.smithi155.stdout:(128/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-10-08T13:15:43.452 INFO:teuthology.orchestra.run.smithi139.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2023-10-08T13:15:43.478 INFO:teuthology.orchestra.run.smithi139.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-08T13:15:43.497 INFO:teuthology.orchestra.run.smithi155.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-08T13:15:43.503 INFO:teuthology.orchestra.run.smithi139.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-08T13:15:43.553 INFO:teuthology.orchestra.run.smithi139.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 249 kB/s | 19 kB 00:00 2023-10-08T13:15:43.578 INFO:teuthology.orchestra.run.smithi139.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-10-08T13:15:43.612 INFO:teuthology.orchestra.run.smithi139.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-10-08T13:15:43.637 INFO:teuthology.orchestra.run.smithi139.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-10-08T13:15:43.671 INFO:teuthology.orchestra.run.smithi139.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-10-08T13:15:43.696 INFO:teuthology.orchestra.run.smithi139.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-10-08T13:15:43.730 INFO:teuthology.orchestra.run.smithi139.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-08T13:15:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-10-08T13:15:43.772 INFO:teuthology.orchestra.run.smithi139.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-08T13:15:43.806 INFO:teuthology.orchestra.run.smithi139.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-08T13:15:43.831 INFO:teuthology.orchestra.run.smithi139.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-10-08T13:15:43.856 INFO:teuthology.orchestra.run.smithi139.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-08T13:15:43.881 INFO:teuthology.orchestra.run.smithi139.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-10-08T13:15:43.915 INFO:teuthology.orchestra.run.smithi139.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-08T13:15:43.965 INFO:teuthology.orchestra.run.smithi139.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-10-08T13:15:43.991 INFO:teuthology.orchestra.run.smithi139.stdout:(96/131): NetworkManager-initscripts-updown-1.3 1.8 MB/s | 138 kB 00:00 2023-10-08T13:15:44.041 INFO:teuthology.orchestra.run.smithi139.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2023-10-08T13:15:44.066 INFO:teuthology.orchestra.run.smithi139.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-10-08T13:15:44.091 INFO:teuthology.orchestra.run.smithi139.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-08T13:15:44.117 INFO:teuthology.orchestra.run.smithi139.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-08T13:15:44.150 INFO:teuthology.orchestra.run.smithi139.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-08T13:15:44.167 INFO:teuthology.orchestra.run.smithi139.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 774 kB/s | 39 kB 00:00 2023-10-08T13:15:44.201 INFO:teuthology.orchestra.run.smithi139.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-10-08T13:15:44.234 INFO:teuthology.orchestra.run.smithi139.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-10-08T13:15:44.259 INFO:teuthology.orchestra.run.smithi139.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-08T13:15:44.285 INFO:teuthology.orchestra.run.smithi139.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-08T13:15:44.318 INFO:teuthology.orchestra.run.smithi139.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T13:15:44.377 INFO:teuthology.orchestra.run.smithi139.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 455 kB/s | 27 kB 00:00 2023-10-08T13:15:44.428 INFO:teuthology.orchestra.run.smithi139.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-10-08T13:15:44.455 INFO:teuthology.orchestra.run.smithi155.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 3.3 MB/s | 3.7 MB 00:01 2023-10-08T13:15:44.469 INFO:teuthology.orchestra.run.smithi139.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-08T13:15:44.514 INFO:teuthology.orchestra.run.smithi155.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 3.2 MB/s | 3.7 MB 00:01 2023-10-08T13:15:44.518 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:15:44.518 INFO:teuthology.orchestra.run.smithi155.stdout:Total 10 MB/s | 209 MB 00:20 2023-10-08T13:15:44.524 INFO:teuthology.orchestra.run.smithi187.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 3.5 MB/s | 6.9 MB 00:01 2023-10-08T13:15:44.544 INFO:teuthology.orchestra.run.smithi139.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-08T13:15:44.583 INFO:teuthology.orchestra.run.smithi187.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 769 kB/s | 45 kB 00:00 2023-10-08T13:15:44.595 INFO:teuthology.orchestra.run.smithi139.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-10-08T13:15:44.637 INFO:teuthology.orchestra.run.smithi139.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-08T13:15:44.642 INFO:teuthology.orchestra.run.smithi187.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 2.1 MB/s | 125 kB 00:00 2023-10-08T13:15:44.704 INFO:teuthology.orchestra.run.smithi139.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2023-10-08T13:15:44.748 INFO:teuthology.orchestra.run.smithi139.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 575 kB/s | 64 kB 00:00 2023-10-08T13:15:44.750 INFO:teuthology.orchestra.run.smithi187.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 1.8 MB/s | 197 kB 00:00 2023-10-08T13:15:44.771 INFO:teuthology.orchestra.run.smithi139.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.8 MB/s | 126 kB 00:00 2023-10-08T13:15:44.788 INFO:teuthology.orchestra.run.smithi139.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 509 kB/s | 20 kB 00:00 2023-10-08T13:15:44.813 INFO:teuthology.orchestra.run.smithi139.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-10-08T13:15:44.855 INFO:teuthology.orchestra.run.smithi139.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-08T13:15:44.859 INFO:teuthology.orchestra.run.smithi187.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 3.4 MB/s | 371 kB 00:00 2023-10-08T13:15:44.959 INFO:teuthology.orchestra.run.smithi187.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 3.6 MB/s | 365 kB 00:00 2023-10-08T13:15:44.989 INFO:teuthology.orchestra.run.smithi139.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-10-08T13:15:45.009 INFO:teuthology.orchestra.run.smithi187.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 107 kB 00:00 2023-10-08T13:15:45.014 INFO:teuthology.orchestra.run.smithi139.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-10-08T13:15:45.056 INFO:teuthology.orchestra.run.smithi139.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-08T13:15:45.060 INFO:teuthology.orchestra.run.smithi187.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-08T13:15:45.098 INFO:teuthology.orchestra.run.smithi139.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-08T13:15:45.349 INFO:teuthology.orchestra.run.smithi139.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 9.1 MB/s | 4.9 MB 00:00 2023-10-08T13:15:45.350 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-10-08T13:15:45.472 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-10-08T13:15:45.472 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-10-08T13:15:45.507 INFO:teuthology.orchestra.run.smithi139.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 9.1 MB/s | 4.7 MB 00:00 2023-10-08T13:15:45.574 INFO:teuthology.orchestra.run.smithi139.stdout:(126/131): postgresql-contrib-10.21-2.module+el 3.5 MB/s | 808 kB 00:00 2023-10-08T13:15:45.633 INFO:teuthology.orchestra.run.smithi139.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-08T13:15:45.716 INFO:teuthology.orchestra.run.smithi139.stdout:(128/131): postgresql-server-10.21-2.module+el8 8.2 MB/s | 5.1 MB 00:00 2023-10-08T13:15:45.775 INFO:teuthology.orchestra.run.smithi139.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-08T13:15:45.786 INFO:teuthology.orchestra.run.smithi187.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 4.9 MB/s | 3.6 MB 00:00 2023-10-08T13:15:46.002 INFO:teuthology.orchestra.run.smithi187.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 830 kB/s | 179 kB 00:00 2023-10-08T13:15:46.069 INFO:teuthology.orchestra.run.smithi187.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 346 kB/s | 23 kB 00:00 2023-10-08T13:15:46.178 INFO:teuthology.orchestra.run.smithi187.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 1.2 MB/s | 132 kB 00:00 2023-10-08T13:15:46.408 INFO:teuthology.orchestra.run.smithi139.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 4.5 MB/s | 3.7 MB 00:00 2023-10-08T13:15:46.604 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-10-08T13:15:46.608 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-10-08T13:15:46.611 INFO:teuthology.orchestra.run.smithi187.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 4.1 MB/s | 1.8 MB 00:00 2023-10-08T13:15:46.883 INFO:teuthology.orchestra.run.smithi139.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 3.0 MB/s | 3.7 MB 00:01 2023-10-08T13:15:46.886 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:15:46.887 INFO:teuthology.orchestra.run.smithi139.stdout:Total 9.4 MB/s | 209 MB 00:22 2023-10-08T13:15:47.700 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2023-10-08T13:15:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2023-10-08T13:15:47.819 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2023-10-08T13:15:47.961 INFO:teuthology.orchestra.run.smithi187.stdout:(30/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 4.6 MB/s | 49 MB 00:10 2023-10-08T13:15:48.028 INFO:teuthology.orchestra.run.smithi187.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 3.6 MB/s | 242 kB 00:00 2023-10-08T13:15:48.145 INFO:teuthology.orchestra.run.smithi187.stdout:(32/131): ceph-mgr-diskprediction-local-18.0.0- 4.8 MB/s | 7.4 MB 00:01 2023-10-08T13:15:48.170 INFO:teuthology.orchestra.run.smithi187.stdout:(33/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 335 kB/s | 47 kB 00:00 2023-10-08T13:15:48.196 INFO:teuthology.orchestra.run.smithi187.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6639.g7 290 kB/s | 15 kB 00:00 2023-10-08T13:15:48.221 INFO:teuthology.orchestra.run.smithi187.stdout:(35/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 5.1 MB/s | 261 kB 00:00 2023-10-08T13:15:48.246 INFO:teuthology.orchestra.run.smithi187.stdout:(36/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 3.7 MB/s | 190 kB 00:00 2023-10-08T13:15:48.271 INFO:teuthology.orchestra.run.smithi187.stdout:(37/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 361 kB/s | 18 kB 00:00 2023-10-08T13:15:48.830 INFO:teuthology.orchestra.run.smithi187.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 105 kB/s | 59 kB 00:00 2023-10-08T13:15:48.952 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2023-10-08T13:15:48.956 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2023-10-08T13:15:49.047 INFO:teuthology.orchestra.run.smithi187.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 346 kB/s | 75 kB 00:00 2023-10-08T13:15:49.072 INFO:teuthology.orchestra.run.smithi187.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 371 kB/s | 306 kB 00:00 2023-10-08T13:15:49.189 INFO:teuthology.orchestra.run.smithi187.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 373 kB/s | 44 kB 00:00 2023-10-08T13:15:49.339 INFO:teuthology.orchestra.run.smithi187.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-10-08T13:15:49.365 INFO:teuthology.orchestra.run.smithi187.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-10-08T13:15:49.448 INFO:teuthology.orchestra.run.smithi187.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-10-08T13:15:49.465 INFO:teuthology.orchestra.run.smithi187.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-10-08T13:15:49.591 INFO:teuthology.orchestra.run.smithi187.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-08T13:15:49.616 INFO:teuthology.orchestra.run.smithi187.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.5 MB/s | 384 kB 00:00 2023-10-08T13:15:49.717 INFO:teuthology.orchestra.run.smithi187.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 649 kB/s | 81 kB 00:00 2023-10-08T13:15:49.733 INFO:teuthology.orchestra.run.smithi187.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-10-08T13:15:49.817 INFO:teuthology.orchestra.run.smithi187.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-10-08T13:15:49.934 INFO:teuthology.orchestra.run.smithi187.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 418 kB/s | 49 kB 00:00 2023-10-08T13:15:49.976 INFO:teuthology.orchestra.run.smithi187.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-10-08T13:15:50.051 INFO:teuthology.orchestra.run.smithi187.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2023-10-08T13:15:50.085 INFO:teuthology.orchestra.run.smithi187.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 554 kB/s | 60 kB 00:00 2023-10-08T13:15:50.327 INFO:teuthology.orchestra.run.smithi187.stdout:(55/131): ceph-common-18.0.0-6639.g7b3143ba.el8 937 kB/s | 23 MB 00:24 2023-10-08T13:15:50.354 INFO:teuthology.orchestra.run.smithi187.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 58 kB/s | 16 kB 00:00 2023-10-08T13:15:50.377 INFO:teuthology.orchestra.run.smithi187.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 868 kB/s | 283 kB 00:00 2023-10-08T13:15:50.427 INFO:teuthology.orchestra.run.smithi187.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2023-10-08T13:15:50.486 INFO:teuthology.orchestra.run.smithi187.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2023-10-08T13:15:50.528 INFO:teuthology.orchestra.run.smithi187.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-10-08T13:15:50.595 INFO:teuthology.orchestra.run.smithi187.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-10-08T13:15:50.637 INFO:teuthology.orchestra.run.smithi187.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 273 kB/s | 29 kB 00:00 2023-10-08T13:15:50.704 INFO:teuthology.orchestra.run.smithi187.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2023-10-08T13:15:50.754 INFO:teuthology.orchestra.run.smithi187.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-08T13:15:50.854 INFO:teuthology.orchestra.run.smithi187.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-10-08T13:15:50.880 INFO:teuthology.orchestra.run.smithi187.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-10-08T13:15:50.930 INFO:teuthology.orchestra.run.smithi187.stdout:(67/131): python3-routes-2.4.1-12.el8.noarch.rp 340 kB/s | 196 kB 00:00 2023-10-08T13:15:50.972 INFO:teuthology.orchestra.run.smithi187.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2023-10-08T13:15:50.997 INFO:teuthology.orchestra.run.smithi187.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-10-08T13:15:51.022 INFO:teuthology.orchestra.run.smithi187.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-08T13:15:51.081 INFO:teuthology.orchestra.run.smithi187.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-10-08T13:15:51.123 INFO:teuthology.orchestra.run.smithi187.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-08T13:15:51.194 INFO:teuthology.orchestra.run.smithi187.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.6 MB/s | 259 kB 00:00 2023-10-08T13:15:51.240 INFO:teuthology.orchestra.run.smithi187.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.8 MB/s | 323 kB 00:00 2023-10-08T13:15:51.274 INFO:teuthology.orchestra.run.smithi187.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-08T13:15:51.425 INFO:teuthology.orchestra.run.smithi187.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 4.5 MB/s | 688 kB 00:00 2023-10-08T13:15:51.538 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-10-08T13:15:51.641 INFO:teuthology.orchestra.run.smithi187.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 2.4 MB/s | 1.7 MB 00:00 2023-10-08T13:15:51.675 INFO:teuthology.orchestra.run.smithi187.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.1 MB/s | 538 kB 00:00 2023-10-08T13:15:51.704 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T13:15:51.725 INFO:teuthology.orchestra.run.smithi187.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.1 MB/s | 187 kB 00:00 2023-10-08T13:15:51.751 INFO:teuthology.orchestra.run.smithi187.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-10-08T13:15:51.784 INFO:teuthology.orchestra.run.smithi187.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-08T13:15:51.818 INFO:teuthology.orchestra.run.smithi187.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 801 kB/s | 27 kB 00:00 2023-10-08T13:15:51.870 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T13:15:51.968 INFO:teuthology.orchestra.run.smithi187.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 14 MB/s | 14 MB 00:00 2023-10-08T13:15:52.002 INFO:teuthology.orchestra.run.smithi187.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.7 MB/s | 320 kB 00:00 2023-10-08T13:15:52.019 INFO:teuthology.orchestra.run.smithi187.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 879 kB/s | 44 kB 00:00 2023-10-08T13:15:52.039 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T13:15:52.094 INFO:teuthology.orchestra.run.smithi187.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2023-10-08T13:15:52.136 INFO:teuthology.orchestra.run.smithi187.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-08T13:15:52.137 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T13:15:52.211 INFO:teuthology.orchestra.run.smithi187.stdout:(88/131): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-10-08T13:15:52.237 INFO:teuthology.orchestra.run.smithi187.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 640 kB/s | 64 kB 00:00 2023-10-08T13:15:52.262 INFO:teuthology.orchestra.run.smithi187.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-08T13:15:52.287 INFO:teuthology.orchestra.run.smithi187.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2023-10-08T13:15:52.314 INFO:teuthology.orchestra.run.smithi187.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-08T13:15:52.364 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T13:15:52.379 INFO:teuthology.orchestra.run.smithi187.stdout:(93/131): python3-numpy-1.14.3-10.el8.x86_64.rp 9.9 MB/s | 3.7 MB 00:00 2023-10-08T13:15:52.413 INFO:teuthology.orchestra.run.smithi187.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2023-10-08T13:15:52.439 INFO:teuthology.orchestra.run.smithi187.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-08T13:15:52.472 INFO:teuthology.orchestra.run.smithi187.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2023-10-08T13:15:52.514 INFO:teuthology.orchestra.run.smithi187.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-08T13:15:52.622 INFO:teuthology.orchestra.run.smithi187.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-10-08T13:15:52.689 INFO:teuthology.orchestra.run.smithi187.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T13:15:52.740 INFO:teuthology.orchestra.run.smithi187.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-08T13:15:52.763 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T13:15:52.773 INFO:teuthology.orchestra.run.smithi187.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-08T13:15:52.815 INFO:teuthology.orchestra.run.smithi187.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-08T13:15:52.840 INFO:teuthology.orchestra.run.smithi187.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-08T13:15:52.874 INFO:teuthology.orchestra.run.smithi187.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 723 kB/s | 43 kB 00:00 2023-10-08T13:15:52.899 INFO:teuthology.orchestra.run.smithi187.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-10-08T13:15:52.925 INFO:teuthology.orchestra.run.smithi187.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-10-08T13:15:52.950 INFO:teuthology.orchestra.run.smithi187.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-08T13:15:52.992 INFO:teuthology.orchestra.run.smithi187.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 639 kB/s | 43 kB 00:00 2023-10-08T13:15:53.005 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T13:15:53.017 INFO:teuthology.orchestra.run.smithi187.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.6 MB/s | 109 kB 00:00 2023-10-08T13:15:53.042 INFO:teuthology.orchestra.run.smithi187.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-08T13:15:53.109 INFO:teuthology.orchestra.run.smithi187.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.5 MB/s | 5.1 MB 00:00 2023-10-08T13:15:53.137 INFO:teuthology.orchestra.run.smithi187.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-10-08T13:15:53.160 INFO:teuthology.orchestra.run.smithi187.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-08T13:15:53.185 INFO:teuthology.orchestra.run.smithi187.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T13:15:53.211 INFO:teuthology.orchestra.run.smithi187.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-10-08T13:15:53.244 INFO:teuthology.orchestra.run.smithi187.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-10-08T13:15:53.278 INFO:teuthology.orchestra.run.smithi187.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-10-08T13:15:53.303 INFO:teuthology.orchestra.run.smithi187.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-10-08T13:15:53.328 INFO:teuthology.orchestra.run.smithi187.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-08T13:15:53.354 INFO:teuthology.orchestra.run.smithi187.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-08T13:15:53.379 INFO:teuthology.orchestra.run.smithi187.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-08T13:15:53.404 INFO:teuthology.orchestra.run.smithi187.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-08T13:15:53.415 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T13:15:53.421 INFO:teuthology.orchestra.run.smithi187.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-10-08T13:15:53.438 INFO:teuthology.orchestra.run.smithi187.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-08T13:15:53.480 INFO:teuthology.orchestra.run.smithi187.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-08T13:15:53.505 INFO:teuthology.orchestra.run.smithi187.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-10-08T13:15:53.531 INFO:teuthology.orchestra.run.smithi187.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-08T13:15:53.580 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:15:53.589 INFO:teuthology.orchestra.run.smithi187.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-10-08T13:15:53.648 INFO:teuthology.orchestra.run.smithi187.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-08T13:15:53.710 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:15:53.888 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:15:53.931 INFO:teuthology.orchestra.run.smithi187.stdout:(130/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 9.3 MB/s | 3.7 MB 00:00 2023-10-08T13:15:53.990 INFO:teuthology.orchestra.run.smithi187.stdout:(131/131): librados2-18.0.0-6639.g7b3143ba.el8. 7.7 MB/s | 3.7 MB 00:00 2023-10-08T13:15:53.994 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:15:53.995 INFO:teuthology.orchestra.run.smithi187.stdout:Total 7.3 MB/s | 209 MB 00:28 2023-10-08T13:15:54.032 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:15:54.332 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2023-10-08T13:15:54.394 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:15:54.516 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T13:15:54.580 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T13:15:54.700 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T13:15:54.807 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T13:15:54.838 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-10-08T13:15:54.894 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T13:15:54.959 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-10-08T13:15:54.959 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-10-08T13:15:54.992 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T13:15:55.034 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T13:15:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T13:15:55.441 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T13:15:55.653 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T13:15:55.679 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T13:15:55.822 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:15:55.894 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T13:15:55.918 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:15:56.080 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:15:56.088 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-10-08T13:15:56.092 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-10-08T13:15:56.223 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:15:56.304 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T13:15:56.425 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T13:15:56.510 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:15:56.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T13:15:56.645 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:15:56.761 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T13:15:56.826 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:15:56.888 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T13:15:56.954 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:15:57.038 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T13:15:57.098 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:15:57.196 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T13:15:57.265 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T13:15:57.497 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T13:15:57.722 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T13:15:57.801 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T13:15:57.955 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T13:15:58.085 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T13:15:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T13:15:58.492 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:15:58.543 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T13:15:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:15:58.713 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T13:15:58.735 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:15:58.878 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:15:59.080 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T13:15:59.239 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T13:15:59.401 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T13:15:59.439 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T13:15:59.567 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T13:15:59.653 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T13:15:59.709 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T13:15:59.835 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T13:15:59.868 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T13:16:00.039 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T13:16:00.210 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T13:16:00.332 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T13:16:00.466 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T13:16:00.542 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T13:16:00.651 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T13:16:00.771 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T13:16:00.944 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-10-08T13:16:01.141 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T13:16:01.232 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T13:16:01.303 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T13:16:01.426 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T13:16:01.508 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T13:16:01.651 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T13:16:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T13:16:02.026 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T13:16:02.132 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T13:16:02.357 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T13:16:02.427 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T13:16:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T13:16:02.549 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T13:16:02.626 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:16:02.769 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T13:16:02.973 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T13:16:03.020 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:16:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T13:16:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:16:03.319 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:16:03.347 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T13:16:03.509 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:16:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T13:16:03.552 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T13:16:03.604 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:16:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T13:16:03.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T13:16:04.004 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T13:16:04.147 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T13:16:04.187 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T13:16:04.385 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T13:16:04.578 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T13:16:04.590 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T13:16:04.773 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T13:16:04.842 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T13:16:04.943 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T13:16:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:16:05.079 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T13:16:05.110 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T13:16:05.234 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:16:05.278 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T13:16:05.309 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T13:16:05.317 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T13:16:05.422 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T13:16:05.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T13:16:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T13:16:05.612 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T13:16:05.682 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T13:16:05.725 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T13:16:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T13:16:06.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T13:16:06.245 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T13:16:06.327 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T13:16:06.340 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T13:16:06.347 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T13:16:06.517 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T13:16:06.559 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T13:16:06.683 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T13:16:06.716 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T13:16:06.920 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T13:16:06.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T13:16:07.098 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T13:16:07.114 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T13:16:07.200 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T13:16:07.289 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T13:16:07.342 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T13:16:07.437 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T13:16:07.441 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T13:16:07.601 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T13:16:07.637 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T13:16:07.822 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T13:16:07.861 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T13:16:07.964 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T13:16:08.059 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T13:16:08.106 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T13:16:08.231 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T13:16:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T13:16:08.306 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T13:16:08.399 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T13:16:08.457 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T13:16:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T13:16:08.571 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T13:16:08.693 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T13:16:08.712 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T13:16:08.773 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T13:16:08.889 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T13:16:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T13:16:08.992 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T13:16:09.074 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T13:16:09.096 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T13:16:09.152 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T13:16:09.174 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T13:16:09.361 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T13:16:09.385 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T13:16:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T13:16:09.511 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T13:16:09.564 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T13:16:09.648 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T13:16:09.694 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T13:16:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T13:16:09.817 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T13:16:09.904 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T13:16:09.968 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T13:16:10.093 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T13:16:10.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T13:16:10.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T13:16:10.295 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T13:16:10.464 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T13:16:10.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T13:16:10.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T13:16:10.841 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T13:16:10.843 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T13:16:10.931 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T13:16:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T13:16:11.184 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T13:16:11.226 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T13:16:11.325 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T13:16:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T13:16:11.482 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T13:16:11.570 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T13:16:11.613 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T13:16:11.641 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T13:16:11.719 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T13:16:11.854 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T13:16:11.897 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T13:16:12.147 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T13:16:12.148 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T13:16:12.359 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T13:16:12.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T13:16:12.498 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T13:16:12.592 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T13:16:12.637 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T13:16:12.836 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T13:16:12.837 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T13:16:12.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T13:16:13.072 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T13:16:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T13:16:13.237 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T13:16:13.405 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T13:16:13.406 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T13:16:13.448 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T13:16:13.550 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T13:16:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T13:16:13.725 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T13:16:13.782 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T13:16:13.920 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T13:16:13.944 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T13:16:13.989 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T13:16:14.125 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T13:16:14.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T13:16:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T13:16:14.298 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T13:16:14.313 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T13:16:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T13:16:14.484 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T13:16:14.486 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T13:16:14.626 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T13:16:14.648 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T13:16:14.766 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T13:16:14.785 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T13:16:14.825 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T13:16:14.993 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T13:16:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T13:16:15.054 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T13:16:15.135 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T13:16:15.186 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T13:16:15.325 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T13:16:15.355 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T13:16:15.536 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T13:16:15.565 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T13:16:15.785 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T13:16:15.925 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T13:16:15.984 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T13:16:16.151 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T13:16:16.152 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T13:16:16.227 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T13:16:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T13:16:16.405 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T13:16:16.417 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T13:16:16.514 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T13:16:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T13:16:16.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T13:16:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T13:16:16.870 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T13:16:16.954 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T13:16:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T13:16:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T13:16:17.226 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T13:16:17.253 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T13:16:17.398 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T13:16:17.412 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T13:16:17.464 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T13:16:17.600 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T13:16:17.663 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T13:16:17.812 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T13:16:17.890 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T13:16:17.986 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T13:16:18.144 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T13:16:18.232 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T13:16:18.385 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:18.470 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:18.472 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T13:16:18.635 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T13:16:18.712 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T13:16:18.936 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T13:16:19.019 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T13:16:19.196 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T13:16:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T13:16:19.372 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T13:16:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T13:16:19.581 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T13:16:19.698 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T13:16:19.755 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T13:16:19.885 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T13:16:20.021 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T13:16:20.182 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T13:16:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T13:16:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T13:16:20.406 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T13:16:20.483 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T13:16:20.718 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T13:16:20.882 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T13:16:21.080 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T13:16:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T13:16:21.250 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T13:16:21.364 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:21.418 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:21.516 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T13:16:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T13:16:21.763 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T13:16:21.943 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T13:16:22.100 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T13:16:22.313 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T13:16:22.524 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T13:16:22.626 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:22.843 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:23.016 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T13:16:23.183 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T13:16:23.320 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T13:16:23.432 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:23.536 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T13:16:23.690 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:23.772 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:23.810 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T13:16:23.892 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:23.995 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T13:16:24.254 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T13:16:24.463 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T13:16:24.655 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T13:16:24.881 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T13:16:25.659 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:25.897 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:25.999 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T13:16:26.284 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T13:16:26.475 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:26.555 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T13:16:26.730 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:26.801 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:26.856 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T13:16:26.988 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:27.154 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T13:16:27.338 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T13:16:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T13:16:28.371 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:28.444 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T13:16:28.622 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T13:16:32.350 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:32.596 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:33.181 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T13:16:33.892 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:33.965 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T13:16:34.129 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /run 2023-10-08T13:16:42.807 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-10-08T13:16:42.808 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-10-08T13:16:42.808 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-10-08T13:16:42.808 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-10-08T13:16:42.808 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /dev 2023-10-08T13:16:42.808 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:16:43.156 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:44.766 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:44.920 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:45.144 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:45.347 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:45.818 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:45.956 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:45.972 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:46.035 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2023-10-08T13:16:46.035 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /run 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /dev 2023-10-08T13:16:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:16:46.368 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:47.672 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:47.864 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:47.955 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:47.986 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T13:16:48.159 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:48.187 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T13:16:48.372 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:48.379 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:48.595 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:48.894 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:16:49.035 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:49.861 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:16:50.046 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:16:50.138 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:16:50.472 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T13:16:50.670 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:16:50.705 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:16:50.838 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:16:50.849 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:16:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:51.111 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:51.223 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T13:16:51.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T13:16:51.642 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:51.864 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:52.125 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T13:16:52.376 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:16:52.410 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:16:52.581 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:16:52.721 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:16:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:16:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:16:53.191 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T13:16:53.191 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-10-08T13:16:53.192 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-10-08T13:16:53.193 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:16:53.230 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:16:53.242 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:16:53.332 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:16:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T13:16:53.943 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:16:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:16:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:16:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:16:55.164 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T13:16:55.347 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:55.477 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T13:16:55.566 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T13:16:55.680 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:16:55.713 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:16:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:55.891 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:16:55.941 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:16:56.083 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:16:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T13:16:56.400 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:56.417 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T13:16:56.442 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:16:56.583 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:16:57.924 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:16:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:58.456 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T13:16:58.564 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T13:16:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T13:16:58.796 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T13:16:58.949 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:59.108 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T13:16:59.170 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T13:16:59.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T13:16:59.486 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:16:59.543 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T13:16:59.703 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T13:16:59.896 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T13:17:00.116 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T13:17:00.283 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T13:17:00.430 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T13:17:00.447 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T13:17:00.640 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:17:00.731 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T13:17:01.102 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T13:17:01.220 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:17:01.356 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:17:01.392 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T13:17:01.557 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:17:01.569 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T13:17:02.145 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T13:17:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T13:17:02.610 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:02.684 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T13:17:02.853 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:02.872 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:02.886 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T13:17:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T13:17:03.029 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T13:17:03.108 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:17:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T13:17:03.141 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T13:17:03.282 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:17:03.303 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T13:17:03.306 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T13:17:03.324 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T13:17:03.465 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:17:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T13:17:03.619 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T13:17:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T13:17:03.825 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T13:17:03.908 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T13:17:03.970 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T13:17:04.024 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:17:04.144 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T13:17:04.231 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T13:17:04.411 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T13:17:04.424 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T13:17:04.586 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T13:17:04.594 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T13:17:04.730 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T13:17:04.730 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:04.939 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:04.939 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:05.166 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:05.376 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T13:17:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T13:17:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T13:17:05.887 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T13:17:05.888 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T13:17:05.889 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T13:17:05.890 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T13:17:05.890 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T13:17:05.890 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T13:17:05.890 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T13:17:05.898 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T13:17:05.898 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T13:17:05.899 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T13:17:05.900 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T13:17:05.901 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T13:17:05.902 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T13:17:05.903 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T13:17:05.904 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T13:17:05.905 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T13:17:05.906 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T13:17:05.906 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T13:17:05.906 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T13:17:05.906 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T13:17:05.906 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T13:17:05.907 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:05.908 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T13:17:06.134 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:06.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:06.424 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:06.582 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T13:17:06.930 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T13:17:07.250 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T13:17:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T13:17:07.864 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T13:17:07.955 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T13:17:08.139 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T13:17:08.151 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T13:17:08.289 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T13:17:08.297 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T13:17:08.342 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:08.342 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:01:56 ago on Sun 08 Oct 2023 01:15:12 PM UTC. 2023-10-08T13:17:08.458 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T13:17:08.458 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:08.659 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:08.679 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T13:17:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:08.961 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T13:17:09.131 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T13:17:09.179 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:09.319 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T13:17:09.686 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T13:17:09.687 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T13:17:09.688 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T13:17:09.689 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T13:17:09.690 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T13:17:09.691 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T13:17:09.692 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T13:17:09.693 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T13:17:09.694 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T13:17:09.695 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T13:17:09.696 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T13:17:09.697 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T13:17:09.698 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T13:17:09.698 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T13:17:09.698 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:09.698 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T13:17:10.226 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T13:17:10.567 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T13:17:10.741 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T13:17:10.775 INFO:teuthology.orchestra.run.smithi155.stdout:Installed products updated. 2023-10-08T13:17:10.918 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T13:17:10.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T13:17:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-3.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T13:17:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T13:17:10.995 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:10.996 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T13:17:10.997 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T13:17:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T13:17:10.999 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T13:17:11.000 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T13:17:11.001 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-10-08T13:17:11.002 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-10-08T13:17:11.084 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T13:17:11.185 DEBUG:teuthology.parallel:result is None 2023-10-08T13:17:11.248 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T13:17:12.180 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:12.180 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:00 ago on Sun 08 Oct 2023 01:15:12 PM UTC. 2023-10-08T13:17:13.409 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:13.663 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:13.682 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T13:17:13.864 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T13:17:14.187 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T13:17:14.478 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T13:17:14.748 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T13:17:14.848 INFO:teuthology.orchestra.run.smithi139.stdout:Installed products updated. 2023-10-08T13:17:14.888 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T13:17:14.897 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T13:17:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:17:15.063 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2023-10-08T13:17:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: jq-1.6-3.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T13:17:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T13:17:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T13:17:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T13:17:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T13:17:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T13:17:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T13:17:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T13:17:15.075 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T13:17:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T13:17:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:17:15.075 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2023-10-08T13:17:15.254 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T13:17:15.289 DEBUG:teuthology.parallel:result is None 2023-10-08T13:17:15.337 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T13:17:15.538 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T13:17:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T13:17:15.550 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:15.766 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:15.766 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:16.002 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T13:17:16.236 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T13:17:16.757 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T13:17:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T13:17:16.759 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T13:17:16.760 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T13:17:16.761 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T13:17:16.762 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T13:17:16.763 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T13:17:16.764 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T13:17:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T13:17:16.766 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T13:17:16.767 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T13:17:16.768 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T13:17:16.768 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T13:17:16.768 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T13:17:16.768 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T13:17:19.231 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T13:17:19.232 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:02:06 ago on Sun 08 Oct 2023 01:15:13 PM UTC. 2023-10-08T13:17:22.433 INFO:teuthology.orchestra.run.smithi187.stdout:Installed products updated. 2023-10-08T13:17:22.650 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:17:22.650 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-10-08T13:17:22.650 INFO:teuthology.orchestra.run.smithi187.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.651 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.652 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-3.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T13:17:22.653 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.654 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T13:17:22.655 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.656 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T13:17:22.657 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T13:17:22.658 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.659 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T13:17:22.660 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T13:17:22.661 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T13:17:22.662 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T13:17:22.662 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:17:22.662 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-10-08T13:17:22.853 DEBUG:teuthology.parallel:result is None 2023-10-08T13:17:22.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:23.251 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T13:17:23.280 INFO:teuthology.orchestra.run.smithi139.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.280 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.281 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T13:17:23.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:23.636 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T13:17:23.665 INFO:teuthology.orchestra.run.smithi155.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.665 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.665 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T13:17:23.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:23.814 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T13:17:23.842 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.842 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T13:17:23.842 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T13:17:23.842 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T13:17:23.843 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:17:23.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T13:17:23.890 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:17:23.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T13:17:23.938 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:17:23.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T13:17:23.986 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T13:17:23.986 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:17:23.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T13:17:24.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T13:17:24.091 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:17:24.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T13:17:24.122 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T13:17:24.192 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:17:24.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T13:17:24.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T13:17:24.294 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T13:17:24.294 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:17:24.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T13:17:24.326 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T13:17:24.396 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:17:24.396 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T13:17:24.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T13:17:24.495 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:17:24.495 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T13:17:24.527 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T13:17:24.598 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T13:17:24.599 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:17:24.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T13:17:24.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T13:17:24.703 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:17:24.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T13:17:24.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T13:17:24.801 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:17:24.801 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T13:17:24.833 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T13:17:24.904 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-08T13:17:24.986 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-08T13:17:24.986 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:24.987 INFO:tasks.cephadm:Cluster fsid is 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:17:24.987 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-08T13:17:24.988 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.139', 'mon.b': '172.21.15.155', 'mon.c': '172.21.15.187'} 2023-10-08T13:17:24.988 INFO:tasks.cephadm:First mon is mon.a on smithi139 2023-10-08T13:17:24.989 INFO:tasks.cephadm:First mgr is x 2023-10-08T13:17:24.989 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-08T13:17:24.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2023-10-08T13:17:25.023 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2023-10-08T13:17:25.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2023-10-08T13:17:25.087 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-08T13:17:25.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:25.226 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73096/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6639-g7b3143ba', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6639.g7b3143ba'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-07 17:16:01.199993', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231007.154158', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-08T13:17:25.362 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-batrick-testing-20231007.154158, sha1 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:17:25.362 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm 2023-10-08T13:17:25.363 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:25.763 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 13:17 /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:25.764 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.221 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 13:17 /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.222 DEBUG:teuthology.orchestra.run.smithi187:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.625 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 13:17 /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.626 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.647 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.669 DEBUG:teuthology.orchestra.run.smithi187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T13:17:26.704 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de on all hosts... 2023-10-08T13:17:26.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T13:17:26.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T13:17:26.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T13:17:29.393 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T13:17:31.824 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T13:17:32.616 INFO:teuthology.orchestra.run.smithi187.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2023-10-08T13:17:54.977 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-10-08T13:18:01.013 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:18:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T13:18:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T13:18:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2023-10-08T13:18:01.013 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T13:18:01.014 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:18:01.014 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:18:01.289 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-10-08T13:18:01.289 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T13:18:01.290 INFO:teuthology.orchestra.run.smithi187.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T13:18:01.290 INFO:teuthology.orchestra.run.smithi187.stdout: "repo_digests": [ 2023-10-08T13:18:01.290 INFO:teuthology.orchestra.run.smithi187.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T13:18:01.290 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2023-10-08T13:18:01.290 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-10-08T13:18:01.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2023-10-08T13:18:01.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2023-10-08T13:18:01.377 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2023-10-08T13:18:01.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2023-10-08T13:18:01.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2023-10-08T13:18:01.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph 2023-10-08T13:18:01.488 INFO:tasks.cephadm:Writing seed config... 2023-10-08T13:18:01.489 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-08T13:18:01.490 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-08T13:18:01.491 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-10-08T13:18:01.492 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:18:01.492 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-08T13:18:01.510 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0585722a-65dd-11ee-8db5-212e2dc638e7 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2023-10-08T13:18:01.510 DEBUG:teuthology.orchestra.run.smithi139:mon.a> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-08T13:18:01.552 DEBUG:teuthology.orchestra.run.smithi139:mgr.x> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-08T13:18:01.577 INFO:journalctl@ceph.mon.a.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:18:01.578 INFO:tasks.cephadm:Bootstrapping... 2023-10-08T13:18:01.578 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de -v bootstrap --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.139 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:18:01.603 INFO:journalctl@ceph.mgr.x.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:18:01.740 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2023-10-08T13:18:01.741 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', '-v', 'bootstrap', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.139', '--skip-admin-label'] 2023-10-08T13:18:01.885 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stdout 4.1.1 2023-10-08T13:18:01.885 INFO:teuthology.orchestra.run.smithi139.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-08T13:18:01.885 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying podman|docker is present... 2023-10-08T13:18:02.027 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stdout 4.1.1 2023-10-08T13:18:02.027 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying lvm2 is present... 2023-10-08T13:18:02.027 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying time synchronization is in place... 2023-10-08T13:18:02.034 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T13:18:02.034 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T13:18:02.040 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T13:18:02.040 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:18:02.046 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout enabled 2023-10-08T13:18:02.051 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout active 2023-10-08T13:18:02.051 INFO:teuthology.orchestra.run.smithi139.stdout:Unit chronyd.service is enabled and running 2023-10-08T13:18:02.052 INFO:teuthology.orchestra.run.smithi139.stdout:Repeating the final host check... 2023-10-08T13:18:02.194 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stdout 4.1.1 2023-10-08T13:18:02.194 INFO:teuthology.orchestra.run.smithi139.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-08T13:18:02.194 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl is present 2023-10-08T13:18:02.194 INFO:teuthology.orchestra.run.smithi139.stdout:lvcreate is present 2023-10-08T13:18:02.200 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T13:18:02.200 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T13:18:02.206 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T13:18:02.206 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:18:02.211 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout enabled 2023-10-08T13:18:02.217 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout active 2023-10-08T13:18:02.217 INFO:teuthology.orchestra.run.smithi139.stdout:Unit chronyd.service is enabled and running 2023-10-08T13:18:02.217 INFO:teuthology.orchestra.run.smithi139.stdout:Host looks OK 2023-10-08T13:18:02.218 INFO:teuthology.orchestra.run.smithi139.stdout:Cluster fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:02.218 INFO:teuthology.orchestra.run.smithi139.stdout:Acquiring lock 140382740990440 on /run/cephadm/0585722a-65dd-11ee-8db5-212e2dc638e7.lock 2023-10-08T13:18:02.218 INFO:teuthology.orchestra.run.smithi139.stdout:Lock 140382740990440 acquired on /run/cephadm/0585722a-65dd-11ee-8db5-212e2dc638e7.lock 2023-10-08T13:18:02.218 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying IP 172.21.15.139 port 3300 ... 2023-10-08T13:18:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying IP 172.21.15.139 port 6789 ... 2023-10-08T13:18:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:Base mon IP(s) is [172.21.15.139:3300, 172.21.15.139:6789], mon addrv is [v2:172.21.15.139:3300,v1:172.21.15.139:6789] 2023-10-08T13:18:02.222 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-10-08T13:18:02.222 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.139 metric 100 2023-10-08T13:18:02.225 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-08T13:18:02.225 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-10-08T13:18:02.225 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout inet6 fe80::96c3:5485:c6ea:316f/64 scope link noprefixroute 2023-10-08T13:18:02.228 INFO:teuthology.orchestra.run.smithi139.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T13:18:02.229 INFO:teuthology.orchestra.run.smithi139.stdout:Mon IP `172.21.15.139` is in CIDR network `172.21.0.0/20` 2023-10-08T13:18:02.229 INFO:teuthology.orchestra.run.smithi139.stdout:Mon IP `172.21.15.139` is in CIDR network `172.21.0.0/20` 2023-10-08T13:18:02.229 INFO:teuthology.orchestra.run.smithi139.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-08T13:18:02.229 INFO:teuthology.orchestra.run.smithi139.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-08T13:18:02.230 INFO:teuthology.orchestra.run.smithi139.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T13:18:03.079 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stdout 09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T13:18:03.079 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T13:18:03.079 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Getting image source signatures 2023-10-08T13:18:03.079 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Copying blob sha256:1016a809630cb60ade9603521911a0725a35bac1f67b6518836ae2dd33bb1dad 2023-10-08T13:18:03.080 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-08T13:18:03.080 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Copying config sha256:09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T13:18:03.080 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-08T13:18:03.080 INFO:teuthology.orchestra.run.smithi139.stdout:/bin/podman: stderr Storing signatures 2023-10-08T13:18:03.828 INFO:teuthology.orchestra.run.smithi139.stdout:ceph: stdout ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T13:18:03.829 INFO:teuthology.orchestra.run.smithi139.stdout:Ceph version: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T13:18:03.829 INFO:teuthology.orchestra.run.smithi139.stdout:Extracting ceph user uid/gid from container image... 2023-10-08T13:18:04.575 INFO:teuthology.orchestra.run.smithi139.stdout:stat: stdout 167 167 2023-10-08T13:18:04.575 INFO:teuthology.orchestra.run.smithi139.stdout:Creating initial keys... 2023-10-08T13:18:05.228 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph-authtool: stdout AQAMrCJlsKFRNxAAFd7zWUCJaM9WYXhXw8BxKw== 2023-10-08T13:18:05.974 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph-authtool: stdout AQANrCJlfYXsIxAAUOOIxugFAY34txNXmgI2bg== 2023-10-08T13:18:06.723 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph-authtool: stdout AQAOrCJlcBjgFRAAqxJkxPiTGq990HvcTGtMAQ== 2023-10-08T13:18:06.724 INFO:teuthology.orchestra.run.smithi139.stdout:Creating initial monmap... 2023-10-08T13:18:07.571 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool for a [v2:172.21.15.139:3300,v1:172.21.15.139:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:setting min_mon_release = pacific 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: set fsid to 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:18:07.572 INFO:teuthology.orchestra.run.smithi139.stdout:Creating mon... 2023-10-08T13:18:08.319 INFO:teuthology.orchestra.run.smithi139.stdout:create mon.a on 2023-10-08T13:18:08.444 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-08T13:18:08.530 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-08T13:18:08.646 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target. 2023-10-08T13:18:08.646 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target. 2023-10-08T13:18:08.817 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T13:18:08.817 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-08T13:18:08.906 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target.wants/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@.service. 2023-10-08T13:18:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:08 smithi139 systemd[1]: Starting Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:18:09.497 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:09 smithi139 podman[98971]: 2023-10-08T13:18:09.497 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:09 smithi139 bash[98971]: 0429f8bedb8e25a50506ff7eedd1ff33becb253aad51f74c30fb876ae2bdb494 2023-10-08T13:18:09.497 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:09 smithi139 ceph-mon[99011]: mkfs 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:09.497 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:09 smithi139 ceph-mon[99011]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T13:18:09.508 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T13:18:09.509 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout disabled 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:firewalld.service is not enabled 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mon to start... 2023-10-08T13:18:09.516 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mon... 2023-10-08T13:18:09.753 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:09 smithi139 systemd[1]: Started Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout cluster: 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout id: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout services: 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.652893s) 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-08T13:18:10.465 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout data: 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout pgs: 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:mon is available 2023-10-08T13:18:10.466 INFO:teuthology.orchestra.run.smithi139.stdout:Assimilating anything we can from ceph.conf... 2023-10-08T13:18:10.715 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T13:18:10.715 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: monmap e1: 1 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} 2023-10-08T13:18:10.715 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: fsmap 2023-10-08T13:18:10.715 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T13:18:10.715 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: mgrmap e1: no daemons active 2023-10-08T13:18:10.716 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:10 smithi139 ceph-mon[99011]: from='client.? 172.21.15.139:0/3387578532' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout fsid = 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.139:3300,v1:172.21.15.139:6789] 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T13:18:11.409 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T13:18:11.410 INFO:teuthology.orchestra.run.smithi139.stdout:Generating new minimal ceph.conf... 2023-10-08T13:18:11.665 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:11 smithi139 ceph-mon[99011]: from='client.? 172.21.15.139:0/3426536637' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T13:18:11.666 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:11 smithi139 ceph-mon[99011]: from='client.? 172.21.15.139:0/3426536637' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-08T13:18:12.348 INFO:teuthology.orchestra.run.smithi139.stdout:Restarting the monitor... 2023-10-08T13:18:12.681 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:12 smithi139 systemd[1]: Stopping Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:18:12.681 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:12 smithi139 ceph-mon[99011]: from='client.? 172.21.15.139:0/853854666' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:18:12.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[98987]: 2023-10-08T13:18:12.679+0000 7fcf3fee6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:18:12.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[98987]: 2023-10-08T13:18:12.679+0000 7fcf3fee6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-08T13:18:13.229 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:13 smithi139 bash[99345]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T13:18:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:13 smithi139 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T13:18:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:13 smithi139 systemd[1]: Stopped Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:18:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:13 smithi139 systemd[1]: Starting Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:18:14.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:14 smithi139 podman[99466]: 2023-10-08T13:18:15.305 INFO:teuthology.orchestra.run.smithi139.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-08T13:18:15.510 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 bash[99466]: 505ea1ff9709eb7111146bb59b62293b59ea672f86371743c8743efc78cd20b4 2023-10-08T13:18:15.510 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T13:18:15.510 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: pidfile_write: ignore empty --pid-file 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: load: jerasure load: lrc 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: RocksDB version: 7.9.2 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Git sha 0 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: DB SUMMARY 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: DB Session ID: BC4CFHCDR12ZF559JOV4 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: CURRENT file: CURRENT 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-08T13:18:15.511 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89252 ; 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.error_if_exists: 0 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.create_if_missing: 0 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.paranoid_checks: 1 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.env: 0x5577186afda0 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.info_log: 0x5577197f3640 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T13:18:15.512 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.statistics: (nil) 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.use_fsync: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_log_file_size: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_fallocate: 1 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T13:18:15.513 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.use_direct_reads: 0 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.db_log_dir: 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.wal_dir: 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T13:18:15.514 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.write_buffer_manager: 0x5577197ab360 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.unordered_write: 0 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T13:18:15.515 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.row_cache: None 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.wal_filter: None 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.two_write_queues: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.wal_compression: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.atomic_flush: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T13:18:15.516 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.log_readahead_size: 0 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_background_jobs: 2 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_background_compactions: -1 2023-10-08T13:18:15.517 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_subcompactions: 1 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_open_files: -1 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T13:18:15.518 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_background_flushes: -1 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Compression algorithms supported: 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kZSTD supported: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kXpressCompression supported: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kZlibCompression supported: 1 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kSnappyCompression supported: 1 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kLZ4Compression supported: 1 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: kBZip2Compression supported: 0 2023-10-08T13:18:15.519 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.merge_operator: 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_filter: None 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5577197f3740) 2023-10-08T13:18:15.520 INFO:journalctl@ceph.mon.a.smithi139.stdout: cache_index_and_filter_blocks: 1 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: pin_top_level_index_and_filter: 1 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: index_type: 0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: data_block_index_type: 0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: index_shortening: 1 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: checksum: 4 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: no_block_cache: 0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_cache: 0x5577198491f0 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_cache_name: BinnedLRUCache 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_cache_options: 2023-10-08T13:18:15.521 INFO:journalctl@ceph.mon.a.smithi139.stdout: capacity : 536870912 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: num_shard_bits : 4 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: strict_capacity_limit : 0 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: high_pri_pool_ratio: 0.000 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_cache_compressed: (nil) 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: persistent_cache: (nil) 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_size: 4096 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_size_deviation: 10 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_restart_interval: 16 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: index_block_restart_interval: 1 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: metadata_block_size: 4096 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: partition_filters: 0 2023-10-08T13:18:15.522 INFO:journalctl@ceph.mon.a.smithi139.stdout: use_delta_encoding: 1 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: filter_policy: bloomfilter 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: whole_key_filtering: 1 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: verify_compression: 0 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: read_amp_bytes_per_bit: 0 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: format_version: 5 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: enable_index_compression: 1 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: block_align: 0 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: max_auto_readahead_size: 262144 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: prepopulate_block_cache: 0 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: initial_auto_readahead_size: 8192 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T13:18:15.523 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression: NoCompression 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.num_levels: 7 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T13:18:15.524 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:18:15.525 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T13:18:15.526 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T13:18:15.527 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T13:18:15.528 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T13:18:15.528 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T13:18:15.528 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T13:18:15.528 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.table_properties_collectors: 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.inplace_update_support: 0 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T13:18:15.529 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.bloom_locality: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.max_successive_merges: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.ttl: 2592000 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T13:18:15.530 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enable_blob_files: false 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.min_blob_size: 0 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-08T13:18:15.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fe7d17f3-f8b2-4b3c-9b07-2cbcbedf98d0 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771095262510, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771095263539, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85477, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 272, "table_properties": {"data_size": 83580, "index_size": 243, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11231, "raw_average_key_size": 48, "raw_value_size": 77269, "raw_average_value_size": 334, "num_data_blocks": 10, "num_entries": 231, "num_filter_entries": 231, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696771095, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fe7d17f3-f8b2-4b3c-9b07-2cbcbedf98d0", "db_session_id": "BC4CFHCDR12ZF559JOV4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771095263617, "job": 1, "event": "recovery_finished"} 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5577198e6000 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: DB pointer 0x5577198d2000 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T13:18:15.532 INFO:journalctl@ceph.mon.a.smithi139.stdout: ** DB Stats ** 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: ** Compaction Stats [default] ** 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T13:18:15.533 INFO:journalctl@ceph.mon.a.smithi139.stdout: L0 2/0 85.31 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: Sum 2/0 85.31 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: ** Compaction Stats [default] ** 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.534 INFO:journalctl@ceph.mon.a.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Cumulative compaction: 0.00 GB write, 14.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Interval compaction: 0.00 GB write, 14.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Block cache BinnedLRUCache@0x5577198491f0#7 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2023-10-08T13:18:15.535 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: starting mon.a rank 0 at public addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] at bind addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???) e1 preinit fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).mds e1 new map 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).mds e1 print_map 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: e1 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: legacy client fscid: -1 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout: No filesystems configured 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T13:18:15.536 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 systemd[1]: Started Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: monmap e1: 1 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0]} removed_ranks: {} 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: fsmap 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T13:18:15.537 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:15 smithi139 ceph-mon[99506]: mgrmap e1: no daemons active 2023-10-08T13:18:16.155 INFO:teuthology.orchestra.run.smithi139.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-08T13:18:16.181 INFO:teuthology.orchestra.run.smithi139.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:18:16.181 INFO:teuthology.orchestra.run.smithi139.stdout:Creating mgr... 2023-10-08T13:18:16.182 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-08T13:18:16.182 INFO:teuthology.orchestra.run.smithi139.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-08T13:18:16.380 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T13:18:16.381 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-08T13:18:16.469 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7.target.wants/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@.service. 2023-10-08T13:18:16.767 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:16 smithi139 systemd[1]: Starting Ceph mgr.x for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:18:17.019 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:16 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1220027962' entity='client.admin' 2023-10-08T13:18:17.019 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:16 smithi139 podman[99735]: 2023-10-08T13:18:17.073 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T13:18:17.073 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout disabled 2023-10-08T13:18:17.081 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T13:18:17.081 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:18:17.081 INFO:teuthology.orchestra.run.smithi139.stdout:firewalld.service is not enabled 2023-10-08T13:18:17.081 INFO:teuthology.orchestra.run.smithi139.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T13:18:17.089 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T13:18:17.089 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout disabled 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:firewalld.service is not enabled 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mgr to start... 2023-10-08T13:18:17.097 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mgr... 2023-10-08T13:18:17.312 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 bash[99735]: 86ed3be2e0eb95cabb2d361bb4e363ed25f788a6b99c1e65195db2b44dcc2d6a 2023-10-08T13:18:17.312 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 systemd[1]: Started Ceph mgr.x for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:18:17.312 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.141+0000 7fdf560be200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:18:17.312 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.221+0000 7fdf560be200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:18:17.594 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.314+0000 7fdf560be200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:18:17.595 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.414+0000 7fdf560be200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:18:17.595 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.593+0000 7fdf560be200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:18:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1880139154' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T13:18:18.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:18:18.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 0 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:18.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T13:18:18.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T13:18:18.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:18.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T13:18:09.442893+0000", 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:18.054 INFO:teuthology.orchestra.run.smithi139.stdout:mgr not available, waiting (1/15)... 2023-10-08T13:18:18.293 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:17.977+0000 7fdf560be200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:18:18.293 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:18.111+0000 7fdf560be200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:18:18.293 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:18.198+0000 7fdf560be200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:18:19.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:18.291+0000 7fdf560be200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:18:19.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:18.710+0000 7fdf560be200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:18:19.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:19.373+0000 7fdf560be200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:18:19.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:19.454+0000 7fdf560be200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:18:20.509 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:20.230+0000 7fdf560be200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:18:20.509 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:20.329+0000 7fdf560be200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:18:20.777 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:20.508+0000 7fdf560be200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:18:21.031 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:20.810+0000 7fdf560be200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:18:21.094 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 0 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:21.095 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T13:18:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T13:18:21.097 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T13:18:21.100 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T13:18:21.101 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T13:18:21.102 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T13:18:09.442893+0000", 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:21.103 INFO:teuthology.orchestra.run.smithi139.stdout:mgr not available, waiting (2/15)... 2023-10-08T13:18:21.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:21 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3411363202' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T13:18:21.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:21.043+0000 7fdf560be200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:18:21.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:21.192+0000 7fdf560be200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:18:21.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:21.456+0000 7fdf560be200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:18:22.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:22.155+0000 7fdf560be200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:18:22.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:22.285+0000 7fdf560be200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:18:22.808 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:22.477+0000 7fdf560be200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:18:22.808 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:22.590+0000 7fdf560be200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:18:23.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:22.807+0000 7fdf560be200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:18:24.042 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T13:18:24.043 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 0 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T13:18:24.044 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T13:18:24.045 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T13:18:24.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T13:18:24.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T13:18:24.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.049 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T13:18:24.050 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T13:18:24.051 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T13:18:09.442893+0000", 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:24.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T13:18:24.053 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:24.053 INFO:teuthology.orchestra.run.smithi139.stdout:mgr not available, waiting (3/15)... 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:23.696+0000 7fdf560be200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1445129427' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: Activating manager daemon x 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: mgrmap e2: x(active, starting, since 0.00332555s) 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:18:24.076 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:18:24.077 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:18:24.077 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:18:24.077 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:23 smithi139 ceph-mon[99506]: Manager daemon x is now available 2023-10-08T13:18:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:18:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:18:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' 2023-10-08T13:18:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' 2023-10-08T13:18:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: from='mgr.14100 172.21.15.139:0/1544793277' entity='mgr.x' 2023-10-08T13:18:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:24 smithi139 ceph-mon[99506]: mgrmap e3: x(active, since 1.0063s) 2023-10-08T13:18:27.573 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:27 smithi139 ceph-mon[99506]: mgrmap e4: x(active, since 2s) 2023-10-08T13:18:28.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:28 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2343158649' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T13:18:31.605 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T13:18:31.606 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 0 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T13:18:31.607 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:31.608 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T13:18:31.608 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T13:18:31.608 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T13:18:31.611 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T13:18:31.611 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T13:18:31.611 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T13:18:31.611 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:31.612 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ], 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:31.613 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T13:18:09.442893+0000", 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout }, 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:31.614 INFO:teuthology.orchestra.run.smithi139.stdout:mgr is available 2023-10-08T13:18:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2932146785' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T13:18:35.061 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout fsid = 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T13:18:35.063 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T13:18:35.064 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling cephadm module... 2023-10-08T13:18:36.535 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1971285487' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-08T13:18:36.535 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setuser ceph since I am not root 2023-10-08T13:18:36.535 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setgroup ceph since I am not root 2023-10-08T13:18:36.536 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:36.454+0000 7ff6e54da200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:18:36.901 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:36.534+0000 7ff6e54da200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:18:36.901 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:36.625+0000 7ff6e54da200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:18:36.901 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:36.722+0000 7ff6e54da200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:18:36.901 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:36 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:36.901+0000 7ff6e54da200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:18:37.600 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1971285487' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-08T13:18:37.600 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-mon[99506]: mgrmap e5: x(active, since 12s) 2023-10-08T13:18:37.600 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:37.285+0000 7ff6e54da200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:18:37.600 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:37.419+0000 7ff6e54da200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:18:37.600 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:37.514+0000 7ff6e54da200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:18:37.853 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:37.853 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-08T13:18:37.853 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T13:18:37.853 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T13:18:37.854 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T13:18:37.854 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:37.854 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for the mgr to restart... 2023-10-08T13:18:37.854 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mgr epoch 5... 2023-10-08T13:18:37.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:37 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:37.616+0000 7ff6e54da200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:18:38.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:38 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3329350489' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T13:18:38.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:38 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:38.053+0000 7ff6e54da200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:18:39.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:38 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:38.726+0000 7ff6e54da200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:18:39.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:38 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:38.807+0000 7ff6e54da200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:18:39.844 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:39 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:39.578+0000 7ff6e54da200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:18:39.844 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:39 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:39.670+0000 7ff6e54da200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:18:40.122 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:39 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:39.842+0000 7ff6e54da200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:18:40.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:40 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:40.121+0000 7ff6e54da200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:18:40.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:40 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:40.360+0000 7ff6e54da200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:18:40.773 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:40 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:40.508+0000 7ff6e54da200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:18:41.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:40 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:40.772+0000 7ff6e54da200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:18:41.802 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:41 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:41.480+0000 7ff6e54da200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:18:41.802 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:41 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:41.609+0000 7ff6e54da200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:18:41.802 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:41 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:41.801+0000 7ff6e54da200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:18:42.131 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:41 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:41.914+0000 7ff6e54da200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:18:42.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:42 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:42.130+0000 7ff6e54da200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:18:43.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:43.016+0000 7ff6e54da200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: Active manager daemon x restarted 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: Activating manager daemon x 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: osdmap e2: 0 total, 0 up, 0 in 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: mgrmap e6: x(active, starting, since 0.00298653s) 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:18:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: Manager daemon x is now available 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:43.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:43 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:mgr epoch 5 is available 2023-10-08T13:18:44.405 INFO:teuthology.orchestra.run.smithi139.stdout:Setting orchestrator backend to cephadm... 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: Found migration_current of "None". Setting to last migration. 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:44.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:44 smithi139 ceph-mon[99506]: mgrmap e7: x(active, since 1.0049s) 2023-10-08T13:18:45.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: [08/Oct/2023:13:18:43] ENGINE Bus STARTING 2023-10-08T13:18:45.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: [08/Oct/2023:13:18:44] ENGINE Serving on https://172.21.15.139:7150 2023-10-08T13:18:45.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T13:18:45.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T13:18:45.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: [08/Oct/2023:13:18:44] ENGINE Serving on http://172.21.15.139:8765 2023-10-08T13:18:45.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: [08/Oct/2023:13:18:44] ENGINE Bus STARTED 2023-10-08T13:18:45.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:45 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:46.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:46 smithi139 ceph-mon[99506]: mgrmap e8: x(active, since 2s) 2023-10-08T13:18:46.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:46 smithi139 ceph-mon[99506]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:46.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:46 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:46.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:46 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:46.484 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-08T13:18:46.485 INFO:teuthology.orchestra.run.smithi139.stdout:Generating ssh key... 2023-10-08T13:18:47.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-mon[99506]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:47.788 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: Generating public/private rsa key pair. 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: Your identification has been saved in /tmp/tmpj943b9jd/key. 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: Your public key has been saved in /tmp/tmpj943b9jd/key.pub. 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: The key fingerprint is: 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: SHA256:KXLPzihyp53tU908rOqX18ctBdcTY0jGtJQkVOkijV0 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: The key's randomart image is: 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: +---[RSA 3072]----+ 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | .o*B+ | 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | +E.+ | 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | + o.. +| 2023-10-08T13:18:47.789 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | + + ...o| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | . o S ...+ o.| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | o + . . = .| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | o. o =.| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | . o..*. + o =| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: | o.++.=ooo . ..| 2023-10-08T13:18:47.790 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:47 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: +----[SHA256]-----+ 2023-10-08T13:18:48.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:48 smithi139 ceph-mon[99506]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:48.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:48 smithi139 ceph-mon[99506]: Generating ssh key... 2023-10-08T13:18:48.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:48 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:48.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:48 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:48.866 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:18:48.866 INFO:teuthology.orchestra.run.smithi139.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:18:48.867 INFO:teuthology.orchestra.run.smithi139.stdout:Adding key to root@localhost authorized_keys... 2023-10-08T13:18:48.867 INFO:teuthology.orchestra.run.smithi139.stdout:Adding host smithi139... 2023-10-08T13:18:49.654 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:49 smithi139 ceph-mon[99506]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:51 smithi139 ceph-mon[99506]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "addr": "172.21.15.139", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:51 smithi139 ceph-mon[99506]: Deploying cephadm binary to smithi139 2023-10-08T13:18:52.315 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout Added host 'smithi139' with addr '172.21.15.139' 2023-10-08T13:18:52.315 INFO:teuthology.orchestra.run.smithi139.stdout:Deploying unmanaged mon service... 2023-10-08T13:18:53.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:52 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:53.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:52 smithi139 ceph-mon[99506]: Added host smithi139 2023-10-08T13:18:53.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:52 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:18:53.560 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-08T13:18:53.560 INFO:teuthology.orchestra.run.smithi139.stdout:Deploying unmanaged mgr service... 2023-10-08T13:18:54.123 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:54 smithi139 ceph-mon[99506]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:54.123 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:54 smithi139 ceph-mon[99506]: Saving service mon spec with placement count:5 2023-10-08T13:18:54.123 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:54 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:54.123 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:54 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:55.111 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-08T13:18:55.554 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:55 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:55.554 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:55 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:56.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:56 smithi139 ceph-mon[99506]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:18:56.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:56 smithi139 ceph-mon[99506]: Saving service mgr spec with placement count:2 2023-10-08T13:18:56.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:56 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:56.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:56 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1360670342' entity='client.admin' 2023-10-08T13:18:57.781 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:57 smithi139 ceph-mon[99506]: from='mgr.14120 172.21.15.139:0/1436285769' entity='mgr.x' 2023-10-08T13:18:57.782 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:57 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/776915454' entity='client.admin' 2023-10-08T13:18:57.803 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling the dashboard module... 2023-10-08T13:18:59.070 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:58 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3024294228' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-08T13:18:59.071 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setuser ceph since I am not root 2023-10-08T13:18:59.071 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setgroup ceph since I am not root 2023-10-08T13:18:59.071 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:58.989+0000 7f88c9e5b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:18:59.071 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.069+0000 7f88c9e5b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:18:59.430 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.159+0000 7f88c9e5b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:18:59.431 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.252+0000 7f88c9e5b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:18:59.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.429+0000 7f88c9e5b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:19:00.137 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3024294228' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-08T13:19:00.138 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-mon[99506]: mgrmap e9: x(active, since 15s) 2023-10-08T13:19:00.138 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.814+0000 7f88c9e5b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:19:00.138 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:18:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:18:59.948+0000 7f88c9e5b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:19:00.138 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:00.040+0000 7f88c9e5b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:19:00.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:00.142+0000 7f88c9e5b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:19:00.498 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for the mgr to restart... 2023-10-08T13:19:00.499 INFO:teuthology.orchestra.run.smithi139.stdout:Waiting for mgr epoch 9... 2023-10-08T13:19:00.816 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:00.573+0000 7f88c9e5b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:19:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:00 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1038108768' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T13:19:01.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:01.255+0000 7f88c9e5b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:19:01.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:01.337+0000 7f88c9e5b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:19:02.373 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:02.108+0000 7f88c9e5b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:19:02.374 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:02.199+0000 7f88c9e5b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:19:02.651 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:02.372+0000 7f88c9e5b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:19:02.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:02.650+0000 7f88c9e5b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:19:02.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:02.876+0000 7f88c9e5b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:19:03.290 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:03.025+0000 7f88c9e5b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:19:03.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:03.289+0000 7f88c9e5b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:19:04.319 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:03.993+0000 7f88c9e5b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:19:04.319 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:04.124+0000 7f88c9e5b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:19:04.319 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:04.318+0000 7f88c9e5b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:19:04.648 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:04.431+0000 7f88c9e5b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:19:04.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:04.647+0000 7f88c9e5b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:19:05.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:19:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:19:05.534+0000 7f88c9e5b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:19:06.588 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: Active manager daemon x restarted 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: Activating manager daemon x 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: osdmap e3: 0 total, 0 up, 0 in 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: mgrmap e10: x(active, starting, since 0.00368592s) 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: Manager daemon x is now available 2023-10-08T13:19:06.589 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:06.590 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:06.590 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:19:06.590 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:06 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:19:06.950 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout { 2023-10-08T13:19:06.951 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-08T13:19:06.951 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T13:19:06.951 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout } 2023-10-08T13:19:06.951 INFO:teuthology.orchestra.run.smithi139.stdout:mgr epoch 9 is available 2023-10-08T13:19:06.951 INFO:teuthology.orchestra.run.smithi139.stdout:Generating a dashboard self-signed certificate... 2023-10-08T13:19:07.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:07 smithi139 ceph-mon[99506]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T13:19:07.693 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:07 smithi139 ceph-mon[99506]: mgrmap e11: x(active, since 1.00653s) 2023-10-08T13:19:07.693 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:07 smithi139 ceph-mon[99506]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T13:19:07.694 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:07 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:08.344 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-08T13:19:08.344 INFO:teuthology.orchestra.run.smithi139.stdout:Creating initial admin user... 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: [08/Oct/2023:13:19:06] ENGINE Bus STARTING 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: [08/Oct/2023:13:19:07] ENGINE Serving on http://172.21.15.139:8765 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: [08/Oct/2023:13:19:07] ENGINE Serving on https://172.21.15.139:7150 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: [08/Oct/2023:13:19:07] ENGINE Bus STARTED 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:08.601 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:08.602 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:08.602 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:08 smithi139 ceph-mon[99506]: mgrmap e12: x(active, since 2s) 2023-10-08T13:19:09.784 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$xAYz16Bc1JjBMdND5kMonO/vqMGJKd63uf4CwssWULtKTHDcYdO7S", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696771149, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-08T13:19:09.784 INFO:teuthology.orchestra.run.smithi139.stdout:Fetching dashboard port number... 2023-10-08T13:19:10.651 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:10 smithi139 ceph-mon[99506]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:10.651 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:10 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:11.052 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stdout 8443 2023-10-08T13:19:11.062 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T13:19:11.062 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout disabled 2023-10-08T13:19:11.069 INFO:teuthology.orchestra.run.smithi139.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T13:19:11.069 INFO:teuthology.orchestra.run.smithi139.stdout:systemctl: stdout inactive 2023-10-08T13:19:11.069 INFO:teuthology.orchestra.run.smithi139.stdout:firewalld.service is not enabled 2023-10-08T13:19:11.069 INFO:teuthology.orchestra.run.smithi139.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout:Ceph Dashboard is now available at: 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: URL: https://smithi139:8443/ 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: User: admin 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: Password: o03sodz5zt 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:11.071 INFO:teuthology.orchestra.run.smithi139.stdout:Saving cluster configuration to /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config directory 2023-10-08T13:19:11.072 INFO:teuthology.orchestra.run.smithi139.stdout:Enabling autotune for osd_memory_target 2023-10-08T13:19:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:11 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1134821235' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-08T13:19:13.356 INFO:teuthology.orchestra.run.smithi139.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-08T13:19:13.356 INFO:teuthology.orchestra.run.smithi139.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-08T13:19:13.356 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout:Or, if you are only running a single cluster on this host: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: ceph telemetry on 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout:For more information see: 2023-10-08T13:19:13.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.358 INFO:teuthology.orchestra.run.smithi139.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-08T13:19:13.358 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:13.358 INFO:teuthology.orchestra.run.smithi139.stdout:Bootstrap complete. 2023-10-08T13:19:13.392 INFO:tasks.cephadm:Fetching config... 2023-10-08T13:19:13.392 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:13.393 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-08T13:19:13.409 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-08T13:19:13.409 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:13.409 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-08T13:19:13.466 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-08T13:19:13.466 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:13.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-08T13:19:13.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:13 smithi139 ceph-mon[99506]: mgrmap e13: x(active, since 6s) 2023-10-08T13:19:13.531 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:13 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1167153634' entity='client.admin' 2023-10-08T13:19:13.534 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-08T13:19:13.535 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:13.535 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-08T13:19:13.591 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-08T13:19:13.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T13:19:13.667 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:13.683 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T13:19:13.728 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:13.741 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T13:19:13.789 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BXfyhvcRib/GStHIFSHS9F7BEfYtcPqu0fZHMSNwO43elahLDn0Z8V+BUSuw6tBsF6AEb5vqBZqWCRJtGTWwzS/pDxD2FvFJe3gHBm0mnkCCD6DfiPYfCZdOIylydlhn95/A7tjUvwPxhbvHWnrqrEOcR3eUyx1mb/Th1goTtxdh+s9Fd3686Okmu0qSqZN4UHXWI1Cpx2zw+pG2dHAaZ8i5HmSLGViI203Cbkio0bJ7zCEgu8ixuXJ1PIHgquAXuUnUD47tgLqbABshDx75isSFzZI2ftG1NvYtTGeJp0qen8EUqaOOtLA/wk3Bi7KyCTr7i8KcoOseSOB1C/bcoIQd4Z4XF51zgybkoqC8dB8Es8MADFduW9RFN6qc23VEKHwIdqhKwfHf70CZ68un2mGFNfPDpZrNO4d/j2Gr/MDZA10Uh5yMLAZMvCyCfby+6hye46gjm62j9BfFKeuMXz3MTIuBUyAiezFwzVwxaNN2Ad8I+dHCYB8UJ6r01Bc= ceph-0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:13.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-08T13:19:14.366 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:16.431 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-08T13:19:16.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-08T13:19:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:19:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:16.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:16.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:16.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3510321275' entity='client.admin' 2023-10-08T13:19:16.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:16.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:16 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:17.002 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:19.052 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2023-10-08T13:19:19.053 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:19:19.053 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2023-10-08T13:19:19.073 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:19:19.073 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:19.133 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2023-10-08T13:19:19.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi155 2023-10-08T13:19:19.728 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:19.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:19.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:19.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:19:19.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:19.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:19.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:19 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:20.871 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:20 smithi139 ceph-mon[99506]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:20.871 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:20 smithi139 ceph-mon[99506]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:20.871 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:20 smithi139 ceph-mon[99506]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:19:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:21 smithi139 ceph-mon[99506]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:21 smithi139 ceph-mon[99506]: Deploying cephadm binary to smithi155 2023-10-08T13:19:23.629 INFO:teuthology.orchestra.run.smithi139.stdout:Added host 'smithi155' with addr '172.21.15.155' 2023-10-08T13:19:24.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T13:19:24.643 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:24.889 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:24 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:24.889 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:24 smithi139 ceph-mon[99506]: Added host smithi155 2023-10-08T13:19:24.889 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:24 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:24.889 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:24 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:25 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:26.191 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:26.191 INFO:teuthology.orchestra.run.smithi139.stdout:[{"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2023-10-08T13:19:26.600 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi187 2023-10-08T13:19:26.600 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:19:26.600 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.conf 2023-10-08T13:19:26.621 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:19:26.621 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:26.681 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2023-10-08T13:19:26.682 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi187 2023-10-08T13:19:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:26 smithi139 ceph-mon[99506]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:26 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:27.236 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:27.783 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:27 smithi139 ceph-mon[99506]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:19:28.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:28 smithi139 ceph-mon[99506]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:29 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:31.184 INFO:teuthology.orchestra.run.smithi139.stdout:Added host 'smithi187' with addr '172.21.15.187' 2023-10-08T13:19:31.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:30 smithi139 ceph-mon[99506]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:31.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:30 smithi139 ceph-mon[99506]: Deploying cephadm binary to smithi187 2023-10-08T13:19:31.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:30 smithi139 ceph-mon[99506]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:31.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:30 smithi139 ceph-mon[99506]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:19:31.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:30 smithi139 ceph-mon[99506]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:31.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T13:19:32.141 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:32.563 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:32 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:32.563 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:32 smithi139 ceph-mon[99506]: Added host smithi187 2023-10-08T13:19:32.563 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:32 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:32.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:32 smithi139 ceph-mon[99506]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:32.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:32 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:33.662 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:19:33.662 INFO:teuthology.orchestra.run.smithi139.stdout:[{"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}] 2023-10-08T13:19:33.686 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:33 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:34.083 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-08T13:19:34.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-08T13:19:34.640 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:34.871 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:34 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:34.872 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:34 smithi139 ceph-mon[99506]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:34.872 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:34 smithi139 ceph-mon[99506]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:19:36.289 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2023-10-08T13:19:36.646 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:36 smithi139 ceph-mon[99506]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:36.647 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T13:19:36.683 INFO:tasks.cephadm:Adding mon.a on smithi139 2023-10-08T13:19:36.683 INFO:tasks.cephadm:Adding mon.b on smithi155 2023-10-08T13:19:36.683 INFO:tasks.cephadm:Adding mon.c on smithi187 2023-10-08T13:19:36.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c' 2023-10-08T13:19:37.283 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:37.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T13:19:37.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:37.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:37.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:37.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:37 smithi139 ceph-mon[99506]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:38.671 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mon update... 2023-10-08T13:19:38.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:38.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:19:38.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:38.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:38.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:38.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:38 smithi139 ceph-mon[99506]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:39.065 DEBUG:teuthology.orchestra.run.smithi155:mon.b> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-08T13:19:39.068 DEBUG:teuthology.orchestra.run.smithi187:mon.c> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-08T13:19:39.070 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T13:19:39.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T13:19:39.098 INFO:journalctl@ceph.mon.c.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:19:39.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:19:39.880 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: Saving service mon spec with placement smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c;count:3 2023-10-08T13:19:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:39 smithi139 ceph-mon[99506]: Deploying daemon mon.c on smithi187 2023-10-08T13:19:40.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:40 smithi139 ceph-mon[99506]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:41.890 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:19:41.890 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":1,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","modified":"2023-10-08T13:18:07.126465Z","created":"2023-10-08T13:18:07.126465Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-08T13:19:41.891 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 1 2023-10-08T13:19:42.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 podman[104271]: 2023-10-08T13:19:42.486 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: pidfile_write: ignore empty --pid-file 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 bash[104271]: a7269149ef2b4cd5f900acd1e5be3149fad9f9cadbea484e5f922b9ca13949ab 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: load: jerasure load: lrc 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: RocksDB version: 7.9.2 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Git sha 0 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: DB SUMMARY 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: DB Session ID: 0H6X3W06SUR4OIHL08EL 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: CURRENT file: CURRENT 2023-10-08T13:19:42.487 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.error_if_exists: 0 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.create_if_missing: 0 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.paranoid_checks: 1 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.env: 0x563d36498da0 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T13:19:42.488 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.info_log: 0x563d38919640 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.statistics: (nil) 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.use_fsync: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_log_file_size: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_fallocate: 1 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T13:19:42.489 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.use_direct_reads: 0 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.db_log_dir: 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.wal_dir: 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T13:19:42.490 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.write_buffer_manager: 0x563d388d1360 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T13:19:42.491 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.unordered_write: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.row_cache: None 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.wal_filter: None 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T13:19:42.492 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.two_write_queues: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.wal_compression: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.atomic_flush: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.log_readahead_size: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T13:19:42.493 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_background_jobs: 2 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_background_compactions: -1 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_subcompactions: 1 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T13:19:42.495 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_open_files: -1 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_background_flushes: -1 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Compression algorithms supported: 2023-10-08T13:19:42.496 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kZSTD supported: 0 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kXpressCompression supported: 0 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kZlibCompression supported: 1 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kSnappyCompression supported: 1 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kLZ4Compression supported: 1 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: kBZip2Compression supported: 0 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T13:19:42.497 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.merge_operator: 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_filter: None 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563d38919740) 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: cache_index_and_filter_blocks: 1 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: pin_top_level_index_and_filter: 1 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: index_type: 0 2023-10-08T13:19:42.498 INFO:journalctl@ceph.mon.c.smithi187.stdout: data_block_index_type: 0 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: index_shortening: 1 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: checksum: 4 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: no_block_cache: 0 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_cache: 0x563d3896f1f0 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_cache_name: BinnedLRUCache 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_cache_options: 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: capacity : 536870912 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: num_shard_bits : 4 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: strict_capacity_limit : 0 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: high_pri_pool_ratio: 0.000 2023-10-08T13:19:42.499 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_cache_compressed: (nil) 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: persistent_cache: (nil) 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_size: 4096 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_size_deviation: 10 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_restart_interval: 16 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: index_block_restart_interval: 1 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: metadata_block_size: 4096 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: partition_filters: 0 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: use_delta_encoding: 1 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: filter_policy: bloomfilter 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: whole_key_filtering: 1 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: verify_compression: 0 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: read_amp_bytes_per_bit: 0 2023-10-08T13:19:42.500 INFO:journalctl@ceph.mon.c.smithi187.stdout: format_version: 5 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: enable_index_compression: 1 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: block_align: 0 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: max_auto_readahead_size: 262144 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: prepopulate_block_cache: 0 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: initial_auto_readahead_size: 8192 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression: NoCompression 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T13:19:42.501 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.num_levels: 7 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:19:42.502 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T13:19:42.503 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T13:19:42.504 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T13:19:42.505 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.table_properties_collectors: 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.inplace_update_support: 0 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T13:19:42.506 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.bloom_locality: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.max_successive_merges: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.ttl: 2592000 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T13:19:42.507 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enable_blob_files: false 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.min_blob_size: 0 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T13:19:42.508 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 15777068-68b5-4462-b1c6-ab7c000c46b6 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771182337840, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771182338239, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696771182, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "15777068-68b5-4462-b1c6-ab7c000c46b6", "db_session_id": "0H6X3W06SUR4OIHL08EL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771182338313, "job": 1, "event": "recovery_finished"} 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563d38a0c000 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: DB pointer 0x563d389f8000 2023-10-08T13:19:42.509 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: ** DB Stats ** 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T13:19:42.510 INFO:journalctl@ceph.mon.c.smithi187.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: ** Compaction Stats [default] ** 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: ** Compaction Stats [default] ** 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:19:42.511 INFO:journalctl@ceph.mon.c.smithi187.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: Cumulative compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:19:42.512 INFO:journalctl@ceph.mon.c.smithi187.stdout: Interval compaction: 0.00 GB write, 0.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: Block cache BinnedLRUCache@0x563d3896f1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: using public_addr v2:172.21.15.187:0/0 -> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: starting mon.c rank -1 at public addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] at bind addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(???) e0 preinit fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).mds e1 new map 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: e1 2023-10-08T13:19:42.513 INFO:journalctl@ceph.mon.c.smithi187.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout: legacy client fscid: -1 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout: 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout: No filesystems configured 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 systemd[1]: Started Ceph mon.c for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:19:42.514 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T13:19:42.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:42.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:42.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:42.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.515 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:42.516 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.517 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Saving service mon spec with placement smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c;count:3 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: Deploying daemon mon.c on smithi187 2023-10-08T13:19:42.518 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:42.519 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:42 smithi187 ceph-mon[104336]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T13:19:43.495 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T13:19:43.495 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T13:19:44.065 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:19:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: mon.a calling monitor election 2023-10-08T13:19:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: mon.c calling monitor election 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: monmap e2: 2 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: fsmap 2023-10-08T13:19:47.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:47.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: mgrmap e13: x(active, since 41s) 2023-10-08T13:19:47.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: overall HEALTH_OK 2023-10-08T13:19:47.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:47.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:47 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: mon.a calling monitor election 2023-10-08T13:19:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: mon.c calling monitor election 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: monmap e2: 2 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:47.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: fsmap 2023-10-08T13:19:47.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:47.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: mgrmap e13: x(active, since 41s) 2023-10-08T13:19:47.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: overall HEALTH_OK 2023-10-08T13:19:47.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:47.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:47 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:48.567 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:19:48.568 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":2,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","modified":"2023-10-08T13:19:42.367880Z","created":"2023-10-08T13:18:07.126465Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T13:19:48.570 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 2 2023-10-08T13:19:48.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:48.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:48.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:48.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: Deploying daemon mon.b on smithi155 2023-10-08T13:19:48.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:48.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:48 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: Deploying daemon mon.b on smithi155 2023-10-08T13:19:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:48 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/2523675873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/2523675873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:50.031 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T13:19:50.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T13:19:50.321 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 systemd[1]: Starting Ceph mon.b for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 podman[103427]: 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 bash[103427]: 36c3a9b116041ca2ffcd614c99ca451fed9545c1789c26cac34f8cad153b4ec5 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pidfile_write: ignore empty --pid-file 2023-10-08T13:19:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: load: jerasure load: lrc 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: RocksDB version: 7.9.2 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Git sha 0 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: DB SUMMARY 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: DB Session ID: A5Q3KO8J89MJQZCJSBL4 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: CURRENT file: CURRENT 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.error_if_exists: 0 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.create_if_missing: 0 2023-10-08T13:19:50.599 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.paranoid_checks: 1 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.env: 0x560271a40da0 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.info_log: 0x5602726bf640 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.statistics: (nil) 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.use_fsync: 0 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_log_file_size: 0 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T13:19:50.600 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_fallocate: 1 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.use_direct_reads: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.db_log_dir: 2023-10-08T13:19:50.601 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.wal_dir: 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.write_buffer_manager: 0x560272677360 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T13:19:50.602 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.unordered_write: 0 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.row_cache: None 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.wal_filter: None 2023-10-08T13:19:50.603 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.two_write_queues: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.wal_compression: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.atomic_flush: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.log_readahead_size: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T13:19:50.604 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_background_jobs: 2 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_background_compactions: -1 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_subcompactions: 1 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T13:19:50.605 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_open_files: -1 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_background_flushes: -1 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Compression algorithms supported: 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kZSTD supported: 0 2023-10-08T13:19:50.606 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kXpressCompression supported: 0 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kZlibCompression supported: 1 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kSnappyCompression supported: 1 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kLZ4Compression supported: 1 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: kBZip2Compression supported: 0 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.merge_operator: 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_filter: None 2023-10-08T13:19:50.607 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5602726bf740) 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks: 1 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_top_level_index_and_filter: 1 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_type: 0 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_index_type: 0 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_shortening: 1 2023-10-08T13:19:50.608 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: checksum: 4 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: no_block_cache: 0 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache: 0x5602727151f0 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_name: BinnedLRUCache 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_options: 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: capacity : 536870912 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_shard_bits : 4 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: strict_capacity_limit : 0 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: high_pri_pool_ratio: 0.000 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_compressed: (nil) 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: persistent_cache: (nil) 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size: 4096 2023-10-08T13:19:50.609 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size_deviation: 10 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_restart_interval: 16 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_block_restart_interval: 1 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: metadata_block_size: 4096 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: partition_filters: 0 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: use_delta_encoding: 1 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: filter_policy: bloomfilter 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: whole_key_filtering: 1 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: verify_compression: 0 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: read_amp_bytes_per_bit: 0 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: format_version: 5 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_index_compression: 1 2023-10-08T13:19:50.610 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_align: 0 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout: max_auto_readahead_size: 262144 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout: prepopulate_block_cache: 0 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout: initial_auto_readahead_size: 8192 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression: NoCompression 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.num_levels: 7 2023-10-08T13:19:50.611 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T13:19:50.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T13:19:50.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T13:19:50.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T13:19:50.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T13:19:50.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T13:19:50.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.table_properties_collectors: 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.inplace_update_support: 0 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T13:19:50.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.bloom_locality: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.max_successive_merges: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.ttl: 2592000 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T13:19:50.618 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enable_blob_files: false 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.min_blob_size: 0 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T13:19:50.619 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f4e01679-4848-469f-82da-eed9322b6f4d 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771190535318, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771190535738, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696771190, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f4e01679-4848-469f-82da-eed9322b6f4d", "db_session_id": "A5Q3KO8J89MJQZCJSBL4", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696771190535805, "job": 1, "event": "recovery_finished"} 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5602727b2000 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: DB pointer 0x56027279e000 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T13:19:50.620 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** DB Stats ** 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T13:19:50.621 INFO:journalctl@ceph.mon.b.smithi155.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T13:19:50.622 INFO:journalctl@ceph.mon.b.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval compaction: 0.00 GB write, 0.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache BinnedLRUCache@0x5602727151f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T13:19:50.623 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: using public_addr v2:172.21.15.155:0/0 -> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: starting mon.b rank -1 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(???) e0 preinit fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).mds e1 new map 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: e1 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: legacy client fscid: -1 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2023-10-08T13:19:50.624 INFO:journalctl@ceph.mon.b.smithi155.stdout: No filesystems configured 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.625 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2539974328' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.626 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:19:50.627 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.628 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Saving service mon spec with placement smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c;count:3 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:50.630 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Deploying daemon mon.c on smithi187 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.a calling monitor election 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.631 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.c calling monitor election 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: monmap e2: 2 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: fsmap 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mgrmap e13: x(active, since 41s) 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: overall HEALTH_OK 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.632 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: Deploying daemon mon.b on smithi155 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/2523675873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.633 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 ceph-mon[103467]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T13:19:50.815 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:50 smithi187 ceph-mon[104336]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:50.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:50 smithi139 ceph-mon[99506]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:50 smithi155 systemd[1]: Started Ceph mon.b for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:19:55.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:55.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: mon.c calling monitor election 2023-10-08T13:19:55.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: mon.a calling monitor election 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: fsmap 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: mgrmap e13: x(active, since 50s) 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: mon.b (rank 2) addr [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] is down (out of quorum) 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:55 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: mon.c calling monitor election 2023-10-08T13:19:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: mon.a calling monitor election 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:55.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: fsmap 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: mgrmap e13: x(active, since 50s) 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: mon.b (rank 2) addr [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] is down (out of quorum) 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:55.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:55 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:56.475 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-10-08T13:19:56.475 INFO:teuthology.orchestra.run.smithi187.stdout:{"epoch":3,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","modified":"2023-10-08T13:19:50.565206Z","created":"2023-10-08T13:18:07.126465Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T13:19:56.477 INFO:teuthology.orchestra.run.smithi187.stderr:dumped monmap epoch 3 2023-10-08T13:19:56.820 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:56 smithi187 ceph-mon[104336]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:56.820 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:56 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:56.820 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:56 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/2823306856' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:56.820 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:56 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:56.852 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-08T13:19:56.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-08T13:19:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:56 smithi139 ceph-mon[99506]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:56 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:56 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/2823306856' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:56 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.425 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:19:57.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:19:57.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: mon.c calling monitor election 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: mon.a calling monitor election 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:57.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: fsmap 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: mgrmap e13: x(active, since 50s) 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: mon.b (rank 2) addr [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] is down (out of quorum) 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:57.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:57.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:19:57.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/2823306856' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T13:19:57.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:57 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:58.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mon.b calling monitor election 2023-10-08T13:19:58.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:19:58.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mon.b calling monitor election 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mon.a calling monitor election 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mon.c calling monitor election 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:58.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: fsmap 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: mgrmap e13: x(active, since 52s) 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: overall HEALTH_OK 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:19:58.440 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:58 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:58.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mon.b calling monitor election 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mon.b calling monitor election 2023-10-08T13:19:58.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mon.a calling monitor election 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mon.c calling monitor election 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: fsmap 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: mgrmap e13: x(active, since 52s) 2023-10-08T13:19:58.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: overall HEALTH_OK 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.729 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:19:58.730 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:58 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:58.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mon.b calling monitor election 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:19:58.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mon.b calling monitor election 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mon.a calling monitor election 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mon.c calling monitor election 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: monmap e3: 3 mons at {a=[v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0],b=[v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0],c=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0]} removed_ranks: {} 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: fsmap 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: mgrmap e13: x(active, since 52s) 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T13:19:58.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: overall HEALTH_OK 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:19:58.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:58 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:58.860 INFO:teuthology.orchestra.run.smithi139.stdout:# minimal ceph.conf for 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:58.860 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2023-10-08T13:19:58.860 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:19:58.860 INFO:teuthology.orchestra.run.smithi139.stdout: mon_host = [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2023-10-08T13:19:59.390 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-08T13:19:59.391 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:59.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T13:19:59.421 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:19:59.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:59.487 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:19:59.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T13:19:59.524 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:19:59.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:59.595 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:19:59.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T13:19:59.626 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:59 smithi187 ceph-mon[104336]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T13:19:59.626 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:59 smithi187 ceph-mon[104336]: Reconfiguring daemon mon.a on smithi139 2023-10-08T13:19:59.626 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:59 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:59.626 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:19:59 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2265120415' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:59.631 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:19:59.631 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:19:59.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:59 smithi139 ceph-mon[99506]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T13:19:59.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:59 smithi139 ceph-mon[99506]: Reconfiguring daemon mon.a on smithi139 2023-10-08T13:19:59.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:59 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:59.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:19:59 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2265120415' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:19:59.702 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-08T13:19:59.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T13:19:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:59 smithi155 ceph-mon[103467]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T13:19:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:59 smithi155 ceph-mon[103467]: Reconfiguring daemon mon.a on smithi139 2023-10-08T13:19:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:59 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:19:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:19:59 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2265120415' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:00.262 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:00.812 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:00.812 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: Reconfiguring mon.b (monmap changed)... 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: Reconfiguring daemon mon.b on smithi155 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: overall HEALTH_OK 2023-10-08T13:20:00.813 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:00 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: Reconfiguring mon.b (monmap changed)... 2023-10-08T13:20:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: Reconfiguring daemon mon.b on smithi155 2023-10-08T13:20:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: overall HEALTH_OK 2023-10-08T13:20:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:00 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: Reconfiguring mon.b (monmap changed)... 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: Reconfiguring daemon mon.b on smithi155 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: overall HEALTH_OK 2023-10-08T13:20:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:00 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.009 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.009 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.009 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:02.009 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:02.010 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:02.010 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:01 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T13:20:02.108 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.108 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.108 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:02.108 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setuser ceph since I am not root 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: ignoring --setgroup ceph since I am not root 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.027+0000 7f825dffb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:20:02.109 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.106+0000 7f825dffb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:02.224 INFO:tasks.cephadm:Adding mgr.x on smithi139 2023-10-08T13:20:02.224 INFO:tasks.cephadm:Adding mgr.y on smithi155 2023-10-08T13:20:02.224 INFO:tasks.cephadm:Adding mgr.z on smithi187 2023-10-08T13:20:02.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi139=x;smithi155=y;smithi187=z' 2023-10-08T13:20:02.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' 2023-10-08T13:20:02.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:02.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:02.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='mgr.14152 172.21.15.139:0/3978705287' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:02.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:01 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T13:20:02.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.197+0000 7f825dffb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:20:02.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.298+0000 7f825dffb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:20:02.777 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:20:02.829 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.467+0000 7f825dffb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:20:03.142 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T13:20:03.142 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-mon[99506]: mgrmap e14: x(active, since 56s) 2023-10-08T13:20:03.143 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.827+0000 7f825dffb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:20:03.143 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:02.959+0000 7f825dffb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:20:03.143 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:03.047+0000 7f825dffb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:20:03.191 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:02 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T13:20:03.191 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:02 smithi187 ceph-mon[104336]: mgrmap e14: x(active, since 56s) 2023-10-08T13:20:03.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:02 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3510329736' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T13:20:03.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:02 smithi155 ceph-mon[103467]: mgrmap e14: x(active, since 56s) 2023-10-08T13:20:03.437 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:03.141+0000 7f825dffb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:20:03.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:03.561+0000 7f825dffb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:20:04.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:04.212+0000 7f825dffb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:20:04.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:04.293+0000 7f825dffb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:20:05.341 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.076+0000 7f825dffb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:05.341 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.167+0000 7f825dffb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:20:05.622 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.340+0000 7f825dffb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:05.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.621+0000 7f825dffb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:20:05.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.847+0000 7f825dffb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:20:06.263 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:05.996+0000 7f825dffb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:20:06.687 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:06.262+0000 7f825dffb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:20:07.292 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:06.967+0000 7f825dffb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:20:07.292 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:07.097+0000 7f825dffb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:20:07.625 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:07.291+0000 7f825dffb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:20:07.625 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:07.405+0000 7f825dffb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:07.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:07.624+0000 7f825dffb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:20:08.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: Active manager daemon x restarted 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: Activating manager daemon x 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: mgrmap e15: x(active, starting, since 0.00409831s) 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: Manager daemon x is now available 2023-10-08T13:20:08.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:08.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:08.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:20:08.511+0000 7f825dffb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:20:08.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: Active manager daemon x restarted 2023-10-08T13:20:08.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: Activating manager daemon x 2023-10-08T13:20:08.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: mgrmap e15: x(active, starting, since 0.00409831s) 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: Manager daemon x is now available 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:08.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: Active manager daemon x restarted 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: Activating manager daemon x 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: mgrmap e15: x(active, starting, since 0.00409831s) 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:20:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: Manager daemon x is now available 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:08.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:09.541 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mgr update... 2023-10-08T13:20:09.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:20:09.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:20:09.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:09 smithi155 ceph-mon[103467]: mgrmap e16: x(active, since 1.00748s) 2023-10-08T13:20:09.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:09.929 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:20:09.929 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:20:09.930 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:09 smithi187 ceph-mon[104336]: mgrmap e16: x(active, since 1.00748s) 2023-10-08T13:20:09.930 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:09.931 DEBUG:teuthology.orchestra.run.smithi155:mgr.y> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-08T13:20:09.933 DEBUG:teuthology.orchestra.run.smithi187:mgr.z> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-08T13:20:09.936 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-08T13:20:09.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-08T13:20:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T13:20:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T13:20:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:09 smithi139 ceph-mon[99506]: mgrmap e16: x(active, since 1.00748s) 2023-10-08T13:20:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:09.938 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-08T13:20:09.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-08T13:20:09.963 INFO:journalctl@ceph.mgr.y.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:20:09.966 INFO:journalctl@ceph.mgr.z.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:20:09.982 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-08T13:20:09.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-08T13:20:10.026 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-08T13:20:10.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-08T13:20:10.069 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-08T13:20:10.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-08T13:20:10.111 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-08T13:20:10.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-08T13:20:10.155 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-08T13:20:10.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-08T13:20:10.198 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-08T13:20:10.198 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-08T13:20:10.250 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T13:20:10.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T13:20:10.299 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-08T13:20:10.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-08T13:20:10.342 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-08T13:20:10.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-08T13:20:10.394 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-08T13:20:10.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-08T13:20:10.450 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-08T13:20:10.450 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-08T13:20:10.494 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-08T13:20:10.494 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-08T13:20:10.541 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-08T13:20:10.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-08T13:20:10.587 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-08T13:20:10.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-08T13:20:10.592 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:10.594 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-08T13:20:10.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-08T13:20:10.652 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T13:20:10.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-08T13:20:10.715 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T13:20:10.715 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-08T13:20:10.716 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:10.747 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:10.759 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-08T13:20:10.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-08T13:20:10.815 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-08T13:20:10.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: [08/Oct/2023:13:20:09] ENGINE Bus STARTING 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi139=x;smithi155=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: Saving service mgr spec with placement smithi139=x;smithi155=y;smithi187=z;count:3 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: [08/Oct/2023:13:20:09] ENGINE Serving on https://172.21.15.139:7150 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: [08/Oct/2023:13:20:09] ENGINE Serving on http://172.21.15.139:8765 2023-10-08T13:20:10.861 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: [08/Oct/2023:13:20:09] ENGINE Bus STARTED 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.871 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-08T13:20:10.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T13:20:10.924 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-08T13:20:10.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: [08/Oct/2023:13:20:09] ENGINE Bus STARTING 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi139=x;smithi155=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: Saving service mgr spec with placement smithi139=x;smithi155=y;smithi187=z;count:3 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: [08/Oct/2023:13:20:09] ENGINE Serving on https://172.21.15.139:7150 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: [08/Oct/2023:13:20:09] ENGINE Serving on http://172.21.15.139:8765 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: [08/Oct/2023:13:20:09] ENGINE Bus STARTED 2023-10-08T13:20:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:10.995 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-08T13:20:10.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-08T13:20:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:11.042 DEBUG:tasks.cephadm:set 24 configs 2023-10-08T13:20:11.042 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi139') 2023-10-08T13:20:11.070 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: [08/Oct/2023:13:20:09] ENGINE Bus STARTING 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi139=x;smithi155=y;smithi187=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: Saving service mgr spec with placement smithi139=x;smithi155=y;smithi187=z;count:3 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: [08/Oct/2023:13:20:09] ENGINE Serving on https://172.21.15.139:7150 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: [08/Oct/2023:13:20:09] ENGINE Serving on http://172.21.15.139:8765 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: [08/Oct/2023:13:20:09] ENGINE Bus STARTED 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:11.870 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:12.472 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.473 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:12 smithi139 ceph-mon[99506]: mgrmap e17: x(active, since 2s) 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:12 smithi187 ceph-mon[104336]: mgrmap e17: x(active, since 2s) 2023-10-08T13:20:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:12.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:12.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:12 smithi155 ceph-mon[103467]: mgrmap e17: x(active, since 2s) 2023-10-08T13:20:13.258 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.259 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.260 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.260 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:13 smithi139 ceph-mon[99506]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:13.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:13 smithi187 ceph-mon[104336]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.541 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:13.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi139:/etc/ceph/ceph.conf 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi155:/etc/ceph/ceph.conf 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi187:/etc/ceph/ceph.conf 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T13:20:13.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:13.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:13 smithi155 ceph-mon[103467]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2023-10-08T13:20:14.185 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:14.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:14 smithi139 ceph-mon[99506]: Deploying daemon mgr.z on smithi187 2023-10-08T13:20:14.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:14.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:14.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:14 smithi155 ceph-mon[103467]: Deploying daemon mgr.z on smithi187 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: Updating smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: Updating smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: Updating smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.666 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:14.667 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:14 smithi187 ceph-mon[104336]: Deploying daemon mgr.z on smithi187 2023-10-08T13:20:14.976 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:14 smithi187 systemd[1]: Starting Ceph mgr.z for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:20:15.466 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 podman[107339]: 2023-10-08T13:20:15.466 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 bash[107339]: e77fd364c53efff9b9460a3c169e07f9b999cbbfb250962cd2cc7f3302006bb2 2023-10-08T13:20:15.466 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mgr[107379]: -- 172.21.15.187:0/3071138752 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d3128fd1e0 con 0x55d3128d2c00 2023-10-08T13:20:15.641 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3050242714' entity='client.admin' 2023-10-08T13:20:15.641 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2093752402' entity='client.admin' 2023-10-08T13:20:15.641 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4063755168' entity='client.admin' 2023-10-08T13:20:15.641 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.641 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.642 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.642 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:15.642 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:15.642 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:15.642 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:15.719 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 systemd[1]: Started Ceph mgr.z for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:20:15.720 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:15.546+0000 7fea95376200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:20:15.720 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:15.627+0000 7fea95376200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:15.721 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3050242714' entity='client.admin' 2023-10-08T13:20:15.721 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2093752402' entity='client.admin' 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4063755168' entity='client.admin' 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:15.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:15.976 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:15.718+0000 7fea95376200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:20:15.976 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:15.811+0000 7fea95376200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:20:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3050242714' entity='client.admin' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2093752402' entity='client.admin' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4063755168' entity='client.admin' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:16.345 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:15.981+0000 7fea95376200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:20:16.658 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:16.344+0000 7fea95376200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:20:16.658 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:16.474+0000 7fea95376200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:20:16.658 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:16.562+0000 7fea95376200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:20:16.658 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:16.656+0000 7fea95376200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:20:16.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-mon[104336]: Deploying daemon mgr.y on smithi155 2023-10-08T13:20:16.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:16 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1778084783' entity='client.admin' 2023-10-08T13:20:17.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe838038b40 msgr2=0x7fe83803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:17.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe838038b40 0x7fe83803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe850197af0 tx=0x7fe844007040 comp rx=0 tx=0).stop 2023-10-08T13:20:17.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe850068e20 msgr2=0x7fe85019c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe850068e20 0x7fe85019c7f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe840005910 tx=0x7fe840009570 comp rx=0 tx=0).stop 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 shutdown_connections 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe838038b40 0x7fe83803b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8501067d0 0x7fe850196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe850068e20 0x7fe85019c7f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 --2- 172.21.15.139:0/2938341267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8500697c0 0x7fe85019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:17.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 >> 172.21.15.139:0/2938341267 conn(0x7fe8500757d0 msgr2=0x7fe8500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:17.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 shutdown_connections 2023-10-08T13:20:17.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:17.046+0000 7fe8566e0700 1 -- 172.21.15.139:0/2938341267 wait complete. 2023-10-08T13:20:17.075 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:16 smithi139 ceph-mon[99506]: Deploying daemon mgr.y on smithi155 2023-10-08T13:20:17.075 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:16 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1778084783' entity='client.admin' 2023-10-08T13:20:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:16 smithi155 ceph-mon[103467]: Deploying daemon mgr.y on smithi155 2023-10-08T13:20:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:16 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1778084783' entity='client.admin' 2023-10-08T13:20:17.347 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 systemd[1]: Starting Ceph mgr.y for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:20:17.355 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:17.476 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:17.079+0000 7fea95376200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:20:17.507 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:17.649 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 podman[105796]: 2023-10-08T13:20:17.896 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:17.896 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:17.959 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 bash[105796]: d0f3ad530cfdc6a5b67f9e46af264d59fce4d8b98c7bc95397992cdefed08ac6 2023-10-08T13:20:17.959 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 systemd[1]: Started Ceph mgr.y for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:20:17.960 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:17.775+0000 7f9a8a058200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T13:20:17.960 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:17.859+0000 7f9a8a058200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:17.960 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:17.959+0000 7f9a8a058200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T13:20:18.044 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:17.757+0000 7fea95376200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:20:18.044 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:17.839+0000 7fea95376200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:20:18.118 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:18.119 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:18.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.140+0000 7f8873c02700 1 -- 172.21.15.139:0/3430414201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c10c140 msgr2=0x7f886c113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:18.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.140+0000 7f8873c02700 1 --2- 172.21.15.139:0/3430414201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c10c140 0x7f886c113d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f886400b0a0 tx=0x7f886400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.141+0000 7f8873c02700 1 -- 172.21.15.139:0/3430414201 shutdown_connections 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.141+0000 7f8873c02700 1 --2- 172.21.15.139:0/3430414201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c10c140 0x7f886c113d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.141+0000 7f8873c02700 1 --2- 172.21.15.139:0/3430414201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c107060 0x7f886c107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.141+0000 7f8873c02700 1 --2- 172.21.15.139:0/3430414201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.141+0000 7f8873c02700 1 -- 172.21.15.139:0/3430414201 >> 172.21.15.139:0/3430414201 conn(0x7f886c073fc0 msgr2=0x7f886c0763e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.142+0000 7f8873c02700 1 -- 172.21.15.139:0/3430414201 shutdown_connections 2023-10-08T13:20:18.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.142+0000 7f8873c02700 1 -- 172.21.15.139:0/3430414201 wait complete. 2023-10-08T13:20:18.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.142+0000 7f8873c02700 1 Processor -- start 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 -- start start 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 0x7f886c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 0x7f886c1a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1a1fd0 con 0x7f886c107060 2023-10-08T13:20:18.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1a2140 con 0x7f886c107a10 2023-10-08T13:20:18.145 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f8873c02700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c1a2300 con 0x7f886c10c140 2023-10-08T13:20:18.145 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f887199e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 0x7f886c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f887199e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 0x7f886c19d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36928/0 (socket says 172.21.15.139:36928) 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f887199e700 1 -- 172.21.15.139:0/2786067831 learned_addr learned my addr 172.21.15.139:0/2786067831 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f887119d700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.143+0000 7f887219f700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 0x7f886c1a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 -- 172.21.15.139:0/2786067831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 msgr2=0x7f886c1a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:18.146 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 0x7f886c1a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 -- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 msgr2=0x7f886c19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 0x7f886c19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 -- 172.21.15.139:0/2786067831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009d00 con 0x7f886c107a10 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887219f700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 0x7f886c1a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f887119d700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c19d660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9c0 tx=0x7f885c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00c9c0 con 0x7f886c107a10 2023-10-08T13:20:18.147 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f885c010430 con 0x7f886c107a10 2023-10-08T13:20:18.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c018680 con 0x7f886c107a10 2023-10-08T13:20:18.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c1a25e0 con 0x7f886c107a10 2023-10-08T13:20:18.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.144+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c06a3e0 con 0x7f886c107a10 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.145+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7f885c0187e0 con 0x7f886c107a10 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.145+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88500052f0 con 0x7f886c107a10 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.145+0000 7f8862ffd700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 0x7f885803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.145+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f885c014070 con 0x7f886c107a10 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.146+0000 7f887199e700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 0x7f885803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:18.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.146+0000 7f887199e700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 0x7f885803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8868005950 tx=0x7f886800b500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:18.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.151+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f885c01fb90 con 0x7f886c107a10 2023-10-08T13:20:18.167 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2938341267' entity='client.admin' 2023-10-08T13:20:18.168 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.168 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.168 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.168 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.168 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:18.180 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:18.244 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.059+0000 7f9a8a058200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T13:20:18.244 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.242+0000 7f9a8a058200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T13:20:18.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2938341267' entity='client.admin' 2023-10-08T13:20:18.244 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.245 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.245 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.245 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.245 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:18.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.385+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7f8850005b20 con 0x7f886c107a10 2023-10-08T13:20:18.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.389+0000 7f8862ffd700 1 -- 172.21.15.139:0/2786067831 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) v1 ==== 117+0+0 (secure 0 0 0) 0x7f885c01f780 con 0x7f886c107a10 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 msgr2=0x7f885803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 0x7f885803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8868005950 tx=0x7f886800b500 comp rx=0 tx=0).stop 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 msgr2=0x7f886c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c19d660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9c0 tx=0x7f885c00ecd0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 shutdown_connections 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8858038b40 0x7f885803b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f886c10c140 0x7f886c1a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f886c107060 0x7f886c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 --2- 172.21.15.139:0/2786067831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f886c107a10 0x7f886c19d660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:18.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 >> 172.21.15.139:0/2786067831 conn(0x7f886c073fc0 msgr2=0x7f886c075380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:18.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 shutdown_connections 2023-10-08T13:20:18.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:18.392+0000 7f8873c02700 1 -- 172.21.15.139:0/2786067831 wait complete. 2023-10-08T13:20:18.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2938341267' entity='client.admin' 2023-10-08T13:20:18.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:18.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:18.501 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:18.908 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.629+0000 7f9a8a058200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T13:20:18.908 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.766+0000 7f9a8a058200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T13:20:18.908 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.863+0000 7f9a8a058200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T13:20:18.968 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:18.685+0000 7fea95376200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:18.968 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:18.778+0000 7fea95376200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:20:19.226 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:18.967+0000 7fea95376200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:19.270 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:19.346 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:18.970+0000 7f9a8a058200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T13:20:19.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 -- 172.21.15.139:0/394459546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 msgr2=0x7f3fe810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 --2- 172.21.15.139:0/394459546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe810c580 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000b0a0 tx=0x7f3fe000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 -- 172.21.15.139:0/394459546 shutdown_connections 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 --2- 172.21.15.139:0/394459546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe810c580 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 --2- 172.21.15.139:0/394459546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 --2- 172.21.15.139:0/394459546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 0x7f3fe80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 -- 172.21.15.139:0/394459546 >> 172.21.15.139:0/394459546 conn(0x7f3fe8075790 msgr2=0x7f3fe8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 -- 172.21.15.139:0/394459546 shutdown_connections 2023-10-08T13:20:19.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.389+0000 7f3fef393700 1 -- 172.21.15.139:0/394459546 wait complete. 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 Processor -- start 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 -- start start 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 0x7f3fe8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe819ddc0 con 0x7f3fe8100110 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe819df30 con 0x7f3fe81056b0 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fef393700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe819e0f0 con 0x7f3fe80ff750 2023-10-08T13:20:19.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36942/0 (socket says 172.21.15.139:36942) 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 -- 172.21.15.139:0/3848684354 learned_addr learned my addr 172.21.15.139:0/3848684354 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fed930700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fed12f700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 0x7f3fe8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 -- 172.21.15.139:0/3848684354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 msgr2=0x7f3fe8198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 0x7f3fe8198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 -- 172.21.15.139:0/3848684354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 msgr2=0x7f3fe819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.390+0000 7f3fec92e700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fec92e700 1 -- 172.21.15.139:0/3848684354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0009d00 con 0x7f3fe8100110 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fed930700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fec92e700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800d980 tx=0x7f3fd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8004220 con 0x7f3fe8100110 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(25 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3fd8007640 con 0x7f3fe8100110 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe819e3d0 con 0x7f3fe8100110 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.391+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80055d0 con 0x7f3fe8100110 2023-10-08T13:20:19.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.392+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe81a5c30 con 0x7f3fe8100110 2023-10-08T13:20:19.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.392+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe8102950 con 0x7f3fe8100110 2023-10-08T13:20:19.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.393+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7f3fd8004750 con 0x7f3fe8100110 2023-10-08T13:20:19.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.393+0000 7f3fde7fc700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 0x7f3fd403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.393+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3fd804b710 con 0x7f3fe8100110 2023-10-08T13:20:19.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.393+0000 7f3fed12f700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 0x7f3fd403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.394+0000 7f3fed12f700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 0x7f3fd403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009be0 tx=0x7f3fe4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:19.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.400+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fd8005730 con 0x7f3fe8100110 2023-10-08T13:20:19.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:19 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' 2023-10-08T13:20:19.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.617+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7f3fe819a1d0 con 0x7f3fe8100110 2023-10-08T13:20:19.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.621+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3fd8016020 con 0x7f3fe8100110 2023-10-08T13:20:19.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.623+0000 7f3fde7fc700 1 -- 172.21.15.139:0/3848684354 <== mon.0 v2:172.21.15.139:3300/0 8 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fd8004f20 con 0x7f3fe8100110 2023-10-08T13:20:19.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 msgr2=0x7f3fd403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 0x7f3fd403b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4009be0 tx=0x7f3fe4009260 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 msgr2=0x7f3fe8199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800d980 tx=0x7f3fd800dc90 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 shutdown_connections 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fd4038b40 0x7f3fd403b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe81056b0 0x7f3fe819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe80ff750 0x7f3fe8198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 --2- 172.21.15.139:0/3848684354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe8100110 0x7f3fe8199400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.625+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 >> 172.21.15.139:0/3848684354 conn(0x7f3fe8075790 msgr2=0x7f3fe80fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.626+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 shutdown_connections 2023-10-08T13:20:19.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.626+0000 7f3fef393700 1 -- 172.21.15.139:0/3848684354 wait complete. 2023-10-08T13:20:19.659 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:19.270+0000 7fea95376200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:20:19.659 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:19.505+0000 7fea95376200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:20:19.659 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' 2023-10-08T13:20:19.660 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.660 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.660 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.660 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- 172.21.15.139:0/313154813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc105690 msgr2=0x7ffabc105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 --2- 172.21.15.139:0/313154813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc105690 0x7ffabc105a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009990 tx=0x7ffaac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- 172.21.15.139:0/313154813 shutdown_connections 2023-10-08T13:20:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 --2- 172.21.15.139:0/313154813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc10c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 --2- 172.21.15.139:0/313154813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc105690 0x7ffabc105a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 --2- 172.21.15.139:0/313154813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc0ff750 0x7ffabc0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- 172.21.15.139:0/313154813 >> 172.21.15.139:0/313154813 conn(0x7ffabc0757d0 msgr2=0x7ffabc075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- 172.21.15.139:0/313154813 shutdown_connections 2023-10-08T13:20:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- 172.21.15.139:0/313154813 wait complete. 2023-10-08T13:20:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 Processor -- start 2023-10-08T13:20:19.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.745+0000 7ffac14d1700 1 -- start start 2023-10-08T13:20:19.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc105690 0x7ffabc195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc196110 con 0x7ffabc0ff750 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc196280 con 0x7ffabc105690 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffac14d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc196440 con 0x7ffabc100110 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffabaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffabaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36954/0 (socket says 172.21.15.139:36954) 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffabaffd700 1 -- 172.21.15.139:0/3378727258 learned_addr learned my addr 172.21.15.139:0/3378727258 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffabb7fe700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc105690 0x7ffabc195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 -- 172.21.15.139:0/3378727258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc105690 msgr2=0x7ffabc195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc105690 0x7ffabc195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 -- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 msgr2=0x7ffabc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 -- 172.21.15.139:0/3378727258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0095f0 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffabaffd700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.746+0000 7ffaba7fc700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc19bdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffab000d750 tx=0x7ffab000da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0004020 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffab0004830 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc196660 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00054c0 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc069040 con 0x7ffabc100110 2023-10-08T13:20:19.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.747+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7ffab000f690 con 0x7ffabc100110 2023-10-08T13:20:19.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.748+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc100dd0 con 0x7ffabc100110 2023-10-08T13:20:19.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.748+0000 7ffaa3fff700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 0x7ffaa403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:19.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.748+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ffab004af20 con 0x7ffabc100110 2023-10-08T13:20:19.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.748+0000 7ffabaffd700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 0x7ffaa403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:19.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.748+0000 7ffabaffd700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 0x7ffaa403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b2e0 tx=0x7ffaac005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:19.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.753+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffab001f950 con 0x7ffabc100110 2023-10-08T13:20:19.846 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:19.422+0000 7f9a8a058200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T13:20:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' 2023-10-08T13:20:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:19.924 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:19.658+0000 7fea95376200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:20:19.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.958+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7ffabc0686b0 con 0x7ffabc100110 2023-10-08T13:20:19.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.965+0000 7ffaa3fff700 1 -- 172.21.15.139:0/3378727258 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) v1 ==== 106+0+0 (secure 0 0 0) 0x7ffab004c070 con 0x7ffabc100110 2023-10-08T13:20:19.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 msgr2=0x7ffaa403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 0x7ffaa403b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00b2e0 tx=0x7ffaac005bc0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 msgr2=0x7ffabc19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc19bdf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffab000d750 tx=0x7ffab000da60 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 shutdown_connections 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffaa4038b40 0x7ffaa403b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffabc105690 0x7ffabc195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffabc0ff750 0x7ffabc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 --2- 172.21.15.139:0/3378727258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffabc100110 0x7ffabc19bdf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 >> 172.21.15.139:0/3378727258 conn(0x7ffabc0757d0 msgr2=0x7ffabc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.967+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 shutdown_connections 2023-10-08T13:20:19.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:19.968+0000 7ffac14d1700 1 -- 172.21.15.139:0/3378727258 wait complete. 2023-10-08T13:20:20.021 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:20.037 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:20.226 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:19.922+0000 7fea95376200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:20:20.397 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:20.099+0000 7f9a8a058200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T13:20:20.397 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:20.180+0000 7f9a8a058200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T13:20:20.570 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.570 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: Reconfiguring daemon mgr.x on smithi139 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3848684354' entity='client.admin' 2023-10-08T13:20:20.571 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:20 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' 2023-10-08T13:20:20.726 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:20.626+0000 7fea95376200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:20:20.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: Reconfiguring daemon mgr.x on smithi139 2023-10-08T13:20:20.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3848684354' entity='client.admin' 2023-10-08T13:20:20.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' 2023-10-08T13:20:20.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: Reconfiguring daemon mgr.x on smithi139 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3848684354' entity='client.admin' 2023-10-08T13:20:20.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' 2023-10-08T13:20:21.060 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:21.067 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:20.758+0000 7fea95376200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:20:21.067 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:20.953+0000 7fea95376200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:20:21.219 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:20.956+0000 7f9a8a058200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:21.219 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:21.047+0000 7f9a8a058200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T13:20:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 -- 172.21.15.139:0/3127477727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 msgr2=0x7fad780685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 --2- 172.21.15.139:0/3127477727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad780685f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad68009990 tx=0x7fad68009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 -- 172.21.15.139:0/3127477727 shutdown_connections 2023-10-08T13:20:21.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 --2- 172.21.15.139:0/3127477727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 --2- 172.21.15.139:0/3127477727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 --2- 172.21.15.139:0/3127477727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad780685f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 -- 172.21.15.139:0/3127477727 >> 172.21.15.139:0/3127477727 conn(0x7fad78075790 msgr2=0x7fad78075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 -- 172.21.15.139:0/3127477727 shutdown_connections 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.874+0000 7fad80012700 1 -- 172.21.15.139:0/3127477727 wait complete. 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 Processor -- start 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 -- start start 2023-10-08T13:20:21.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad78197170 con 0x7fad78068190 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781972e0 con 0x7fad781067a0 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad80012700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781974a0 con 0x7fad78068b30 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7ddae700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7ddae700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36968/0 (socket says 172.21.15.139:36968) 2023-10-08T13:20:21.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7ddae700 1 -- 172.21.15.139:0/2124184864 learned_addr learned my addr 172.21.15.139:0/2124184864 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7e5af700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7d5ad700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.875+0000 7fad7ddae700 1 -- 172.21.15.139:0/2124184864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 msgr2=0x7fad7819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7ddae700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7ddae700 1 -- 172.21.15.139:0/2124184864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 msgr2=0x7fad78196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7ddae700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7ddae700 1 -- 172.21.15.139:0/2124184864 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680095f0 con 0x7fad78068190 2023-10-08T13:20:21.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7e5af700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7d5ad700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad7ddae700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad7400e9a0 tx=0x7fad7400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74009790 con 0x7fad78068190 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad74010430 con 0x7fad78068190 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad78197780 con 0x7fad78068190 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74018680 con 0x7fad78068190 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.876+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781a3920 con 0x7fad78068190 2023-10-08T13:20:21.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.877+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78108dc0 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.882+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) v1 ==== 45653+0+0 (secure 0 0 0) 0x7fad740105a0 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.882+0000 7fad6effd700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 0x7fad6403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.882+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fad74014070 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.882+0000 7fad7d5ad700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 0x7fad6403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.883+0000 7fad7d5ad700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 0x7fad6403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b2e0 tx=0x7fad68005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:20.887+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fad7401f780 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.102+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fad78101ee0 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.105+0000 7fad6effd700 1 -- 172.21.15.139:0/2124184864 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) v1 ==== 116+0+0 (secure 0 0 0) 0x7fad7401f780 con 0x7fad78068190 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 msgr2=0x7fad6403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 0x7fad6403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b2e0 tx=0x7fad68005960 comp rx=0 tx=0).stop 2023-10-08T13:20:21.319 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 msgr2=0x7fad7819c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad7400e9a0 tx=0x7fad7400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 shutdown_connections 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fad64038b40 0x7fad6403b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad781067a0 0x7fad78196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78068190 0x7fad7819c930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 --2- 172.21.15.139:0/2124184864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad78068b30 0x7fad7819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 >> 172.21.15.139:0/2124184864 conn(0x7fad78075790 msgr2=0x7fad780fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 shutdown_connections 2023-10-08T13:20:21.320 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:21.107+0000 7fad80012700 1 -- 172.21.15.139:0/2124184864 wait complete. 2023-10-08T13:20:21.476 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:21.066+0000 7fea95376200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:21.476 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:21.283+0000 7fea95376200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:20:21.498 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:21.219+0000 7f9a8a058200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T13:20:21.846 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:21.497+0000 7f9a8a058200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T13:20:21.846 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:21.725+0000 7f9a8a058200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T13:20:22.138 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:22 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2124184864' entity='client.admin' 2023-10-08T13:20:22.138 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:21.874+0000 7f9a8a058200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T13:20:22.365 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:22 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2124184864' entity='client.admin' 2023-10-08T13:20:22.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:22 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2124184864' entity='client.admin' 2023-10-08T13:20:22.476 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:20:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z[107355]: 2023-10-08T13:20:22.145+0000 7fea95376200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:20:22.596 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:22.137+0000 7f9a8a058200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T13:20:22.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi139') 2023-10-08T13:20:22.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi139') 2023-10-08T13:20:22.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi139') 2023-10-08T13:20:22.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi139') 2023-10-08T13:20:22.617 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi139') 2023-10-08T13:20:22.618 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi139') 2023-10-08T13:20:23.096 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:22.842+0000 7f9a8a058200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T13:20:23.096 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:22.974+0000 7f9a8a058200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T13:20:23.311 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:23 smithi139 ceph-mon[99506]: Standby manager daemon z started 2023-10-08T13:20:23.312 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:23 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T13:20:23.312 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:23 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:23.312 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:23 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T13:20:23.312 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:23 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:23 smithi187 ceph-mon[104336]: Standby manager daemon z started 2023-10-08T13:20:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:23 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T13:20:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:23 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:23.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:23 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T13:20:23.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:23 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:23.502 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:23.170+0000 7f9a8a058200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T13:20:23.502 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:23.283+0000 7f9a8a058200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T13:20:23.502 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-mon[103467]: Standby manager daemon z started 2023-10-08T13:20:23.503 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T13:20:23.503 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:23.503 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T13:20:23.503 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.187:0/1501953504' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:23.644 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:23.684 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:23.708 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi139') 2023-10-08T13:20:23.708 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi139') 2023-10-08T13:20:23.846 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:23.501+0000 7f9a8a058200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T13:20:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:24 smithi139 ceph-mon[99506]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-08T13:20:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T13:20:24.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:24 smithi155 ceph-mon[103467]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-08T13:20:24.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T13:20:24.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:24 smithi187 ceph-mon[104336]: mgrmap e18: x(active, since 14s), standbys: z 2023-10-08T13:20:24.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T13:20:24.846 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:20:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y[105812]: 2023-10-08T13:20:24.381+0000 7f9a8a058200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T13:20:24.890 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:25.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:25 smithi139 ceph-mon[99506]: Standby manager daemon y started 2023-10-08T13:20:25.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:25 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T13:20:25.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:25 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:25.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:25 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T13:20:25.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:25 smithi139 ceph-mon[99506]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:25 smithi187 ceph-mon[104336]: Standby manager daemon y started 2023-10-08T13:20:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:25 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T13:20:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:25 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:25.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:25 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T13:20:25.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:25 smithi187 ceph-mon[104336]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:25.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:25 smithi155 ceph-mon[103467]: Standby manager daemon y started 2023-10-08T13:20:25.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:25 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T13:20:25.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:25 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T13:20:25.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:25 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T13:20:25.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:25 smithi155 ceph-mon[103467]: from='mgr.? 172.21.15.155:0/2610864819' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/2685341853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff190 msgr2=0x7f2f440ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/2685341853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff190 0x7f2f440ff5f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009990 tx=0x7f2f34009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/2685341853 shutdown_connections 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/2685341853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ffb30 0x7f2f4410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/2685341853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 0x7f2f44105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/2685341853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff190 0x7f2f440ff5f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/2685341853 >> 172.21.15.139:0/2685341853 conn(0x7f2f44074a10 msgr2=0x7f2f44074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/2685341853 shutdown_connections 2023-10-08T13:20:25.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.961+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/2685341853 wait complete. 2023-10-08T13:20:25.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 Processor -- start 2023-10-08T13:20:25.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 -- start start 2023-10-08T13:20:25.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ff190 0x7f2f4419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:25.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:25.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 0x7f2f44196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:25.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f441970f0 con 0x7f2f440ffb30 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44197260 con 0x7f2f441058d0 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4a2ce700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44197420 con 0x7f2f440ff190 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:36984/0 (socket says 172.21.15.139:36984) 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 -- 172.21.15.139:0/3663161985 learned_addr learned my addr 172.21.15.139:0/3663161985 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f43fff700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ff190 0x7f2f4419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f4886b700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 0x7f2f44196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 -- 172.21.15.139:0/3663161985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ff190 msgr2=0x7f2f4419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ff190 0x7f2f4419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 -- 172.21.15.139:0/3663161985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 msgr2=0x7f2f44196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.962+0000 7f2f437fe700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 0x7f2f44196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f437fe700 1 -- 172.21.15.139:0/3663161985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f340095f0 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f437fe700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f340095c0 tx=0x7f2f3400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3401d070 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f34005030 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34004a90 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f441976a0 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.963+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f441a3940 con 0x7f2f440ffb30 2023-10-08T13:20:25.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.964+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f44108d30 con 0x7f2f440ffb30 2023-10-08T13:20:25.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.965+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f2f34005410 con 0x7f2f440ffb30 2023-10-08T13:20:25.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.965+0000 7f2f417fa700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:25.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.966+0000 7f2f43fff700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:25.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.966+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2f340cc360 con 0x7f2f440ffb30 2023-10-08T13:20:25.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.966+0000 7f2f43fff700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f44068160 tx=0x7f2f3800a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:25.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:25.969+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f340975b0 con 0x7f2f440ffb30 2023-10-08T13:20:26.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.172+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f2f44067c30 con 0x7f2f440ffb30 2023-10-08T13:20:26.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.175+0000 7f2f417fa700 1 -- 172.21.15.139:0/3663161985 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v19)=0 v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2f3409abd0 con 0x7f2f440ffb30 2023-10-08T13:20:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 msgr2=0x7f2f2c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f44068160 tx=0x7f2f3800a380 comp rx=0 tx=0).stop 2023-10-08T13:20:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 msgr2=0x7f2f4419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f340095c0 tx=0x7f2f3400f690 comp rx=0 tx=0).stop 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 shutdown_connections 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441058d0 0x7f2f44196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f440ff190 0x7f2f4419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 --2- 172.21.15.139:0/3663161985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ffb30 0x7f2f4419ce90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 >> 172.21.15.139:0/3663161985 conn(0x7f2f44074a10 msgr2=0x7f2f440fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 shutdown_connections 2023-10-08T13:20:26.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.178+0000 7f2f4a2ce700 1 -- 172.21.15.139:0/3663161985 wait complete. 2023-10-08T13:20:26.385 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:26 smithi139 ceph-mon[99506]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T13:20:26.385 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:26 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T13:20:26.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:26 smithi187 ceph-mon[104336]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T13:20:26.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:26 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T13:20:26.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:26 smithi155 ceph-mon[103467]: mgrmap e19: x(active, since 16s), standbys: z, y 2023-10-08T13:20:26.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:26 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/3274234787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb28068190 msgr2=0x7fbb280685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/3274234787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb28068190 0x7fbb280685f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbb14009990 tx=0x7fbb14009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/3274234787 shutdown_connections 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/3274234787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068b30 0x7fbb2810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/3274234787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb281067a0 0x7fbb28106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/3274234787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb28068190 0x7fbb280685f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/3274234787 >> 172.21.15.139:0/3274234787 conn(0x7fbb28075790 msgr2=0x7fbb28075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:26.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/3274234787 shutdown_connections 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.896+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/3274234787 wait complete. 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 Processor -- start 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 -- start start 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068190 0x7fbb2819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb28068b30 0x7fbb2819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28197110 con 0x7fbb281067a0 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28197280 con 0x7fbb28068190 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ecf9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28197440 con 0x7fbb28068b30 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37000/0 (socket says 172.21.15.139:37000) 2023-10-08T13:20:26.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 -- 172.21.15.139:0/1946704723 learned_addr learned my addr 172.21.15.139:0/1946704723 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2ca95700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068190 0x7fbb2819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb27fff700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb28068b30 0x7fbb2819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 -- 172.21.15.139:0/1946704723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb28068b30 msgr2=0x7fbb2819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb28068b30 0x7fbb2819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 -- 172.21.15.139:0/1946704723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068190 msgr2=0x7fbb2819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068190 0x7fbb2819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 -- 172.21.15.139:0/1946704723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140095f0 con 0x7fbb281067a0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.897+0000 7fbb2d296700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb20007ee0 tx=0x7fbb2000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.898+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2000dd20 con 0x7fbb281067a0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.898+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb2000f040 con 0x7fbb281067a0 2023-10-08T13:20:26.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.898+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb28197720 con 0x7fbb281067a0 2023-10-08T13:20:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.898+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb200048a0 con 0x7fbb281067a0 2023-10-08T13:20:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.898+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb281a3910 con 0x7fbb281067a0 2023-10-08T13:20:26.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.899+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28108d50 con 0x7fbb281067a0 2023-10-08T13:20:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.900+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fbb20003a00 con 0x7fbb281067a0 2023-10-08T13:20:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.900+0000 7fbb25ffb700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 0x7fbb180a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.900+0000 7fbb2ca95700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 0x7fbb180a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.901+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fbb200ca910 con 0x7fbb281067a0 2023-10-08T13:20:26.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.901+0000 7fbb2ca95700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 0x7fbb180a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005950 tx=0x7fbb1c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:26.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:26.905+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbb2004f100 con 0x7fbb281067a0 2023-10-08T13:20:27.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.102+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7fbb28101ee0 con 0x7fbb281067a0 2023-10-08T13:20:27.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.105+0000 7fbb25ffb700 1 -- 172.21.15.139:0/1946704723 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v20)=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7fbb20095b70 con 0x7fbb281067a0 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 msgr2=0x7fbb180a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 0x7fbb180a3980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005950 tx=0x7fbb1c00b410 comp rx=0 tx=0).stop 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 msgr2=0x7fbb28196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb20007ee0 tx=0x7fbb2000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 shutdown_connections 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbb180a14c0 0x7fbb180a3980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb281067a0 0x7fbb28196ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb28068190 0x7fbb2819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:27.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 --2- 172.21.15.139:0/1946704723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb28068b30 0x7fbb2819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:27.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 >> 172.21.15.139:0/1946704723 conn(0x7fbb28075790 msgr2=0x7fbb280fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:27.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 shutdown_connections 2023-10-08T13:20:27.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:27.108+0000 7fbb2ecf9700 1 -- 172.21.15.139:0/1946704723 wait complete. 2023-10-08T13:20:27.400 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:27 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3663161985' entity='client.admin' 2023-10-08T13:20:27.400 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:27 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1946704723' entity='client.admin' 2023-10-08T13:20:27.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:27 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3663161985' entity='client.admin' 2023-10-08T13:20:27.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:27 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1946704723' entity='client.admin' 2023-10-08T13:20:27.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:27 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3663161985' entity='client.admin' 2023-10-08T13:20:27.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:27 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1946704723' entity='client.admin' 2023-10-08T13:20:28.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 -- 172.21.15.139:0/1464655008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 msgr2=0x7f01580ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:28.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 --2- 172.21.15.139:0/1464655008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f01580ff5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f014c009990 tx=0x7f014c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 -- 172.21.15.139:0/1464655008 shutdown_connections 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 --2- 172.21.15.139:0/1464655008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 0x7f015810d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 --2- 172.21.15.139:0/1464655008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 --2- 172.21.15.139:0/1464655008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f01580ff5d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 -- 172.21.15.139:0/1464655008 >> 172.21.15.139:0/1464655008 conn(0x7f0158074aa0 msgr2=0x7f0158074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 -- 172.21.15.139:0/1464655008 shutdown_connections 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 -- 172.21.15.139:0/1464655008 wait complete. 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.536+0000 7f015d498700 1 Processor -- start 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 -- start start 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 0x7f015819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:28.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01581971d0 con 0x7f01580ff150 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158197340 con 0x7f0158105840 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158197500 con 0x7f01580ffb10 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37010/0 (socket says 172.21.15.139:37010) 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 -- 172.21.15.139:0/1435283048 learned_addr learned my addr 172.21.15.139:0/1435283048 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f01567fc700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 0x7f015819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f01577fe700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 -- 172.21.15.139:0/1435283048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 msgr2=0x7f015819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 0x7f015819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 -- 172.21.15.139:0/1435283048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 msgr2=0x7f0158196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 -- 172.21.15.139:0/1435283048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0095f0 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f01577fe700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f0156ffd700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f014800b530 tx=0x7f014800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011830 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0148011e50 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01581977e0 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.537+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800f2e0 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.538+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01581a39d0 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.538+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158108db0 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.540+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f0148010380 con 0x7f01580ff150 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.540+0000 7f013ffff700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 0x7f01400a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:28.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.540+0000 7f01567fc700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 0x7f01400a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.540+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f01480cb190 con 0x7f01580ff150 2023-10-08T13:20:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.541+0000 7f01567fc700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 0x7f01400a3980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0158197ce0 tx=0x7f014c005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:28.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.544+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01480963f0 con 0x7f01580ff150 2023-10-08T13:20:28.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.759+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f0158068950 con 0x7f01580ff150 2023-10-08T13:20:28.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.762+0000 7f013ffff700 1 -- 172.21.15.139:0/1435283048 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f01480150b0 con 0x7f01580ff150 2023-10-08T13:20:28.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 msgr2=0x7f01400a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:28.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 0x7f01400a3980 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0158197ce0 tx=0x7f014c005fd0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 msgr2=0x7f015819c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:28.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f014800b530 tx=0x7f014800b840 comp rx=0 tx=0).stop 2023-10-08T13:20:28.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 shutdown_connections 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01400a14c0 0x7f01400a3980 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0158105840 0x7f0158196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01580ff150 0x7f015819c9e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 --2- 172.21.15.139:0/1435283048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01580ffb10 0x7f015819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 >> 172.21.15.139:0/1435283048 conn(0x7f0158074aa0 msgr2=0x7f01580fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 shutdown_connections 2023-10-08T13:20:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.765+0000 7f015d498700 1 -- 172.21.15.139:0/1435283048 wait complete. 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 -- 172.21.15.139:0/1572110373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1481002a0 msgr2=0x7fd148100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 --2- 172.21.15.139:0/1572110373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1481002a0 0x7fd148100720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd138009990 tx=0x7fd138009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 -- 172.21.15.139:0/1572110373 shutdown_connections 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 --2- 172.21.15.139:0/1572110373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148100c60 0x7fd14810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 --2- 172.21.15.139:0/1572110373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd148104720 0x7fd148104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 --2- 172.21.15.139:0/1572110373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1481002a0 0x7fd148100720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 -- 172.21.15.139:0/1572110373 >> 172.21.15.139:0/1572110373 conn(0x7fd148074a10 msgr2=0x7fd148074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.039+0000 7fd14f678700 1 -- 172.21.15.139:0/1572110373 shutdown_connections 2023-10-08T13:20:29.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.040+0000 7fd14f678700 1 -- 172.21.15.139:0/1572110373 wait complete. 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.040+0000 7fd14f678700 1 Processor -- start 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 -- start start 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1481002a0 0x7fd1481979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148104720 0x7fd1481a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481987b0 con 0x7fd148100c60 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481a2f70 con 0x7fd1481002a0 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14f678700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1481a30b0 con 0x7fd148104720 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37040/0 (socket says 172.21.15.139:37040) 2023-10-08T13:20:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 -- 172.21.15.139:0/3018520681 learned_addr learned my addr 172.21.15.139:0/3018520681 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14d414700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1481002a0 0x7fd1481979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14dc15700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148104720 0x7fd1481a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 -- 172.21.15.139:0/3018520681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148104720 msgr2=0x7fd1481a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148104720 0x7fd1481a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 -- 172.21.15.139:0/3018520681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1481002a0 msgr2=0x7fd1481979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1481002a0 0x7fd1481979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 -- 172.21.15.139:0/3018520681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380095f0 con 0x7fd148100c60 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.041+0000 7fd14cc13700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd138009fd0 tx=0x7fd13800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.042+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13801d070 con 0x7fd148100c60 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.042+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd138005510 con 0x7fd148100c60 2023-10-08T13:20:29.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.042+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1481a32d0 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.042+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138004a90 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.042+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1481a37c0 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.043+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd148107c60 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.044+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fd138004c30 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.045+0000 7fd13e7fc700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 0x7fd1340a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.045+0000 7fd14d414700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 0x7fd1340a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.045+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd1380cc230 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.046+0000 7fd14d414700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 0x7fd1340a3980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd144005950 tx=0x7fd14400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.049+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd138097520 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd1480ff750 con 0x7fd148100c60 2023-10-08T13:20:29.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.267+0000 7fd13e7fc700 1 -- 172.21.15.139:0/3018520681 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd13809ab40 con 0x7fd148100c60 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 msgr2=0x7fd1340a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 0x7fd1340a3980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd144005950 tx=0x7fd14400b410 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 msgr2=0x7fd148197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd138009fd0 tx=0x7fd13800f670 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 shutdown_connections 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd1340a14c0 0x7fd1340a3980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd148104720 0x7fd1481a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1481002a0 0x7fd1481979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 --2- 172.21.15.139:0/3018520681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd148100c60 0x7fd148197ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 >> 172.21.15.139:0/3018520681 conn(0x7fd148074a10 msgr2=0x7fd1480fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 shutdown_connections 2023-10-08T13:20:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.271+0000 7fd14f678700 1 -- 172.21.15.139:0/3018520681 wait complete. 2023-10-08T13:20:29.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 -- 172.21.15.139:0/4162042114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 msgr2=0x7f92ac0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 --2- 172.21.15.139:0/4162042114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac0ffbd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009990 tx=0x7f92a0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 -- 172.21.15.139:0/4162042114 shutdown_connections 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 --2- 172.21.15.139:0/4162042114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac100110 0x7f92ac10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 --2- 172.21.15.139:0/4162042114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac1056b0 0x7f92ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 --2- 172.21.15.139:0/4162042114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac0ffbd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 -- 172.21.15.139:0/4162042114 >> 172.21.15.139:0/4162042114 conn(0x7f92ac075790 msgr2=0x7f92ac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 -- 172.21.15.139:0/4162042114 shutdown_connections 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.955+0000 7f92b21bf700 1 -- 172.21.15.139:0/4162042114 wait complete. 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.956+0000 7f92b21bf700 1 Processor -- start 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.956+0000 7f92b21bf700 1 -- start start 2023-10-08T13:20:29.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.956+0000 7f92b21bf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.956+0000 7f92b21bf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac100110 0x7f92ac19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 0x7f92ac195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac195f90 con 0x7f92ac0ff750 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac196100 con 0x7f92ac100110 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac1962c0 con 0x7f92ac1056b0 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37024/0 (socket says 172.21.15.139:37024) 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 -- 172.21.15.139:0/3158955643 learned_addr learned my addr 172.21.15.139:0/3158955643 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92abfff700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 0x7f92ac195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 -- 172.21.15.139:0/3158955643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 msgr2=0x7f92ac195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 0x7f92ac195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 -- 172.21.15.139:0/3158955643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac100110 msgr2=0x7f92ac19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92aaffd700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac100110 0x7f92ac19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac100110 0x7f92ac19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 -- 172.21.15.139:0/3158955643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00095f0 con 0x7f92ac0ff750 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92abfff700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 0x7f92ac195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92ab7fe700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d980 tx=0x7f929c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c00bb60 con 0x7f92ac0ff750 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f929c007640 con 0x7f92ac0ff750 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac1965a0 con 0x7f92ac0ff750 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c004e90 con 0x7f92ac0ff750 2023-10-08T13:20:29.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.957+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac068360 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.958+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac100df0 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.959+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f929c00bcc0 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.960+0000 7f92a8ff9700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 0x7f92940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.960+0000 7f92aaffd700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 0x7f92940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.960+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f929c0cb430 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.960+0000 7f92aaffd700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 0x7f92940a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92a0003730 tx=0x7f92a00036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:28.963+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f929c096690 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.176+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f92ac04e4c0 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.181+0000 7f92a8ff9700 1 -- 172.21.15.139:0/3158955643 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7f929c016020 con 0x7f92ac0ff750 2023-10-08T13:20:29.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 msgr2=0x7f92940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 0x7f92940a3980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92a0003730 tx=0x7f92a00036c0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 msgr2=0x7f92ac19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f929c00d980 tx=0x7f929c00dd40 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 shutdown_connections 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92940a14c0 0x7f92940a3980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ac1056b0 0x7f92ac195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ac0ff750 0x7f92ac19b7f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 --2- 172.21.15.139:0/3158955643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ac100110 0x7f92ac19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 >> 172.21.15.139:0/3158955643 conn(0x7f92ac075790 msgr2=0x7f92ac0fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 shutdown_connections 2023-10-08T13:20:29.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.184+0000 7f92b21bf700 1 -- 172.21.15.139:0/3158955643 wait complete. 2023-10-08T13:20:29.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 -- 172.21.15.139:0/1709499832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef38100110 msgr2=0x7fef3810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1709499832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef38100110 0x7fef3810c580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fef3000b0a0 tx=0x7fef3000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 -- 172.21.15.139:0/1709499832 shutdown_connections 2023-10-08T13:20:29.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1709499832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef38100110 0x7fef3810c580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1709499832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef381056b0 0x7fef38105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1709499832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 0x7fef380ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 -- 172.21.15.139:0/1709499832 >> 172.21.15.139:0/1709499832 conn(0x7fef38075790 msgr2=0x7fef38075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 -- 172.21.15.139:0/1709499832 shutdown_connections 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.893+0000 7fef3eeac700 1 -- 172.21.15.139:0/1709499832 wait complete. 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 Processor -- start 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 -- start start 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 0x7fef38197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38100110 0x7fef381980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef381989e0 con 0x7fef381056b0 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef381a3170 con 0x7fef380ff750 2023-10-08T13:20:29.897 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3eeac700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef381a32e0 con 0x7fef38100110 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37098/0 (socket says 172.21.15.139:37098) 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 -- 172.21.15.139:0/1754672902 learned_addr learned my addr 172.21.15.139:0/1754672902 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef37fff700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38100110 0x7fef381980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3cc48700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 0x7fef38197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 -- 172.21.15.139:0/1754672902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38100110 msgr2=0x7fef381980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38100110 0x7fef381980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 -- 172.21.15.139:0/1754672902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 msgr2=0x7fef38197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 0x7fef38197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:29.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 -- 172.21.15.139:0/1754672902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009d00 con 0x7fef381056b0 2023-10-08T13:20:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.894+0000 7fef3d449700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef300077f0 tx=0x7fef30007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.895+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e040 con 0x7fef381056b0 2023-10-08T13:20:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.895+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef30004c60 con 0x7fef381056b0 2023-10-08T13:20:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.895+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30005280 con 0x7fef381056b0 2023-10-08T13:20:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.895+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef381a3560 con 0x7fef381056b0 2023-10-08T13:20:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.895+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef381a3980 con 0x7fef381056b0 2023-10-08T13:20:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.896+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef38107cb0 con 0x7fef381056b0 2023-10-08T13:20:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.897+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fef3001b450 con 0x7fef381056b0 2023-10-08T13:20:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.897+0000 7fef35ffb700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 0x7fef280a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.898+0000 7fef3cc48700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 0x7fef280a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.898+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fef300cc730 con 0x7fef381056b0 2023-10-08T13:20:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.898+0000 7fef3cc48700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 0x7fef280a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef2c005950 tx=0x7fef2c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.902+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef30097a20 con 0x7fef381056b0 2023-10-08T13:20:29.914 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:29.914 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1435283048' entity='client.admin' 2023-10-08T13:20:29.914 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3158955643' entity='client.admin' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3018520681' entity='client.admin' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3931273098' entity='client.admin' 2023-10-08T13:20:29.915 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:29 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' 2023-10-08T13:20:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1435283048' entity='client.admin' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3158955643' entity='client.admin' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3018520681' entity='client.admin' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3931273098' entity='client.admin' 2023-10-08T13:20:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:29 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' 2023-10-08T13:20:30.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.109+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fef38068750 con 0x7fef381056b0 2023-10-08T13:20:30.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.113+0000 7fef35ffb700 1 -- 172.21.15.139:0/1754672902 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fef3009b040 con 0x7fef381056b0 2023-10-08T13:20:30.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 msgr2=0x7fef280a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 0x7fef280a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef2c005950 tx=0x7fef2c0058e0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 msgr2=0x7fef381a2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef300077f0 tx=0x7fef30007820 comp rx=0 tx=0).stop 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 shutdown_connections 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef280a14c0 0x7fef280a3980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef381056b0 0x7fef381a2c30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef380ff750 0x7fef38197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 --2- 172.21.15.139:0/1754672902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef38100110 0x7fef381980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.115+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 >> 172.21.15.139:0/1754672902 conn(0x7fef38075790 msgr2=0x7fef380fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.116+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 shutdown_connections 2023-10-08T13:20:30.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.116+0000 7fef3eeac700 1 -- 172.21.15.139:0/1754672902 wait complete. 2023-10-08T13:20:30.133 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:30.133 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1435283048' entity='client.admin' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3158955643' entity='client.admin' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3018520681' entity='client.admin' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' 2023-10-08T13:20:30.134 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3931273098' entity='client.admin' 2023-10-08T13:20:30.135 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:29 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' 2023-10-08T13:20:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.438+0000 7fc7d813c700 1 -- 172.21.15.139:0/1655474712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01089d0 msgr2=0x7fc7d0108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.438+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1655474712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01089d0 0x7fc7d0108db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009990 tx=0x7fc7cc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- 172.21.15.139:0/1655474712 shutdown_connections 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1655474712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 0x7fc7d010f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1655474712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01089d0 0x7fc7d0108db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1655474712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01029d0 0x7fc7d0102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- 172.21.15.139:0/1655474712 >> 172.21.15.139:0/1655474712 conn(0x7fc7d00fe4c0 msgr2=0x7fc7d01008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- 172.21.15.139:0/1655474712 shutdown_connections 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- 172.21.15.139:0/1655474712 wait complete. 2023-10-08T13:20:30.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 Processor -- start 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- start start 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 0x7fc7d0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 0x7fc7d019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.439+0000 7fc7d813c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d019dd50 con 0x7fc7d01029d0 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d813c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d019dec0 con 0x7fc7d0103390 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d813c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d019e080 con 0x7fc7d01089d0 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d5ed8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d5ed8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37080/0 (socket says 172.21.15.139:37080) 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d5ed8700 1 -- 172.21.15.139:0/1744637218 learned_addr learned my addr 172.21.15.139:0/1744637218 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 0x7fc7d019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d56d7700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 0x7fc7d0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 -- 172.21.15.139:0/1744637218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 msgr2=0x7fc7d0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 0x7fc7d0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 -- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 msgr2=0x7fc7d0198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 -- 172.21.15.139:0/1744637218 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0095f0 con 0x7fc7d01089d0 2023-10-08T13:20:30.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d5ed8700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d66d9700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 0x7fc7d019d740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800efc0 tx=0x7fc7c800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8018070 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7c800f040 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d019e300 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800cd40 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.440+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d01a5bc0 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.441+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d010af60 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.443+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fc7c8003a00 con 0x7fc7d01089d0 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.443+0000 7fc7c6ffd700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 0x7fc7bc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.443+0000 7fc7d5ed8700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 0x7fc7bc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.443+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc7c80cb5f0 con 0x7fc7d01089d0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.444+0000 7fc7d5ed8700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 0x7fc7bc0a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00b2e0 tx=0x7fc7cc005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.447+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc7c80968c0 con 0x7fc7d01089d0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.661+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fc7d004e4c0 con 0x7fc7d01089d0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.666+0000 7fc7c6ffd700 1 -- 172.21.15.139:0/1744637218 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc7c8099ee0 con 0x7fc7d01089d0 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 msgr2=0x7fc7bc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 0x7fc7bc0a3980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00b2e0 tx=0x7fc7cc005bc0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 msgr2=0x7fc7d019d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 0x7fc7d019d740 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800efc0 tx=0x7fc7c800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 shutdown_connections 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7bc0a14c0 0x7fc7bc0a3980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d01089d0 0x7fc7d019d740 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7d01029d0 0x7fc7d0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 --2- 172.21.15.139:0/1744637218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7d0103390 0x7fc7d0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 >> 172.21.15.139:0/1744637218 conn(0x7fc7d00fe4c0 msgr2=0x7fc7d00fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 shutdown_connections 2023-10-08T13:20:30.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.670+0000 7fc7d813c700 1 -- 172.21.15.139:0/1744637218 wait complete. 2023-10-08T13:20:30.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 -- 172.21.15.139:0/3579189014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 msgr2=0x7f7c20103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3579189014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c20103de0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009990 tx=0x7f7c1c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 -- 172.21.15.139:0/3579189014 shutdown_connections 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3579189014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 0x7f7c200ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3579189014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c20103de0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3579189014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c200ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 -- 172.21.15.139:0/3579189014 >> 172.21.15.139:0/3579189014 conn(0x7f7c20074a10 msgr2=0x7f7c20074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 -- 172.21.15.139:0/3579189014 shutdown_connections 2023-10-08T13:20:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.404+0000 7f7c2741c700 1 -- 172.21.15.139:0/3579189014 wait complete. 2023-10-08T13:20:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 Processor -- start 2023-10-08T13:20:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 -- start start 2023-10-08T13:20:30.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c2019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 0x7f7c2019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20197110 con 0x7f7c20104320 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20197280 con 0x7f7c20067990 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c2741c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20197440 con 0x7f7c200ff6d0 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c259b9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c259b9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37070/0 (socket says 172.21.15.139:37070) 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c259b9700 1 -- 172.21.15.139:0/3931273098 learned_addr learned my addr 172.21.15.139:0/3931273098 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c249b7700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 0x7f7c2019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c251b8700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c2019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c259b9700 1 -- 172.21.15.139:0/3931273098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 msgr2=0x7f7c2019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.405+0000 7f7c259b9700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 0x7f7c2019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c259b9700 1 -- 172.21.15.139:0/3931273098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 msgr2=0x7f7c2019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c259b9700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c2019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c259b9700 1 -- 172.21.15.139:0/3931273098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10009520 con 0x7f7c20104320 2023-10-08T13:20:30.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c251b8700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c2019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c259b9700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c18007ee0 tx=0x7f7c1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800ddd0 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c0095f0 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c1800f040 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c180048e0 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.406+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c201a3780 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.407+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c201005b0 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.408+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f7c18003a00 con 0x7f7c20104320 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.408+0000 7f7c167fc700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 0x7f7c0c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.409+0000 7f7c251b8700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 0x7f7c0c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.409+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7c180caab0 con 0x7f7c20104320 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.409+0000 7f7c251b8700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 0x7f7c0c0a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c006010 tx=0x7f7c1c00b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.413+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7c1804f100 con 0x7f7c20104320 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.651+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f7c20198000 con 0x7f7c20104320 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.655+0000 7f7c167fc700 1 -- 172.21.15.139:0/3931273098 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v25)=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7c18095d10 con 0x7f7c20104320 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 msgr2=0x7f7c0c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 0x7f7c0c0a3900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c006010 tx=0x7f7c1c00b260 comp rx=0 tx=0).stop 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 msgr2=0x7f7c20196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c18007ee0 tx=0x7f7c1800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 shutdown_connections 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7c0c0a1440 0x7f7c0c0a3900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c20104320 0x7f7c20196aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c20067990 0x7f7c2019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 --2- 172.21.15.139:0/3931273098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ff6d0 0x7f7c2019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 >> 172.21.15.139:0/3931273098 conn(0x7f7c20074a10 msgr2=0x7f7c20101930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 shutdown_connections 2023-10-08T13:20:30.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.660+0000 7f7c2741c700 1 -- 172.21.15.139:0/3931273098 wait complete. 2023-10-08T13:20:30.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 -- 172.21.15.139:0/1197882741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea41067a0 msgr2=0x7f1ea4106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/1197882741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea41067a0 0x7f1ea4106b80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00098f0 tx=0x7f1ea0009c00 comp rx=0 tx=0).stop 2023-10-08T13:20:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 -- 172.21.15.139:0/1197882741 shutdown_connections 2023-10-08T13:20:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/1197882741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/1197882741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea41067a0 0x7f1ea4106b80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/1197882741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea4068190 0x7f1ea40685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 -- 172.21.15.139:0/1197882741 >> 172.21.15.139:0/1197882741 conn(0x7f1ea4075790 msgr2=0x7f1ea4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 -- 172.21.15.139:0/1197882741 shutdown_connections 2023-10-08T13:20:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.558+0000 7f1eac4c9700 1 -- 172.21.15.139:0/1197882741 wait complete. 2023-10-08T13:20:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.559+0000 7f1eac4c9700 1 Processor -- start 2023-10-08T13:20:30.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.559+0000 7f1eac4c9700 1 -- start start 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.559+0000 7f1eac4c9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea4068190 0x7f1ea419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.559+0000 7f1eac4c9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4197160 con 0x7f1ea41067a0 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea41972d0 con 0x7f1ea4068b30 2023-10-08T13:20:30.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4197490 con 0x7f1ea4068190 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37112/0 (socket says 172.21.15.139:37112) 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 -- 172.21.15.139:0/4051657473 learned_addr learned my addr 172.21.15.139:0/4051657473 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaa265700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea4068190 0x7f1ea419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1ea9a64700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 -- 172.21.15.139:0/4051657473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea4068190 msgr2=0x7f1ea419c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea4068190 0x7f1ea419c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 -- 172.21.15.139:0/4051657473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 msgr2=0x7f1ea419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 -- 172.21.15.139:0/4051657473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea0009520 con 0x7f1ea41067a0 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1ea9a64700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:30.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eaaa66700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c110 tx=0x7f1e9c00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c017070 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea4197710 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e9c00e050 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c007940 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.560+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea41a39b0 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.561+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea4108d50 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.563+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f1e9c004ad0 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.563+0000 7f1e9b7fe700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 0x7f1e900a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.564+0000 7f1eaa265700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 0x7f1e900a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.564+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f1e9c0cb620 con 0x7f1ea41067a0 2023-10-08T13:20:30.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.564+0000 7f1eaa265700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 0x7f1e900a3900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00098c0 tx=0x7f1ea0019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.567+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1e9c096880 con 0x7f1ea41067a0 2023-10-08T13:20:30.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.779+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f1ea4101ee0 con 0x7f1ea41067a0 2023-10-08T13:20:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.782+0000 7f1e9b7fe700 1 -- 172.21.15.139:0/4051657473 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v28)=0 v28) v1 ==== 116+0+0 (secure 0 0 0) 0x7f1e9c099ea0 con 0x7f1ea41067a0 2023-10-08T13:20:30.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 msgr2=0x7f1e900a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 0x7f1e900a3900 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00098c0 tx=0x7f1ea0019040 comp rx=0 tx=0).stop 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 msgr2=0x7f1ea4196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00c110 tx=0x7f1e9c00c420 comp rx=0 tx=0).stop 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 shutdown_connections 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1e900a1440 0x7f1e900a3900 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ea41067a0 0x7f1ea4196b00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ea4068190 0x7f1ea419c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 --2- 172.21.15.139:0/4051657473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ea4068b30 0x7f1ea419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 >> 172.21.15.139:0/4051657473 conn(0x7f1ea4075790 msgr2=0x7f1ea40fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 shutdown_connections 2023-10-08T13:20:30.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:30.785+0000 7f1eac4c9700 1 -- 172.21.15.139:0/4051657473 wait complete. 2023-10-08T13:20:30.882 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: Reconfiguring mon.c (monmap changed)... 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: Reconfiguring daemon mon.c on smithi187 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1754672902' entity='client.admin' 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:30.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:30.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.259+0000 7f2f49337700 1 -- 172.21.15.139:0/3790258487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 msgr2=0x7f2f440ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.259+0000 7f2f49337700 1 --2- 172.21.15.139:0/3790258487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f440ffbd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009990 tx=0x7f2f38009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 -- 172.21.15.139:0/3790258487 shutdown_connections 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 --2- 172.21.15.139:0/3790258487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f44100110 0x7f2f4410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 --2- 172.21.15.139:0/3790258487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f441056b0 0x7f2f44105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 --2- 172.21.15.139:0/3790258487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f440ffbd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 -- 172.21.15.139:0/3790258487 >> 172.21.15.139:0/3790258487 conn(0x7f2f44075790 msgr2=0x7f2f44075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 -- 172.21.15.139:0/3790258487 shutdown_connections 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.260+0000 7f2f49337700 1 -- 172.21.15.139:0/3790258487 wait complete. 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 Processor -- start 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 -- start start 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f4419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 0x7f2f4419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f441056b0 0x7f2f44194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44194ea0 con 0x7f2f440ff750 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44195010 con 0x7f2f44100110 2023-10-08T13:20:30.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f49337700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f441951d0 con 0x7f2f441056b0 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f4419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f4419a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37052/0 (socket says 172.21.15.139:37052) 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f42ffd700 1 -- 172.21.15.139:0/2587353353 learned_addr learned my addr 172.21.15.139:0/2587353353 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.261+0000 7f2f427fc700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 0x7f2f4419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 -- 172.21.15.139:0/2587353353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f441056b0 msgr2=0x7f2f44194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f441056b0 0x7f2f44194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 -- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 msgr2=0x7f2f4419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f4419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 -- 172.21.15.139:0/2587353353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34009520 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f427fc700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 0x7f2f4419ac30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006010 tx=0x7f2f38003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38003d50 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f380056c0 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380095f0 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38022920 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.262+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f441a1510 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.264+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f44107c40 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.265+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f2f3800b4f0 con 0x7f2f44100110 2023-10-08T13:20:30.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.266+0000 7f2f2bfff700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.266+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f2f38011e40 con 0x7f2f44100110 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.269+0000 7f2f42ffd700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.269+0000 7f2f42ffd700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e70 tx=0x7f2f34009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.274+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f3809c620 con 0x7f2f44100110 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.534+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f2f4404e4c0 con 0x7f2f44100110 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.539+0000 7f2f2bfff700 1 -- 172.21.15.139:0/2587353353 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f380a6070 con 0x7f2f44100110 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 msgr2=0x7f2f2c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e70 tx=0x7f2f34009260 comp rx=0 tx=0).stop 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 msgr2=0x7f2f4419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:30.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 0x7f2f4419ac30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006010 tx=0x7f2f38003c30 comp rx=0 tx=0).stop 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 shutdown_connections 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f2c0a14c0 0x7f2f2c0a3980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f441056b0 0x7f2f44194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f440ff750 0x7f2f4419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 --2- 172.21.15.139:0/2587353353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f44100110 0x7f2f4419ac30 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006010 tx=0x7f2f38003c30 comp rx=0 tx=0).stop 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 >> 172.21.15.139:0/2587353353 conn(0x7f2f44075790 msgr2=0x7f2f440fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 shutdown_connections 2023-10-08T13:20:30.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:29.542+0000 7f2f49337700 1 -- 172.21.15.139:0/2587353353 wait complete. 2023-10-08T13:20:31.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: Reconfiguring mon.c (monmap changed)... 2023-10-08T13:20:31.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: Reconfiguring daemon mon.c on smithi187 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1754672902' entity='client.admin' 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:31.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: Reconfiguring mon.c (monmap changed)... 2023-10-08T13:20:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: Reconfiguring daemon mon.c on smithi187 2023-10-08T13:20:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1754672902' entity='client.admin' 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:31.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- 172.21.15.139:0/1337649499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 msgr2=0x7fe4d00ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1337649499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d00ffb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00099c0 tx=0x7fe4c0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- 172.21.15.139:0/1337649499 shutdown_connections 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1337649499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d01000a0 0x7fe4d010c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1337649499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d0105730 0x7fe4d0105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1337649499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d00ffb60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- 172.21.15.139:0/1337649499 >> 172.21.15.139:0/1337649499 conn(0x7fe4d00766f0 msgr2=0x7fe4d0076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- 172.21.15.139:0/1337649499 shutdown_connections 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- 172.21.15.139:0/1337649499 wait complete. 2023-10-08T13:20:31.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 Processor -- start 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 -- start start 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.301+0000 7fe4d737f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01000a0 0x7fe4d0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 0x7fe4d01a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0198860 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d01a3020 con 0x7fe4d01000a0 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d01a3160 con 0x7fe4d0105730 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37122/0 (socket says 172.21.15.139:37122) 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 -- 172.21.15.139:0/1168587659 learned_addr learned my addr 172.21.15.139:0/1168587659 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:31.405 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d591c700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 0x7fe4d01a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 -- 172.21.15.139:0/1168587659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 msgr2=0x7fe4d01a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 0x7fe4d01a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 -- 172.21.15.139:0/1168587659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01000a0 msgr2=0x7fe4d0197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01000a0 0x7fe4d0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 -- 172.21.15.139:0/1168587659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00095f0 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d591c700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 0x7fe4d01a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d511b700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d950 tx=0x7fe4cc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc009b40 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4cc009ca0 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.406 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d01a33e0 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00f620 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.302+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d01a3930 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.303+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d0107c70 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.304+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fe4cc010460 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.305+0000 7fe4c67fc700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 0x7fe4bc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.305+0000 7fe4d491a700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 0x7fe4bc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.305+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe4cc0cb3c0 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.305+0000 7fe4d491a700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 0x7fe4bc0a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00098e0 tx=0x7fe4c0000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:31.407 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.311+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe4cc096620 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.509+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7fe4d0100e00 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.513+0000 7fe4c67fc700 1 -- 172.21.15.139:0/1168587659 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe4cc0160b0 con 0x7fe4d00ff6e0 2023-10-08T13:20:31.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 msgr2=0x7fe4bc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:31.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 0x7fe4bc0a3980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00098e0 tx=0x7fe4c0000bc0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 msgr2=0x7fe4d0197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:31.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00d950 tx=0x7fe4cc00dd10 comp rx=0 tx=0).stop 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 shutdown_connections 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4bc0a14c0 0x7fe4bc0a3980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4d0105730 0x7fe4d01a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4d00ff6e0 0x7fe4d0197a60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 --2- 172.21.15.139:0/1168587659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01000a0 0x7fe4d0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 >> 172.21.15.139:0/1168587659 conn(0x7fe4d00766f0 msgr2=0x7fe4d00fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 shutdown_connections 2023-10-08T13:20:31.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:31.515+0000 7fe4d737f700 1 -- 172.21.15.139:0/1168587659 wait complete. 2023-10-08T13:20:31.988 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:31 smithi139 ceph-mon[99506]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:31.989 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:31 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4051657473' entity='client.admin' 2023-10-08T13:20:31.989 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:31 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1168587659' entity='client.admin' 2023-10-08T13:20:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:31 smithi155 ceph-mon[103467]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:31 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4051657473' entity='client.admin' 2023-10-08T13:20:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:31 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1168587659' entity='client.admin' 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 -- 172.21.15.139:0/2479552725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 msgr2=0x7f1874106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 --2- 172.21.15.139:0/2479552725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874106b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1870009990 tx=0x7f1870009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 -- 172.21.15.139:0/2479552725 shutdown_connections 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 --2- 172.21.15.139:0/2479552725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068b30 0x7f187410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 --2- 172.21.15.139:0/2479552725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874106b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 --2- 172.21.15.139:0/2479552725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068190 0x7f18740685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.179+0000 7f187bca9700 1 -- 172.21.15.139:0/2479552725 >> 172.21.15.139:0/2479552725 conn(0x7f1874075790 msgr2=0x7f1874075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:32.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- 172.21.15.139:0/2479552725 shutdown_connections 2023-10-08T13:20:32.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- 172.21.15.139:0/2479552725 wait complete. 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 Processor -- start 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- start start 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 0x7f187419c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 0x7f187419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18741970c0 con 0x7f18741067a0 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1874197200 con 0x7f1874068190 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.180+0000 7f187bca9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18741973c0 con 0x7f1874068b30 2023-10-08T13:20:32.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37140/0 (socket says 172.21.15.139:37140) 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 -- 172.21.15.139:0/728249903 learned_addr learned my addr 172.21.15.139:0/728249903 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f1879a45700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 0x7f187419c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f1879244700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 0x7f187419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 -- 172.21.15.139:0/728249903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 msgr2=0x7f187419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 0x7f187419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 -- 172.21.15.139:0/728249903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 msgr2=0x7f187419c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 0x7f187419c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 -- 172.21.15.139:0/728249903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700095f0 con 0x7f18741067a0 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f1879a45700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 0x7f187419c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:32.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f1879244700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 0x7f187419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187a246700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f186c007ee0 tx=0x7f186c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c017070 con 0x7f18741067a0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f186c00f040 con 0x7f18741067a0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18741976a0 con 0x7f18741067a0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c005740 con 0x7f18741067a0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.181+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18741a38f0 con 0x7f18741067a0 2023-10-08T13:20:32.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.182+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1874108d50 con 0x7f18741067a0 2023-10-08T13:20:32.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.184+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f186c0058a0 con 0x7f18741067a0 2023-10-08T13:20:32.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.184+0000 7f186affd700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 0x7f18600a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:32.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.184+0000 7f1879a45700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 0x7f18600a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:32.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.184+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f186c0caf40 con 0x7f18741067a0 2023-10-08T13:20:32.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.185+0000 7f1879a45700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 0x7f18600a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f187000b5c0 tx=0x7f1870005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:32.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.188+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f186c0961a0 con 0x7f18741067a0 2023-10-08T13:20:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:31 smithi187 ceph-mon[104336]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:31 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4051657473' entity='client.admin' 2023-10-08T13:20:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:31 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1168587659' entity='client.admin' 2023-10-08T13:20:32.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.383+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f1874197fb0 con 0x7f18741067a0 2023-10-08T13:20:32.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.387+0000 7f186affd700 1 -- 172.21.15.139:0/728249903 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v30)=0 v30) v1 ==== 127+0+0 (secure 0 0 0) 0x7f1874197fb0 con 0x7f18741067a0 2023-10-08T13:20:32.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 msgr2=0x7f18600a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:32.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 0x7f18600a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f187000b5c0 tx=0x7f1870005fb0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 msgr2=0x7f1874196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f186c007ee0 tx=0x7f186c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 shutdown_connections 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f18600a1440 0x7f18600a3900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18741067a0 0x7f1874196a60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1874068190 0x7f187419c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 --2- 172.21.15.139:0/728249903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1874068b30 0x7f187419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 >> 172.21.15.139:0/728249903 conn(0x7f1874075790 msgr2=0x7f18740fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 shutdown_connections 2023-10-08T13:20:32.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:32.389+0000 7f187bca9700 1 -- 172.21.15.139:0/728249903 wait complete. 2023-10-08T13:20:33.289 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi139') 2023-10-08T13:20:33.289 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi139') 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- 172.21.15.139:0/3260878701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55500ff190 msgr2=0x7f55500ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 --2- 172.21.15.139:0/3260878701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55500ff190 0x7f55500ff610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f553c009990 tx=0x7f553c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- 172.21.15.139:0/3260878701 shutdown_connections 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 --2- 172.21.15.139:0/3260878701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 0x7f555010bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 --2- 172.21.15.139:0/3260878701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5550103e70 0x7f5550104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 --2- 172.21.15.139:0/3260878701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f55500ff190 0x7f55500ff610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- 172.21.15.139:0/3260878701 >> 172.21.15.139:0/3260878701 conn(0x7f5550074a10 msgr2=0x7f5550074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- 172.21.15.139:0/3260878701 shutdown_connections 2023-10-08T13:20:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- 172.21.15.139:0/3260878701 wait complete. 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 Processor -- start 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.323+0000 7f5556add700 1 -- start start 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 0x7f555019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 0x7f555019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5550197080 con 0x7f5550103e70 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501971f0 con 0x7f55500ffb50 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501973b0 con 0x7f55500ff190 2023-10-08T13:20:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37154/0 (socket says 172.21.15.139:37154) 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 -- 172.21.15.139:0/2044346882 learned_addr learned my addr 172.21.15.139:0/2044346882 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5554879700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 0x7f555019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f554ffff700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 0x7f555019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 -- 172.21.15.139:0/2044346882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 msgr2=0x7f555019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 0x7f555019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 -- 172.21.15.139:0/2044346882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 msgr2=0x7f555019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 0x7f555019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 -- 172.21.15.139:0/2044346882 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0095f0 con 0x7f5550103e70 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5554879700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 0x7f555019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:20:33.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f555507a700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f554800ada0 tx=0x7f554800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800f070 con 0x7f5550103e70 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5548007b30 con 0x7f5550103e70 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5550197690 con 0x7f5550103e70 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.324+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548005440 con 0x7f5550103e70 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.325+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55501a3880 con 0x7f5550103e70 2023-10-08T13:20:33.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.325+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55501005b0 con 0x7f5550103e70 2023-10-08T13:20:33.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.326+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f5548004ad0 con 0x7f5550103e70 2023-10-08T13:20:33.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.327+0000 7f554dffb700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 0x7f55400a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.327+0000 7f5554879700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 0x7f55400a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.327+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f55480ca7a0 con 0x7f5550103e70 2023-10-08T13:20:33.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.327+0000 7f5554879700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 0x7f55400a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5544005950 tx=0x7f55440058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.331+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5548095a90 con 0x7f5550103e70 2023-10-08T13:20:33.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.540+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f5550197f60 con 0x7f5550103e70 2023-10-08T13:20:33.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.544+0000 7f554dffb700 1 -- 172.21.15.139:0/2044346882 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5550197f60 con 0x7f5550103e70 2023-10-08T13:20:33.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 msgr2=0x7f55400a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 0x7f55400a3900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5544005950 tx=0x7f55440058e0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 msgr2=0x7f5550196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f554800ada0 tx=0x7f554800c330 comp rx=0 tx=0).stop 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 shutdown_connections 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55400a1440 0x7f55400a3900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5550103e70 0x7f5550196a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55500ff190 0x7f555019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 --2- 172.21.15.139:0/2044346882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55500ffb50 0x7f555019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 >> 172.21.15.139:0/2044346882 conn(0x7f5550074a10 msgr2=0x7f5550102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 shutdown_connections 2023-10-08T13:20:33.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.546+0000 7f5556add700 1 -- 172.21.15.139:0/2044346882 wait complete. 2023-10-08T13:20:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/728249903' entity='client.admin' 2023-10-08T13:20:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:33 smithi139 ceph-mon[99506]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/728249903' entity='client.admin' 2023-10-08T13:20:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:33 smithi187 ceph-mon[104336]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:33.845 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 -- 172.21.15.139:0/3379305573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 msgr2=0x7fb02c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.845 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 --2- 172.21.15.139:0/3379305573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c0ffbd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009990 tx=0x7fb01c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.845 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 -- 172.21.15.139:0/3379305573 shutdown_connections 2023-10-08T13:20:33.845 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 --2- 172.21.15.139:0/3379305573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c100110 0x7fb02c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 --2- 172.21.15.139:0/3379305573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c1056b0 0x7fb02c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 --2- 172.21.15.139:0/3379305573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c0ffbd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 -- 172.21.15.139:0/3379305573 >> 172.21.15.139:0/3379305573 conn(0x7fb02c075790 msgr2=0x7fb02c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 -- 172.21.15.139:0/3379305573 shutdown_connections 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.520+0000 7fb033fb7700 1 -- 172.21.15.139:0/3379305573 wait complete. 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 Processor -- start 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 -- start start 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 0x7fb02c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c1056b0 0x7fb02c1a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c198810 con 0x7fb02c0ff750 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1a3040 con 0x7fb02c1056b0 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb033fb7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1a3180 con 0x7fb02c100110 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb031d53700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb031d53700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37164/0 (socket says 172.21.15.139:37164) 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.521+0000 7fb031d53700 1 -- 172.21.15.139:0/1370777337 learned_addr learned my addr 172.21.15.139:0/1370777337 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031552700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 0x7fb02c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 -- 172.21.15.139:0/1370777337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 msgr2=0x7fb02c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 0x7fb02c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 -- 172.21.15.139:0/1370777337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c1056b0 msgr2=0x7fb02c1a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c1056b0 0x7fb02c1a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.847 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 -- 172.21.15.139:0/1370777337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0095f0 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031552700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 0x7fb02c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb031d53700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb02800d980 tx=0x7fb02800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb028009b40 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb02800b6e0 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c1a33e0 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02800f620 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.522+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1a3930 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.523+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c107c40 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.525+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fb028010460 con 0x7fb02c0ff750 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.525+0000 7fb022ffd700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 0x7fb0180a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:33.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.525+0000 7fb031552700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 0x7fb0180a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.525+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb0280caf80 con 0x7fb02c0ff750 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.526+0000 7fb031552700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 0x7fb0180a3980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00b5c0 tx=0x7fb01c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.529+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb0280961e0 con 0x7fb02c0ff750 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.732+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7fb02c100df0 con 0x7fb02c0ff750 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.736+0000 7fb022ffd700 1 -- 172.21.15.139:0/1370777337 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v32)=0 v32) v1 ==== 121+0+0 (secure 0 0 0) 0x7fb0280200c0 con 0x7fb02c0ff750 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.738+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 msgr2=0x7fb0180a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.738+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 0x7fb0180a3980 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00b5c0 tx=0x7fb01c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.738+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 msgr2=0x7fb02c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.738+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb02800d980 tx=0x7fb02800dd40 comp rx=0 tx=0).stop 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 shutdown_connections 2023-10-08T13:20:33.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb0180a14c0 0x7fb0180a3980 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb02c1056b0 0x7fb02c1a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb02c0ff750 0x7fb02c197a80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 --2- 172.21.15.139:0/1370777337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb02c100110 0x7fb02c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 >> 172.21.15.139:0/1370777337 conn(0x7fb02c075790 msgr2=0x7fb02c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 shutdown_connections 2023-10-08T13:20:33.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:33.739+0000 7fb033fb7700 1 -- 172.21.15.139:0/1370777337 wait complete. 2023-10-08T13:20:33.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/728249903' entity='client.admin' 2023-10-08T13:20:33.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:33 smithi155 ceph-mon[103467]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:34.056 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.056 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.057 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.057 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.057 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.057 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.057 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi139') 2023-10-08T13:20:34.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.433+0000 7f456cc10700 1 -- 172.21.15.139:0/1881027931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4568104720 msgr2=0x7f4568104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.433+0000 7f456cc10700 1 --2- 172.21.15.139:0/1881027931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4568104720 0x7f4568104b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f456000b0a0 tx=0x7f456000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 -- 172.21.15.139:0/1881027931 shutdown_connections 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 --2- 172.21.15.139:0/1881027931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f456810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 --2- 172.21.15.139:0/1881027931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4568104720 0x7f4568104b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 --2- 172.21.15.139:0/1881027931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45681002a0 0x7f4568100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 -- 172.21.15.139:0/1881027931 >> 172.21.15.139:0/1881027931 conn(0x7f4568074a10 msgr2=0x7f4568074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 -- 172.21.15.139:0/1881027931 shutdown_connections 2023-10-08T13:20:34.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 -- 172.21.15.139:0/1881027931 wait complete. 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 Processor -- start 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.434+0000 7f456cc10700 1 -- start start 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f4568195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 0x7f4568196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a50e0 con 0x7f45681002a0 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a5220 con 0x7f4568104720 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a53e0 con 0x7f4568100c60 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37178/0 (socket says 172.21.15.139:37178) 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 -- 172.21.15.139:0/2802591807 learned_addr learned my addr 172.21.15.139:0/2802591807 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:34.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f4566d9d700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 0x7f4568196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f4565d9b700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f4568195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 -- 172.21.15.139:0/2802591807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 msgr2=0x7f4568195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f4568195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 -- 172.21.15.139:0/2802591807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 msgr2=0x7f4568196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 0x7f4568196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 -- 172.21.15.139:0/2802591807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009d00 con 0x7f45681002a0 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f4565d9b700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f4568195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f4566d9d700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 0x7f4568196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456659c700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f456000b070 tx=0x7f4560007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456000e040 con 0x7f45681002a0 2023-10-08T13:20:34.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4560004e60 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45681a5660 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560005520 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.435+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45681a5ad0 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.436+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4568107c80 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.437+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f456001bba0 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.438+0000 7f45577fe700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 0x7f45500a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.438+0000 7f4565d9b700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 0x7f45500a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.438+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f45600cc690 con 0x7f45681002a0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.438+0000 7f4565d9b700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 0x7f45500a3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45680ff9e0 tx=0x7f455c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:34.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.442+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4560097980 con 0x7f45681002a0 2023-10-08T13:20:34.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.639+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f4568067d10 con 0x7f45681002a0 2023-10-08T13:20:34.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.643+0000 7f45577fe700 1 -- 172.21.15.139:0/2802591807 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v33)=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7f456009afa0 con 0x7f45681002a0 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 msgr2=0x7f45500a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 0x7f45500a3900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45680ff9e0 tx=0x7f455c008040 comp rx=0 tx=0).stop 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 msgr2=0x7f45681959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f456000b070 tx=0x7f4560007920 comp rx=0 tx=0).stop 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 shutdown_connections 2023-10-08T13:20:34.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f45500a1440 0x7f45500a3900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4568104720 0x7f4568196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45681002a0 0x7f45681959d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 --2- 172.21.15.139:0/2802591807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568100c60 0x7f4568195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 >> 172.21.15.139:0/2802591807 conn(0x7f4568074a10 msgr2=0x7f45680fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 shutdown_connections 2023-10-08T13:20:34.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:34.646+0000 7f456cc10700 1 -- 172.21.15.139:0/2802591807 wait complete. 2023-10-08T13:20:34.821 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2044346882' entity='client.admin' 2023-10-08T13:20:34.822 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1370777337' entity='client.admin' 2023-10-08T13:20:34.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2044346882' entity='client.admin' 2023-10-08T13:20:34.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1370777337' entity='client.admin' 2023-10-08T13:20:34.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2044346882' entity='client.admin' 2023-10-08T13:20:34.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1370777337' entity='client.admin' 2023-10-08T13:20:35.091 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0585722a-65dd-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi139') 2023-10-08T13:20:35.092 INFO:tasks.cephadm:Deploying OSDs... 2023-10-08T13:20:35.093 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:20:35.093 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T13:20:35.111 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T13:20:35.111 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2023-10-08T13:20:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 393317 Links: 1 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-10-08 13:19:16.453994305 +0000 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-10-08 13:13:56.743281727 +0000 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-10-08 13:13:56.743281727 +0000 2023-10-08T13:20:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-10-08T13:20:35.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T13:20:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-10-08T13:20:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-10-08T13:20:35.240 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000301643 s, 1.7 MB/s 2023-10-08T13:20:35.241 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T13:20:35.300 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 385609 Links: 1 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-10-08 13:19:16.509992875 +0000 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-10-08 13:13:57.255268584 +0000 2023-10-08T13:20:35.358 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-10-08 13:13:57.255268584 +0000 2023-10-08T13:20:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-10-08T13:20:35.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T13:20:35.423 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-10-08T13:20:35.423 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-10-08T13:20:35.423 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000242315 s, 2.1 MB/s 2023-10-08T13:20:35.424 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T13:20:35.484 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2023-10-08T13:20:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T13:20:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 394547 Links: 1 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-10-08 13:19:16.563991497 +0000 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-10-08 13:13:57.765255492 +0000 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-10-08 13:13:57.765255492 +0000 2023-10-08T13:20:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-10-08T13:20:35.545 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T13:20:35.610 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-10-08T13:20:35.611 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-10-08T13:20:35.611 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.00021831 s, 2.3 MB/s 2023-10-08T13:20:35.612 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T13:20:35.672 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2023-10-08T13:20:35.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:35 smithi139 ceph-mon[99506]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:35.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2802591807' entity='client.admin' 2023-10-08T13:20:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T13:20:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:35.706 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 6h/6d Inode: 394703 Links: 1 2023-10-08T13:20:35.706 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:35.706 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:35.707 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-10-08 13:19:16.619990067 +0000 2023-10-08T13:20:35.707 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-10-08 13:13:58.274242426 +0000 2023-10-08T13:20:35.707 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-10-08 13:13:58.274242426 +0000 2023-10-08T13:20:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2023-10-08T13:20:35.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T13:20:35.772 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2023-10-08T13:20:35.772 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2023-10-08T13:20:35.772 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000209915 s, 2.4 MB/s 2023-10-08T13:20:35.773 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T13:20:35.834 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-10-08T13:20:35.834 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T13:20:35.856 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T13:20:35.857 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-10-08T13:20:35.920 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T13:20:35.920 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:35.920 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 384888 Links: 1 2023-10-08T13:20:35.920 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:35.920 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:35.921 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-08 13:20:17.025526527 +0000 2023-10-08T13:20:35.921 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-08 13:14:06.413724796 +0000 2023-10-08T13:20:35.921 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-08 13:14:06.413724796 +0000 2023-10-08T13:20:35.921 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-08T13:20:35.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T13:20:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:35 smithi187 ceph-mon[104336]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2802591807' entity='client.admin' 2023-10-08T13:20:35.991 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:35 smithi155 ceph-mon[103467]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:35.992 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2802591807' entity='client.admin' 2023-10-08T13:20:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-08T13:20:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-08T13:20:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000229238 s, 2.2 MB/s 2023-10-08T13:20:35.996 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T13:20:36.057 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 393710 Links: 1 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:36.117 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-08 13:20:17.025526527 +0000 2023-10-08T13:20:36.118 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-08 13:14:06.948713878 +0000 2023-10-08T13:20:36.118 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-08 13:14:06.948713878 +0000 2023-10-08T13:20:36.118 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-08T13:20:36.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T13:20:36.185 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-08T13:20:36.186 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-08T13:20:36.186 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000234481 s, 2.2 MB/s 2023-10-08T13:20:36.187 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T13:20:36.246 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 387854 Links: 1 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-08 13:20:17.025526527 +0000 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-08 13:14:07.474703144 +0000 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-08 13:14:07.474703144 +0000 2023-10-08T13:20:36.305 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-08T13:20:36.306 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T13:20:36.374 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-08T13:20:36.374 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-08T13:20:36.375 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000208851 s, 2.5 MB/s 2023-10-08T13:20:36.375 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T13:20:36.432 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 393896 Links: 1 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-10-08 13:20:17.025526527 +0000 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-10-08 13:14:07.972692981 +0000 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-10-08 13:14:07.972692981 +0000 2023-10-08T13:20:36.490 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: - 2023-10-08T13:20:36.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T13:20:36.556 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-10-08T13:20:36.556 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-10-08T13:20:36.556 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000202203 s, 2.5 MB/s 2023-10-08T13:20:36.557 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T13:20:36.615 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-10-08T13:20:36.615 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T13:20:36.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T13:20:36.636 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-10-08T13:20:36.696 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T13:20:36.696 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 378655 Links: 1 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-08 13:20:14.838815839 +0000 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-08 13:13:58.217304061 +0000 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-08 13:13:58.217304061 +0000 2023-10-08T13:20:36.697 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-08T13:20:36.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T13:20:36.768 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-08T13:20:36.768 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-08T13:20:36.768 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000277765 s, 1.8 MB/s 2023-10-08T13:20:36.770 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T13:20:36.829 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 378802 Links: 1 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:36.888 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-08 13:20:14.839815822 +0000 2023-10-08T13:20:36.889 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-08 13:13:58.734295500 +0000 2023-10-08T13:20:36.889 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-08 13:13:58.734295500 +0000 2023-10-08T13:20:36.889 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-08T13:20:36.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T13:20:36.954 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-08T13:20:36.955 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-08T13:20:36.955 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000229777 s, 2.2 MB/s 2023-10-08T13:20:36.956 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T13:20:37.014 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-10-08T13:20:37.547 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T13:20:37.588 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 390781 Links: 1 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-08 13:20:14.839815822 +0000 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-08 13:13:59.225287369 +0000 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-08 13:13:59.225287369 +0000 2023-10-08T13:20:37.589 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-08T13:20:37.589 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T13:20:37.619 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-08T13:20:37.619 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-08T13:20:37.619 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000221341 s, 2.3 MB/s 2023-10-08T13:20:37.620 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T13:20:37.680 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-10-08T13:20:37.740 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T13:20:37.740 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T13:20:37.740 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 396438 Links: 1 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-10-08 13:20:14.839815822 +0000 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-10-08 13:13:59.726279072 +0000 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-10-08 13:13:59.726279072 +0000 2023-10-08T13:20:37.741 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2023-10-08T13:20:37.741 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T13:20:37.808 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-10-08T13:20:37.809 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-10-08T13:20:37.809 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000230517 s, 2.2 MB/s 2023-10-08T13:20:37.810 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T13:20:37.868 INFO:tasks.cephadm:Deploying osd.0 on smithi139 with /dev/vg_nvme/lv_4... 2023-10-08T13:20:37.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T13:20:37.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:37 smithi139 ceph-mon[99506]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:37 smithi187 ceph-mon[104336]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:37 smithi155 ceph-mon[103467]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:38.436 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:39 smithi139 ceph-mon[99506]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:39 smithi187 ceph-mon[104336]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T13:20:40.038 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T13:20:40.039 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2023-10-08T13:20:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2023-10-08T13:20:40.039 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111879 s, 937 MB/s 2023-10-08T13:20:40.039 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2023-10-08T13:20:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:39 smithi155 ceph-mon[103467]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:40.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2023-10-08T13:20:41.082 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:20:41.553 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:41 smithi139 ceph-mon[99506]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:41.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:41 smithi155 ceph-mon[103467]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:41.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:41 smithi187 ceph-mon[104336]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:42.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 -- 172.21.15.139:0/648534667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 msgr2=0x7ff5a0100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 --2- 172.21.15.139:0/648534667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0100720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff590009990 tx=0x7ff590009ca0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 -- 172.21.15.139:0/648534667 shutdown_connections 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 --2- 172.21.15.139:0/648534667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0100c60 0x7ff5a010c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 --2- 172.21.15.139:0/648534667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0104720 0x7ff5a0104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 --2- 172.21.15.139:0/648534667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0100720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 -- 172.21.15.139:0/648534667 >> 172.21.15.139:0/648534667 conn(0x7ff5a0074a10 msgr2=0x7ff5a0074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 -- 172.21.15.139:0/648534667 shutdown_connections 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.282+0000 7ff5a4968700 1 -- 172.21.15.139:0/648534667 wait complete. 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 Processor -- start 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 -- start start 2023-10-08T13:20:42.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 0x7ff5a0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0104720 0x7ff5a01a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a0198860 con 0x7ff5a01002a0 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01a3020 con 0x7ff5a0104720 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff5a4968700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01a3160 con 0x7ff5a0100c60 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff59e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff59e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37190/0 (socket says 172.21.15.139:37190) 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.283+0000 7ff59e59c700 1 -- 172.21.15.139:0/456846416 learned_addr learned my addr 172.21.15.139:0/456846416 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59dd9b700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 0x7ff5a0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 -- 172.21.15.139:0/456846416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 msgr2=0x7ff5a0197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:42.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 0x7ff5a0197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 -- 172.21.15.139:0/456846416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0104720 msgr2=0x7ff5a01a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59ed9d700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0104720 0x7ff5a01a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0104720 0x7ff5a01a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 -- 172.21.15.139:0/456846416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900095f0 con 0x7ff5a01002a0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59dd9b700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 0x7ff5a0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff59e59c700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d980 tx=0x7ff59400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594009b40 con 0x7ff5a01002a0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a01a33e0 con 0x7ff5a01002a0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff59400de60 con 0x7ff5a01002a0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594005580 con 0x7ff5a01002a0 2023-10-08T13:20:42.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.284+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01a3890 con 0x7ff5a01002a0 2023-10-08T13:20:42.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.285+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a0107c80 con 0x7ff5a01002a0 2023-10-08T13:20:42.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.286+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7ff594004750 con 0x7ff5a01002a0 2023-10-08T13:20:42.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.287+0000 7ff58f7fe700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 0x7ff5880a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:20:42.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.287+0000 7ff59dd9b700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 0x7ff5880a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:20:42.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.287+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff5940cb130 con 0x7ff5a01002a0 2023-10-08T13:20:42.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.287+0000 7ff59dd9b700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 0x7ff5880a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff590006010 tx=0x7ff59001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:20:42.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.291+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff594096390 con 0x7ff5a01002a0 2023-10-08T13:20:42.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:42.489+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a00ff750 con 0x7ff5880a1440 2023-10-08T13:20:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:20:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:20:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:42.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:20:42.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:20:42.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:20:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:20:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:43.844 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:43 smithi139 ceph-mon[99506]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:43.844 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:43 smithi139 ceph-mon[99506]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:43 smithi155 ceph-mon[103467]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:43 smithi155 ceph-mon[103467]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:43 smithi187 ceph-mon[104336]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:20:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:43 smithi187 ceph-mon[104336]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]: dispatch 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]': finished 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:20:45.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:45 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/673835217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:20:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]: dispatch 2023-10-08T13:20:45.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]': finished 2023-10-08T13:20:45.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T13:20:45.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:20:45.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:45 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/673835217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:20:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]: dispatch 2023-10-08T13:20:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2812891617' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7d1e38b5-74c5-449b-96f0-3619599c9602"}]': finished 2023-10-08T13:20:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T13:20:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:20:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:45 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/673835217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:20:47.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:47 smithi155 ceph-mon[103467]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:47 smithi139 ceph-mon[99506]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:47 smithi187 ceph-mon[104336]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:49.931 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:49 smithi139 ceph-mon[99506]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:49 smithi187 ceph-mon[104336]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:49 smithi155 ceph-mon[103467]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:51.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:51 smithi155 ceph-mon[103467]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:51 smithi139 ceph-mon[99506]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:51 smithi187 ceph-mon[104336]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:52.552 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T13:20:52.552 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:52.552 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:52 smithi139 ceph-mon[99506]: Deploying daemon osd.0 on smithi139 2023-10-08T13:20:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T13:20:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:52 smithi155 ceph-mon[103467]: Deploying daemon osd.0 on smithi139 2023-10-08T13:20:52.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T13:20:52.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:52.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:52 smithi187 ceph-mon[104336]: Deploying daemon osd.0 on smithi139 2023-10-08T13:20:53.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:53 smithi139 ceph-mon[99506]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:53.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:53 smithi155 ceph-mon[103467]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:53.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:53 smithi187 ceph-mon[104336]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:55.793 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:55 smithi139 ceph-mon[99506]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:55.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:55 smithi155 ceph-mon[103467]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:55 smithi187 ceph-mon[104336]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:56.975 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:56 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:56.976 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:56 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:56.976 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:56 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:57.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:56 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:57.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:56 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:57.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:56 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:57.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:56 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:57.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:56 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:57.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:56 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:57 smithi139 ceph-mon[99506]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:57 smithi187 ceph-mon[104336]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:58.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:57 smithi155 ceph-mon[103467]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:58.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.538+0000 7ff58f7fe700 1 -- 172.21.15.139:0/456846416 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff5a00ff750 con 0x7ff5880a1440 2023-10-08T13:20:58.540 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 0 on host 'smithi139' 2023-10-08T13:20:58.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 msgr2=0x7ff5880a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:58.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 0x7ff5880a3900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff590006010 tx=0x7ff59001a040 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 msgr2=0x7ff5a0197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d980 tx=0x7ff59400dd40 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 shutdown_connections 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5880a1440 0x7ff5880a3900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5a0104720 0x7ff5a01a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5a01002a0 0x7ff5a0197a60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 --2- 172.21.15.139:0/456846416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a0100c60 0x7ff5a0197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 >> 172.21.15.139:0/456846416 conn(0x7ff5a0074a10 msgr2=0x7ff5a00fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 shutdown_connections 2023-10-08T13:20:58.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:20:58.541+0000 7ff5a4968700 1 -- 172.21.15.139:0/456846416 wait complete. 2023-10-08T13:20:58.979 DEBUG:teuthology.orchestra.run.smithi139:osd.0> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-08T13:20:58.982 INFO:tasks.cephadm:Deploying osd.1 on smithi155 with /dev/vg_nvme/lv_4... 2023-10-08T13:20:58.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T13:20:59.018 INFO:journalctl@ceph.osd.0.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:20:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:59.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:20:58 smithi187 ceph-mon[104336]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:59.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:20:58 smithi155 ceph-mon[103467]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:20:59.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:20:59.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:20:58 smithi139 ceph-mon[99506]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:20:59.549 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:20:59.907 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:20:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:20:59.723+0000 7f8c01f5f640 -1 osd.0 0 log_to_monitors true 2023-10-08T13:21:00.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:00 smithi155 ceph-mon[103467]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T13:21:00.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:00 smithi139 ceph-mon[99506]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T13:21:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:00 smithi187 ceph-mon[104336]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T13:21:01.078 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T13:21:01.079 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T13:21:01.079 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-10-08T13:21:01.079 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-10-08T13:21:01.079 INFO:teuthology.orchestra.run.smithi155.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109956 s, 954 MB/s 2023-10-08T13:21:01.079 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-10-08T13:21:01.498 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2023-10-08T13:21:01.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:21:01.520+0000 7f8bf75d6700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T13:21:01.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:21:01.523+0000 7f8bf0bc6700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:21:01.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-mon[99506]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T13:21:01.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-mon[99506]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T13:21:01.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-mon[99506]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:21:01.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:01.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:01 smithi139 ceph-mon[99506]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:21:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:01 smithi155 ceph-mon[103467]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T13:21:01.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:01 smithi155 ceph-mon[103467]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T13:21:01.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:01 smithi155 ceph-mon[103467]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:21:01.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:01.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:01 smithi155 ceph-mon[103467]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:21:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:01 smithi187 ceph-mon[104336]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T13:21:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:01 smithi187 ceph-mon[104336]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T13:21:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:01 smithi187 ceph-mon[104336]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:21:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:01 smithi187 ceph-mon[104336]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T13:21:02.056 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi139 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi139 to 17168M 2023-10-08T13:21:02.774 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.775 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:02.775 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:02.775 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:21:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T13:21:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi139 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi139 to 17168M 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:21:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T13:21:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi139 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi139 to 17168M 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:03.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.258+0000 7fda88bb2700 1 -- 172.21.15.155:0/461499067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 msgr2=0x7fda840ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:03.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.258+0000 7fda88bb2700 1 --2- 172.21.15.155:0/461499067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda840ffbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda74009990 tx=0x7fda74009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 -- 172.21.15.155:0/461499067 shutdown_connections 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 --2- 172.21.15.155:0/461499067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda84100110 0x7fda8410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 --2- 172.21.15.155:0/461499067 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda841056b0 0x7fda84105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 --2- 172.21.15.155:0/461499067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda840ffbd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 -- 172.21.15.155:0/461499067 >> 172.21.15.155:0/461499067 conn(0x7fda84075790 msgr2=0x7fda84075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 -- 172.21.15.155:0/461499067 shutdown_connections 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 -- 172.21.15.155:0/461499067 wait complete. 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 Processor -- start 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.259+0000 7fda88bb2700 1 -- start start 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 0x7fda84197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:03.263 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda841056b0 0x7fda841a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda84198890 con 0x7fda84100110 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841a3050 con 0x7fda840ff750 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841a3190 con 0x7fda841056b0 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44872/0 (socket says 172.21.15.155:44872) 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 -- 172.21.15.155:0/1411302642 learned_addr learned my addr 172.21.15.155:0/1411302642 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda82d9d700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda841056b0 0x7fda841a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda81d9b700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 0x7fda84197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 -- 172.21.15.155:0/1411302642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda841056b0 msgr2=0x7fda841a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda841056b0 0x7fda841a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 -- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 msgr2=0x7fda84197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:03.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 0x7fda84197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 -- 172.21.15.155:0/1411302642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740095f0 con 0x7fda840ff750 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda81d9b700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 0x7fda84197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda8259c700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00d950 tx=0x7fda6c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c009940 con 0x7fda840ff750 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda6c010460 con 0x7fda840ff750 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda841a3410 con 0x7fda840ff750 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00f620 con 0x7fda840ff750 2023-10-08T13:21:03.265 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.260+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda841a3910 con 0x7fda840ff750 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.261+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda84107cd0 con 0x7fda840ff750 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.262+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fda6c0108d0 con 0x7fda840ff750 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.263+0000 7fda7b7fe700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 0x7fda700a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.263+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fda6c0cb180 con 0x7fda840ff750 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.263+0000 7fda81d9b700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 0x7fda700a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:03.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.263+0000 7fda81d9b700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 0x7fda700a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda7400b5c0 tx=0x7fda74005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:03.268 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.267+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda6c096180 con 0x7fda840ff750 2023-10-08T13:21:03.466 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:03.465+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fda84068750 con 0x7fda700a1440 2023-10-08T13:21:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:21:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:21:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] boot 2023-10-08T13:21:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T13:21:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:03 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:21:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:21:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] boot 2023-10-08T13:21:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T13:21:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:03 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:21:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:21:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: osd.0 [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] boot 2023-10-08T13:21:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T13:21:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T13:21:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:03 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:04.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:04 smithi155 ceph-mon[103467]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:04.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:04 smithi155 ceph-mon[103467]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T13:21:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:04 smithi139 ceph-mon[99506]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:04 smithi139 ceph-mon[99506]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T13:21:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:04 smithi187 ceph-mon[104336]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:04 smithi187 ceph-mon[104336]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T13:21:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:05 smithi155 ceph-mon[103467]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:05 smithi139 ceph-mon[99506]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:05 smithi187 ceph-mon[104336]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:06.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/1532873774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]': finished 2023-10-08T13:21:06.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T13:21:06.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:06.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/1141177540' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/1532873774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]': finished 2023-10-08T13:21:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T13:21:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:06.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/1141177540' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/1532873774' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]: dispatch 2023-10-08T13:21:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8d6fd01-729c-4b3b-9073-1df5819593c0"}]': finished 2023-10-08T13:21:06.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T13:21:06.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:06.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/1141177540' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:07 smithi155 ceph-mon[103467]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:07 smithi139 ceph-mon[99506]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:07 smithi187 ceph-mon[104336]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:09 smithi155 ceph-mon[103467]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:09 smithi139 ceph-mon[99506]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:09 smithi187 ceph-mon[104336]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:11.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:11 smithi155 ceph-mon[103467]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:11 smithi139 ceph-mon[99506]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:11 smithi187 ceph-mon[104336]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T13:21:12.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:12 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:12.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T13:21:12.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:12 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:12.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T13:21:12.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:12 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:13.502 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:13 smithi155 ceph-mon[103467]: Deploying daemon osd.1 on smithi155 2023-10-08T13:21:13.503 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:13 smithi155 ceph-mon[103467]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:13 smithi139 ceph-mon[99506]: Deploying daemon osd.1 on smithi155 2023-10-08T13:21:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:13 smithi139 ceph-mon[99506]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:13 smithi187 ceph-mon[104336]: Deploying daemon osd.1 on smithi155 2023-10-08T13:21:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:13 smithi187 ceph-mon[104336]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:15.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:15 smithi155 ceph-mon[103467]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:15 smithi139 ceph-mon[99506]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:15 smithi187 ceph-mon[104336]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:17.700 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.700 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.700 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:17 smithi155 ceph-mon[103467]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:17.700 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:17 smithi139 ceph-mon[99506]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:17 smithi187 ceph-mon[104336]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:19.229 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.228+0000 7fda7b7fe700 1 -- 172.21.15.155:0/1411302642 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fda84068750 con 0x7fda700a1440 2023-10-08T13:21:19.230 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 1 on host 'smithi155' 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 msgr2=0x7fda700a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 0x7fda700a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda7400b5c0 tx=0x7fda74005fb0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 msgr2=0x7fda84197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00d950 tx=0x7fda6c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 shutdown_connections 2023-10-08T13:21:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda700a1440 0x7fda700a3900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda841056b0 0x7fda841a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda840ff750 0x7fda84197a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 --2- 172.21.15.155:0/1411302642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda84100110 0x7fda84197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.230+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 >> 172.21.15.155:0/1411302642 conn(0x7fda84075790 msgr2=0x7fda840fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.231+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 shutdown_connections 2023-10-08T13:21:19.232 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:21:19.231+0000 7fda88bb2700 1 -- 172.21.15.155:0/1411302642 wait complete. 2023-10-08T13:21:19.643 DEBUG:teuthology.orchestra.run.smithi155:osd.1> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-08T13:21:19.645 INFO:tasks.cephadm:Deploying osd.2 on smithi187 with /dev/vg_nvme/lv_4... 2023-10-08T13:21:19.645 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T13:21:19.673 INFO:journalctl@ceph.osd.1.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:21:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:19 smithi187 ceph-mon[104336]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:19 smithi155 ceph-mon[103467]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:19 smithi139 ceph-mon[99506]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:20.209 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:21:20.849 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:21:20.504+0000 7f4677ce1640 -1 osd.1 0 log_to_monitors true 2023-10-08T13:21:21.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:21 smithi187 ceph-mon[104336]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:21 smithi187 ceph-mon[104336]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:21 smithi187 ceph-mon[104336]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:21 smithi155 ceph-mon[103467]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:21 smithi155 ceph-mon[103467]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:21 smithi155 ceph-mon[103467]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:21.678 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T13:21:21.678 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T13:21:21.678 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-10-08T13:21:21.679 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-10-08T13:21:21.679 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109845 s, 955 MB/s 2023-10-08T13:21:21.679 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-10-08T13:21:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:21 smithi139 ceph-mon[99506]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:21 smithi139 ceph-mon[99506]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T13:21:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:21 smithi139 ceph-mon[99506]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:22.151 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi187:vg_nvme/lv_4 2023-10-08T13:21:22.324 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T13:21:22.324 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.324 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T13:21:22.324 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:22.324 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:22.325 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:22.596 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:21:22.319+0000 7f466d358700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T13:21:22.596 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:21:22.322+0000 7f4666147700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:21:22.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:22.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:22.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T13:21:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T13:21:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:22.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:22.712 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:21:22.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:23.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi155 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi155 to 17168M 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:23.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi155 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi155 to 17168M 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.674 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:23.675 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:23.675 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:23.675 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:23.675 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:23.675 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi155 2023-10-08T13:21:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi155 to 17168M 2023-10-08T13:21:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:21:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T13:21:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T13:21:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 -- 172.21.15.187:0/1475220370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9080ff750 msgr2=0x7fd9080ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/1475220370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9080ff750 0x7fd9080ffbd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009990 tx=0x7fd8f0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 -- 172.21.15.187:0/1475220370 shutdown_connections 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/1475220370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd908100110 0x7fd90810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/1475220370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9081056b0 0x7fd908105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/1475220370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9080ff750 0x7fd9080ffbd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 -- 172.21.15.187:0/1475220370 >> 172.21.15.187:0/1475220370 conn(0x7fd908075790 msgr2=0x7fd908075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 -- 172.21.15.187:0/1475220370 shutdown_connections 2023-10-08T13:21:23.847 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.845+0000 7fd90e9b4700 1 -- 172.21.15.187:0/1475220370 wait complete. 2023-10-08T13:21:23.849 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.846+0000 7fd90e9b4700 1 Processor -- start 2023-10-08T13:21:23.849 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.846+0000 7fd90e9b4700 1 -- start start 2023-10-08T13:21:23.849 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9080ff750 0x7fd90819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 0x7fd90819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd908195fa0 con 0x7fd908100110 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd908196110 con 0x7fd9080ff750 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9081962d0 con 0x7fd9081056b0 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:40382/0 (socket says 172.21.15.187:40382) 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 -- 172.21.15.187:0/963992949 learned_addr learned my addr 172.21.15.187:0/963992949 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd9077fe700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 0x7fd90819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd907fff700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9080ff750 0x7fd90819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.850 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 -- 172.21.15.187:0/963992949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9080ff750 msgr2=0x7fd90819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9080ff750 0x7fd90819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 -- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 msgr2=0x7fd90819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 0x7fd90819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 -- 172.21.15.187:0/963992949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00095f0 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd9077fe700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 0x7fd90819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90cf51700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd90000ada0 tx=0x7fd90000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000f070 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9081965b0 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd900007b30 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900005440 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.847+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9081a27f0 con 0x7fd9081056b0 2023-10-08T13:21:23.851 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.848+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd908100df0 con 0x7fd9081056b0 2023-10-08T13:21:23.852 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.849+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7fd900004ad0 con 0x7fd9081056b0 2023-10-08T13:21:23.852 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.850+0000 7fd9057fa700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 0x7fd8f40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:23.852 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.850+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2524+0+0 (secure 0 0 0) 0x7fd9000cac20 con 0x7fd9081056b0 2023-10-08T13:21:23.853 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.850+0000 7fd907fff700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 0x7fd8f40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:23.853 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.851+0000 7fd907fff700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 0x7fd8f40a3900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005fd0 tx=0x7fd8f8005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:23.855 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:23.854+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd900095a90 con 0x7fd9081056b0 2023-10-08T13:21:24.052 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:24.051+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd90810f6a0 con 0x7fd8f40a1440 2023-10-08T13:21:24.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:21:24.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:21:24.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] boot 2023-10-08T13:21:24.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T13:21:24.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:24.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:24.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:24.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:21:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:21:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] boot 2023-10-08T13:21:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T13:21:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:24.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:24.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:24.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:24.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:21:24.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:21:24.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: osd.1 [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] boot 2023-10-08T13:21:24.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T13:21:24.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T13:21:24.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:24.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:24.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:25 smithi187 ceph-mon[104336]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:25 smithi187 ceph-mon[104336]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T13:21:25.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:25 smithi187 ceph-mon[104336]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:25.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:25 smithi155 ceph-mon[103467]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:25.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:25 smithi155 ceph-mon[103467]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T13:21:25.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:25 smithi155 ceph-mon[103467]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:25.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:25 smithi139 ceph-mon[99506]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:25.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:25 smithi139 ceph-mon[99506]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T13:21:25.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:25 smithi139 ceph-mon[99506]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:26 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/2662677274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:26 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:26 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]': finished 2023-10-08T13:21:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:26 smithi155 ceph-mon[103467]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T13:21:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:26 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:26 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/2662677274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:26 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:26 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]': finished 2023-10-08T13:21:26.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:26 smithi139 ceph-mon[99506]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T13:21:26.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:26 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:26.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:26 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/2662677274' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:26 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]: dispatch 2023-10-08T13:21:26.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:26 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59c35f9f-67d3-45b6-9bf0-c13e6c593ddd"}]': finished 2023-10-08T13:21:26.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:26 smithi187 ceph-mon[104336]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T13:21:26.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:26 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:27.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:27 smithi155 ceph-mon[103467]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:27.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:27 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/54262067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:27.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:27 smithi139 ceph-mon[99506]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:27.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:27 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/54262067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:27 smithi187 ceph-mon[104336]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:27 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/54262067' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:29 smithi139 ceph-mon[99506]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:29.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:29 smithi187 ceph-mon[104336]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:29 smithi155 ceph-mon[103467]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:31.591 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:31 smithi187 ceph-mon[104336]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:31.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:31 smithi155 ceph-mon[103467]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:31 smithi139 ceph-mon[99506]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:33 smithi187 ceph-mon[104336]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:21:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:33 smithi187 ceph-mon[104336]: Deploying daemon osd.2 on smithi187 2023-10-08T13:21:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:33 smithi139 ceph-mon[99506]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:21:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:33.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:33 smithi139 ceph-mon[99506]: Deploying daemon osd.2 on smithi187 2023-10-08T13:21:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:33 smithi155 ceph-mon[103467]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:34.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T13:21:34.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:34.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:33 smithi155 ceph-mon[103467]: Deploying daemon osd.2 on smithi187 2023-10-08T13:21:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:35 smithi139 ceph-mon[99506]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:35.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:35 smithi187 ceph-mon[104336]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:35 smithi155 ceph-mon[103467]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:37 smithi139 ceph-mon[99506]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:37.938 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:37 smithi187 ceph-mon[104336]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:37.938 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:37.938 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:37.938 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:37 smithi155 ceph-mon[103467]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:39.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.909+0000 7fd9057fa700 1 -- 172.21.15.187:0/963992949 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd90810f6a0 con 0x7fd8f40a1440 2023-10-08T13:21:39.910 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 2 on host 'smithi187' 2023-10-08T13:21:39.912 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 msgr2=0x7fd8f40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 0x7fd8f40a3900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005fd0 tx=0x7fd8f8005db0 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 msgr2=0x7fd908195940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd90000ada0 tx=0x7fd90000c330 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 shutdown_connections 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a1440 0x7fd8f40a3900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9081056b0 0x7fd908195940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9080ff750 0x7fd90819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 --2- 172.21.15.187:0/963992949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd908100110 0x7fd90819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:39.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 >> 172.21.15.187:0/963992949 conn(0x7fd908075790 msgr2=0x7fd9080fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 shutdown_connections 2023-10-08T13:21:39.914 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:21:39.911+0000 7fd90e9b4700 1 -- 172.21.15.187:0/963992949 wait complete. 2023-10-08T13:21:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:39.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:40.317 DEBUG:teuthology.orchestra.run.smithi187:osd.2> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-08T13:21:40.319 INFO:tasks.cephadm:Deploying osd.3 on smithi139 with /dev/vg_nvme/lv_3... 2023-10-08T13:21:40.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:21:40.359 INFO:journalctl@ceph.osd.2.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:21:40.888 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:41.043 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.044 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.044 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:41.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:41.330 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:21:41.041+0000 7fbdf0c68640 -1 osd.2 0 log_to_monitors true 2023-10-08T13:21:41.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:41.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:42.010 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:41 smithi139 ceph-mon[99506]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:42.010 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:41 smithi139 ceph-mon[99506]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:21:42.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:41 smithi187 ceph-mon[104336]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:42.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:41 smithi187 ceph-mon[104336]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:21:42.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:41 smithi155 ceph-mon[103467]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:42.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:41 smithi155 ceph-mon[103467]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T13:21:42.448 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:21:42.448 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:21:42.448 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2023-10-08T13:21:42.448 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2023-10-08T13:21:42.448 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111341 s, 942 MB/s 2023-10-08T13:21:42.449 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 2023-10-08T13:21:42.449 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2023-10-08T13:21:42.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2023-10-08T13:21:42.978 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:21:42.895+0000 7fbde62df700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T13:21:42.978 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:21:42.901+0000 7fbdde0cc700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:21:42.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:21:42.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:42.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:42 smithi187 ceph-mon[104336]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:21:43.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:43.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:43.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:42 smithi139 ceph-mon[99506]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:21:43.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T13:21:43.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T13:21:43.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:21:43.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:43.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:21:43.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:43.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:21:43.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:43.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:42 smithi155 ceph-mon[103467]: from='osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:21:43.395 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi187 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi187 to 17168M 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi187 2023-10-08T13:21:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi187 to 17168M 2023-10-08T13:21:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:21:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:44.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi187 2023-10-08T13:21:44.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi187 to 17168M 2023-10-08T13:21:44.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T13:21:44.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:44.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 -- 172.21.15.139:0/2627558696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184073340 msgr2=0x7f918410cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:44.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 --2- 172.21.15.139:0/2627558696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184073340 0x7f918410cd10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9178009990 tx=0x7f9178009ca0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 -- 172.21.15.139:0/2627558696 shutdown_connections 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 --2- 172.21.15.139:0/2627558696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f918410d250 0x7f918410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 --2- 172.21.15.139:0/2627558696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 --2- 172.21.15.139:0/2627558696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9184073340 0x7f918410cd10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 -- 172.21.15.139:0/2627558696 >> 172.21.15.139:0/2627558696 conn(0x7f91840779e0 msgr2=0x7f9184077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 -- 172.21.15.139:0/2627558696 shutdown_connections 2023-10-08T13:21:44.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.734+0000 7f91898ca700 1 -- 172.21.15.139:0/2627558696 wait complete. 2023-10-08T13:21:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 Processor -- start 2023-10-08T13:21:44.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 -- start start 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9184073340 0x7f91841993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918410d250 0x7f918419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918419ddb0 con 0x7f9184072a20 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918419df20 con 0x7f918410d250 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91898ca700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918419e0e0 con 0x7f9184073340 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f9182ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f9182ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37258/0 (socket says 172.21.15.139:37258) 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f9182ffd700 1 -- 172.21.15.139:0/3363454862 learned_addr learned my addr 172.21.15.139:0/3363454862 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:21:44.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91827fc700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9184073340 0x7f91841993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.735+0000 7f91837fe700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918410d250 0x7f918419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 -- 172.21.15.139:0/3363454862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9184073340 msgr2=0x7f91841993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9184073340 0x7f91841993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 -- 172.21.15.139:0/3363454862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918410d250 msgr2=0x7f918419d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918410d250 0x7f918419d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 -- 172.21.15.139:0/3363454862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91780095f0 con 0x7f9184072a20 2023-10-08T13:21:44.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.736+0000 7f9182ffd700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f917400e9a0 tx=0x7f917400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:44.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.848+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174009790 con 0x7f9184072a20 2023-10-08T13:21:44.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.848+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f917400cbd0 con 0x7f9184072a20 2023-10-08T13:21:44.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.848+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918419e3c0 con 0x7f9184072a20 2023-10-08T13:21:44.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.848+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174018680 con 0x7f9184072a20 2023-10-08T13:21:44.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.848+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91841a5c20 con 0x7f9184072a20 2023-10-08T13:21:44.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.849+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9184108460 con 0x7f9184072a20 2023-10-08T13:21:44.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.851+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) v1 ==== 135965+0+0 (secure 0 0 0) 0x7f917400cd40 con 0x7f9184072a20 2023-10-08T13:21:44.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.851+0000 7f91888c8700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 0x7f916c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:21:44.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.851+0000 7f91827fc700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 0x7f916c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:21:44.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.851+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3066+0+0 (secure 0 0 0) 0x7f9174014070 con 0x7f9184072a20 2023-10-08T13:21:44.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.852+0000 7f91827fc700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 0x7f916c0a3900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f917800b2e0 tx=0x7f9178005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:21:44.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:44.854+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f91740968d0 con 0x7f9184072a20 2023-10-08T13:21:45.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:45.056+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f918404e530 con 0x7f916c0a1440 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] boot 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:45.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:44 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:45.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:21:45.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:21:45.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] boot 2023-10-08T13:21:45.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:21:45.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:45.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:44 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:45.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:21:45.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:21:45.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: osd.2 [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] boot 2023-10-08T13:21:45.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T13:21:45.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T13:21:45.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:44 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:46.176 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:46.176 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:46.177 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:21:46.177 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:46.177 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:46.177 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:46.177 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:21:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:46.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:46.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:46.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:46.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:21:46.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:46 smithi139 ceph-mon[99506]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:46 smithi139 ceph-mon[99506]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:21:47.188 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131787]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:47.188 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:47.188 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131787]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:47.188 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131787]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:46 smithi187 ceph-mon[104336]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:46 smithi187 ceph-mon[104336]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:21:47.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:46 smithi155 ceph-mon[103467]: from='client.14475 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:21:47.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:21:47.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:46 smithi155 ceph-mon[103467]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T13:21:47.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131819]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:47.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131819]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:47.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131819]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:47.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:21:47 smithi139 sudo[131819]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:47.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114428]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:47.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114428]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:47.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114428]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:47.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114428]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:47.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:21:47.936+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9174096ca0 con 0x7f9184072a20 2023-10-08T13:21:48.096 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114431]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:48.096 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114431]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:48.096 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114431]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:48.097 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:21:47 smithi155 sudo[114431]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]: dispatch 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]': finished 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:21:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]: dispatch 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]': finished 2023-10-08T13:21:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:21:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:21:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.226 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116214]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:48.226 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116214]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:48.226 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116214]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:48.226 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116214]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]: dispatch 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3302608808' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c4fd3e0-7072-4fc5-8b9d-48030d0a877a"}]': finished 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: osdmap e23: 4 total, 3 up, 4 in 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:21:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:48.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116217]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:48.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116217]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:48.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116217]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:48.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:21:48 smithi187 sudo[116217]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:48.887 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[131909]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:48.888 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[131909]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:48.888 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[131909]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:48.888 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[131909]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[132096]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[132096]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[132096]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:48 smithi139 sudo[132096]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:49.381 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116220]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:49.381 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116220]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:49.381 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116220]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:49.381 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116220]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:49.646 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2883229304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:49.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114434]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T13:21:49.648 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:49.648 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114434]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:49.648 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114434]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2883229304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:49.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116223]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:49.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116223]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 sudo[116223]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: mgrmap e20: x(active, since 99s), standbys: z, y 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2883229304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:49.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:49.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:49.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114437]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T13:21:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114437]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T13:21:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114437]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T13:21:50.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:49 smithi155 sudo[114437]: pam_unix(sudo:session): session closed for user root 2023-10-08T13:21:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:50.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:50.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:50.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:50 smithi139 ceph-mon[99506]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:50.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:50.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:50 smithi187 ceph-mon[104336]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:50.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T13:21:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:50 smithi155 ceph-mon[103467]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T13:21:51.551 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:51 smithi139 ceph-mon[99506]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:51 smithi187 ceph-mon[104336]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:51 smithi155 ceph-mon[103467]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:53.865 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:53 smithi139 ceph-mon[99506]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:53 smithi187 ceph-mon[104336]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:53 smithi155 ceph-mon[103467]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:21:54.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:21:54.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:21:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:55.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T13:21:55.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:21:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:55 smithi139 ceph-mon[99506]: Deploying daemon osd.3 on smithi139 2023-10-08T13:21:55.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:55 smithi139 ceph-mon[99506]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:21:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:55 smithi187 ceph-mon[104336]: Deploying daemon osd.3 on smithi139 2023-10-08T13:21:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:55 smithi187 ceph-mon[104336]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:21:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:55 smithi155 ceph-mon[103467]: Deploying daemon osd.3 on smithi139 2023-10-08T13:21:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:55 smithi155 ceph-mon[103467]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T13:21:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:57 smithi139 ceph-mon[99506]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:21:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:57 smithi187 ceph-mon[104336]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:21:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:57 smithi155 ceph-mon[103467]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T13:21:59.581 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:59 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.581 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:59 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:59.582 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:59 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.582 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:21:59 smithi139 ceph-mon[99506]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:21:59.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:59 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:59 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:59.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:59 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:21:59 smithi187 ceph-mon[104336]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:21:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:59 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:59 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:21:59.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:59 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:21:59.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:21:59 smithi155 ceph-mon[103467]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T13:22:01.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.156+0000 7f91888c8700 1 -- 172.21.15.139:0/3363454862 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f918404e530 con 0x7f916c0a1440 2023-10-08T13:22:01.157 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 3 on host 'smithi139' 2023-10-08T13:22:01.159 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 msgr2=0x7f916c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:01.159 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 0x7f916c0a3900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f917800b2e0 tx=0x7f9178005960 comp rx=0 tx=0).stop 2023-10-08T13:22:01.159 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 msgr2=0x7f9184198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f917400e9a0 tx=0x7f917400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 shutdown_connections 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f916c0a1440 0x7f916c0a3900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918410d250 0x7f918419d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9184072a20 0x7f9184198eb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 --2- 172.21.15.139:0/3363454862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9184073340 0x7f91841993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 >> 172.21.15.139:0/3363454862 conn(0x7f91840779e0 msgr2=0x7f91840fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 shutdown_connections 2023-10-08T13:22:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:01.158+0000 7f91898ca700 1 -- 172.21.15.139:0/3363454862 wait complete. 2023-10-08T13:22:01.586 DEBUG:teuthology.orchestra.run.smithi139:osd.3> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-08T13:22:01.588 INFO:tasks.cephadm:Deploying osd.4 on smithi155 with /dev/vg_nvme/lv_3... 2023-10-08T13:22:01.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:22:01.616 INFO:journalctl@ceph.osd.3.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:22:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:22:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:22:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:02.164 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:22:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T13:22:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:02.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:02.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:02.687 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:22:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:22:02.463+0000 7f9c6f5ea640 -1 osd.3 0 log_to_monitors true 2023-10-08T13:22:03.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:02 smithi155 ceph-mon[103467]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:22:03.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:02 smithi139 ceph-mon[99506]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:22:03.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:02 smithi187 ceph-mon[104336]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T13:22:03.648 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:22:03.648 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:22:03.648 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-10-08T13:22:03.649 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-10-08T13:22:03.649 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111104 s, 944 MB/s 2023-10-08T13:22:03.649 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-10-08T13:22:03.992 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:03 smithi155 ceph-mon[103467]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:22:03.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:03 smithi155 ceph-mon[103467]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:22:03.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:03 smithi155 ceph-mon[103467]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:22:03.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:03 smithi155 ceph-mon[103467]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:22:03.993 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:03 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:04.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2023-10-08T13:22:04.142 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:22:03.758+0000 7f9c64c61700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T13:22:04.143 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:22:03.763+0000 7f9c5fa54700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:22:04.143 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-mon[99506]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:22:04.143 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-mon[99506]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:22:04.143 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-mon[99506]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:22:04.143 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-mon[99506]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:22:04.143 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:03 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:03 smithi187 ceph-mon[104336]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T13:22:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:03 smithi187 ceph-mon[104336]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T13:22:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:03 smithi187 ceph-mon[104336]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T13:22:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:03 smithi187 ceph-mon[104336]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:22:04.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:03 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:04.569 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.093 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.094 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:05.094 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:05.094 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:05.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:05.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:22:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T13:22:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:05.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:05.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- 172.21.15.155:0/3239792920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5000ffa10 msgr2=0x7fa5000ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:05.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 --2- 172.21.15.155:0/3239792920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5000ffa10 0x7fa5000ffe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009990 tx=0x7fa4f0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.741 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- 172.21.15.155:0/3239792920 shutdown_connections 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 --2- 172.21.15.155:0/3239792920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5001003d0 0x7fa50010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 --2- 172.21.15.155:0/3239792920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 0x7fa500105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 --2- 172.21.15.155:0/3239792920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5000ffa10 0x7fa5000ffe90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- 172.21.15.155:0/3239792920 >> 172.21.15.155:0/3239792920 conn(0x7fa500076490 msgr2=0x7fa5000768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- 172.21.15.155:0/3239792920 shutdown_connections 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- 172.21.15.155:0/3239792920 wait complete. 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 Processor -- start 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.739+0000 7fa507ffa700 1 -- start start 2023-10-08T13:22:05.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5000ffa10 0x7fa500195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 0x7fa5001962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5001a4fd0 con 0x7fa5000ffa10 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5001a5140 con 0x7fa5001003d0 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5001a5300 con 0x7fa500105760 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44950/0 (socket says 172.21.15.155:44950) 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 -- 172.21.15.155:0/1300804482 learned_addr learned my addr 172.21.15.155:0/1300804482 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-08T13:22:05.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505d96700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5000ffa10 0x7fa500195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa506597700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 0x7fa5001962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 -- 172.21.15.155:0/1300804482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 msgr2=0x7fa5001962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 0x7fa5001962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 -- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5000ffa10 msgr2=0x7fa500195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5000ffa10 0x7fa500195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 -- 172.21.15.155:0/1300804482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00095f0 con 0x7fa5001003d0 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa505595700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0000c00 tx=0x7fa4f0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:05.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f001d070 con 0x7fa5001003d0 2023-10-08T13:22:05.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4f0022470 con 0x7fa5001003d0 2023-10-08T13:22:05.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5001a5580 con 0x7fa5001003d0 2023-10-08T13:22:05.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0017650 con 0x7fa5001003d0 2023-10-08T13:22:05.745 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.740+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5001a5990 con 0x7fa5001003d0 2023-10-08T13:22:05.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.741+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa500107bb0 con 0x7fa5001003d0 2023-10-08T13:22:05.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.742+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa4f00225e0 con 0x7fa5001003d0 2023-10-08T13:22:05.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.743+0000 7fa4f6ffd700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 0x7fa4ec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:05.746 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.743+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3913+0+0 (secure 0 0 0) 0x7fa4f00cd4b0 con 0x7fa5001003d0 2023-10-08T13:22:05.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.743+0000 7fa505d96700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 0x7fa4ec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:05.747 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.744+0000 7fa505d96700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 0x7fa4ec0a3990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005950 tx=0x7fa4fc00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:05.748 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.747+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa4f0097df0 con 0x7fa5001003d0 2023-10-08T13:22:05.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:22:05.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi139 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi139 to 8584M 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] boot 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:22:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:05.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:05 smithi155 ceph-mon[103467]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:22:05.946 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:05.945+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa500069400 con 0x7fa4ec0a14d0 2023-10-08T13:22:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:22:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:22:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi139 2023-10-08T13:22:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi139 to 8584M 2023-10-08T13:22:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:22:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] boot 2023-10-08T13:22:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:22:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:05 smithi139 ceph-mon[99506]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:22:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:22:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:22:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi139 2023-10-08T13:22:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi139 to 8584M 2023-10-08T13:22:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: pgmap v71: 1 pgs: 1 peering; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T13:22:06.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: osd.3 [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] boot 2023-10-08T13:22:06.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: osdmap e26: 4 total, 4 up, 4 in 2023-10-08T13:22:06.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T13:22:06.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:05 smithi187 ceph-mon[104336]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T13:22:07.050 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:07.051 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:07.051 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:07.051 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:06 smithi155 ceph-mon[103467]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:22:07.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:07.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:07.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:07.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:06 smithi139 ceph-mon[99506]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:22:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:06 smithi187 ceph-mon[104336]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T13:22:07.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:07 smithi155 ceph-mon[103467]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:07.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:07 smithi155 ceph-mon[103467]: pgmap v75: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:07.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:07 smithi155 ceph-mon[103467]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:22:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:07 smithi139 ceph-mon[99506]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:07 smithi139 ceph-mon[99506]: pgmap v75: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:07 smithi139 ceph-mon[99506]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:22:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:07 smithi187 ceph-mon[104336]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:07 smithi187 ceph-mon[104336]: pgmap v75: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:07 smithi187 ceph-mon[104336]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T13:22:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:08 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/3704379696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:08 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:08 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]': finished 2023-10-08T13:22:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:08 smithi155 ceph-mon[103467]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:22:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:08 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/3704379696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:08 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:08 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]': finished 2023-10-08T13:22:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:08 smithi139 ceph-mon[99506]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:22:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:08 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/3704379696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:08 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]: dispatch 2023-10-08T13:22:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:08 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b56dde7b-4858-481a-bbcb-1d3d243a368d"}]': finished 2023-10-08T13:22:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:08 smithi187 ceph-mon[104336]: osdmap e30: 5 total, 4 up, 5 in 2023-10-08T13:22:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:09 smithi155 ceph-mon[103467]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:09 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/3682768360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:09 smithi139 ceph-mon[99506]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:09 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/3682768360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:09 smithi187 ceph-mon[104336]: pgmap v78: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:09 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/3682768360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:11.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:11 smithi155 ceph-mon[103467]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:11 smithi139 ceph-mon[99506]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:11 smithi187 ceph-mon[104336]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:13 smithi155 ceph-mon[103467]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-10-08T13:22:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:13 smithi139 ceph-mon[99506]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-10-08T13:22:13.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:13 smithi187 ceph-mon[104336]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2023-10-08T13:22:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:15 smithi139 ceph-mon[99506]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:22:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:15 smithi139 ceph-mon[99506]: Deploying daemon osd.4 on smithi155 2023-10-08T13:22:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:15 smithi187 ceph-mon[104336]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:15.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:22:15.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:15.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:15 smithi187 ceph-mon[104336]: Deploying daemon osd.4 on smithi155 2023-10-08T13:22:15.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:15 smithi155 ceph-mon[103467]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:15.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T13:22:15.985 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:15.986 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:15 smithi155 ceph-mon[103467]: Deploying daemon osd.4 on smithi155 2023-10-08T13:22:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:17 smithi139 ceph-mon[99506]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-08T13:22:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:17 smithi187 ceph-mon[104336]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-08T13:22:18.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:17 smithi155 ceph-mon[103467]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-10-08T13:22:19.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:19 smithi155 ceph-mon[103467]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:22:19.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:19 smithi139 ceph-mon[99506]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:22:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:19 smithi187 ceph-mon[104336]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-10-08T13:22:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:21 smithi155 ceph-mon[103467]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:22:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:21 smithi139 ceph-mon[99506]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:22:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:21 smithi187 ceph-mon[104336]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:22:21.754 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.753+0000 7fa4f6ffd700 1 -- 172.21.15.155:0/1300804482 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa500069400 con 0x7fa4ec0a14d0 2023-10-08T13:22:21.754 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 4 on host 'smithi155' 2023-10-08T13:22:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 msgr2=0x7fa4ec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:21.756 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 0x7fa4ec0a3990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005950 tx=0x7fa4fc00b410 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 msgr2=0x7fa500195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0000c00 tx=0x7fa4f0004730 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 shutdown_connections 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4ec0a14d0 0x7fa4ec0a3990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa500105760 0x7fa5001962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5000ffa10 0x7fa500195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 --2- 172.21.15.155:0/1300804482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5001003d0 0x7fa500195d90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 >> 172.21.15.155:0/1300804482 conn(0x7fa500076490 msgr2=0x7fa5000fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 shutdown_connections 2023-10-08T13:22:21.757 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:22:21.755+0000 7fa507ffa700 1 -- 172.21.15.155:0/1300804482 wait complete. 2023-10-08T13:22:22.171 DEBUG:teuthology.orchestra.run.smithi155:osd.4> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-08T13:22:22.173 INFO:tasks.cephadm:Deploying osd.5 on smithi187 with /dev/vg_nvme/lv_3... 2023-10-08T13:22:22.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T13:22:22.202 INFO:journalctl@ceph.osd.4.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:22:22.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.739 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:22.772 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.772 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.772 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:22.772 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:23.346 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:22:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:22:23.087+0000 7f87408a1640 -1 osd.4 0 log_to_monitors true 2023-10-08T13:22:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:23 smithi139 ceph-mon[99506]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:23 smithi139 ceph-mon[99506]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:23.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:23 smithi139 ceph-mon[99506]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:23.722 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:23 smithi187 ceph-mon[104336]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:23.723 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:23 smithi187 ceph-mon[104336]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:23.723 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:23 smithi187 ceph-mon[104336]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:23.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:23 smithi155 ceph-mon[103467]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:23.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:23 smithi155 ceph-mon[103467]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:23.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:23 smithi155 ceph-mon[103467]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110222 s, 951 MB/s 2023-10-08T13:22:24.242 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-10-08T13:22:24.581 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:24 smithi187 ceph-mon[104336]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:22:24.582 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:24 smithi187 ceph-mon[104336]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:22:24.582 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:24.582 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:24 smithi187 ceph-mon[104336]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:24.582 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:24 smithi187 ceph-mon[104336]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:24.583 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi187:vg_nvme/lv_3 2023-10-08T13:22:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:24 smithi139 ceph-mon[99506]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:22:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:24 smithi139 ceph-mon[99506]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:22:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:24 smithi139 ceph-mon[99506]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:24.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:24 smithi139 ceph-mon[99506]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:24.844 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:22:24.435+0000 7f8736719700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T13:22:24.844 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:22:24.441+0000 7f872dd05700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:22:24.845 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-mon[103467]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T13:22:24.845 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-mon[103467]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T13:22:24.845 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:24.845 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-mon[103467]: from='osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:24.845 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:24 smithi155 ceph-mon[103467]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:22:25.155 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi155 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi155 to 8584M 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:22:25.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi155 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi155 to 8584M 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:22:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T13:22:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi155 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi155 to 8584M 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:25.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:25.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:25.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:25.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/2327476524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 msgr2=0x7f0cb4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/2327476524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4105a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009990 tx=0x7f0cb0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/2327476524 shutdown_connections 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/2327476524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb4100110 0x7f0cb410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/2327476524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4105a90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/2327476524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb40ff750 0x7f0cb40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/2327476524 >> 172.21.15.187:0/2327476524 conn(0x7f0cb4075790 msgr2=0x7f0cb4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/2327476524 shutdown_connections 2023-10-08T13:22:26.465 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/2327476524 wait complete. 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.461+0000 7f0cbc0b7700 1 Processor -- start 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 -- start start 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb40ff750 0x7f0cb419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb4100110 0x7f0cb419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4197600 con 0x7f0cb4100110 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4197770 con 0x7f0cb40ff750 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4197930 con 0x7f0cb41056b0 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:40466/0 (socket says 172.21.15.187:40466) 2023-10-08T13:22:26.466 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 -- 172.21.15.187:0/515227457 learned_addr learned my addr 172.21.15.187:0/515227457 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cb9652700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb4100110 0x7f0cb419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cb9e53700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb40ff750 0x7f0cb419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 -- 172.21.15.187:0/515227457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb40ff750 msgr2=0x7f0cb419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb40ff750 0x7f0cb419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 -- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb4100110 msgr2=0x7f0cb419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb4100110 0x7f0cb419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 -- 172.21.15.187:0/515227457 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00095f0 con 0x7f0cb41056b0 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cba654700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00ada0 tx=0x7f0cac00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00f070 con 0x7f0cb41056b0 2023-10-08T13:22:26.467 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cac007b30 con 0x7f0cb41056b0 2023-10-08T13:22:26.468 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac005440 con 0x7f0cb41056b0 2023-10-08T13:22:26.468 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.462+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb4197c10 con 0x7f0cb41056b0 2023-10-08T13:22:26.468 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.463+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb41a3900 con 0x7f0cb41056b0 2023-10-08T13:22:26.468 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.464+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb4100df0 con 0x7f0cb41056b0 2023-10-08T13:22:26.469 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.464+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0cac004ad0 con 0x7f0cb41056b0 2023-10-08T13:22:26.469 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.465+0000 7f0caaffd700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 0x7f0ca00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:26.469 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.465+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f0cac0cb380 con 0x7f0cb41056b0 2023-10-08T13:22:26.469 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.465+0000 7f0cb9e53700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 0x7f0ca00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:26.469 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.466+0000 7f0cb9e53700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 0x7f0ca00a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005850 tx=0x7f0cb001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:26.470 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.470+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cac095a10 con 0x7f0cb41056b0 2023-10-08T13:22:26.666 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:26.665+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cb410f650 con 0x7f0ca00a1550 2023-10-08T13:22:26.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:22:26.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:22:26.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:26.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] boot 2023-10-08T13:22:26.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:22:26.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:26 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:26.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:22:26.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:22:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] boot 2023-10-08T13:22:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:22:26.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:26 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:22:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:22:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: osd.4 [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] boot 2023-10-08T13:22:26.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: osdmap e33: 5 total, 5 up, 5 in 2023-10-08T13:22:26.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:26 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:27.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:27.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:22:27.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:27.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:27.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:27.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:27.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:27.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T13:22:27.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:27.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:27.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:27.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:27.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/2520154996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]': finished 2023-10-08T13:22:29.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:22:29.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/2520154996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]': finished 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:22:29.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/2520154996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]: dispatch 2023-10-08T13:22:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a99b3b48-6c21-402e-9030-59a51a671f21"}]': finished 2023-10-08T13:22:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: osdmap e35: 6 total, 5 up, 6 in 2023-10-08T13:22:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:30.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:30 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/3998239905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:30.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:30 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/3998239905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:31.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:30 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/3998239905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:31 smithi139 ceph-mon[99506]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:31 smithi187 ceph-mon[104336]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:32.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:31 smithi155 ceph-mon[103467]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:33.919 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:33 smithi187 ceph-mon[104336]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:33 smithi139 ceph-mon[99506]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:34.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:33 smithi155 ceph-mon[103467]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:35 smithi139 ceph-mon[99506]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:22:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:35 smithi187 ceph-mon[104336]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:22:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:35 smithi155 ceph-mon[103467]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T13:22:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:36.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:36 smithi139 ceph-mon[99506]: Deploying daemon osd.5 on smithi187 2023-10-08T13:22:36.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:36 smithi187 ceph-mon[104336]: Deploying daemon osd.5 on smithi187 2023-10-08T13:22:37.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:36 smithi155 ceph-mon[103467]: Deploying daemon osd.5 on smithi187 2023-10-08T13:22:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:37 smithi139 ceph-mon[99506]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:37.946 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:37 smithi187 ceph-mon[104336]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:37 smithi155 ceph-mon[103467]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:39.897 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:39 smithi187 ceph-mon[104336]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:39 smithi139 ceph-mon[99506]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:39 smithi155 ceph-mon[103467]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:41.171 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.171 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.171 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:40 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:41.171 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:40 smithi187 ceph-mon[104336]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:41.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:40 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:41.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:40 smithi155 ceph-mon[103467]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:41.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:41.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:40 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:41.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:40 smithi139 ceph-mon[99506]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:42.624 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 5 on host 'smithi187' 2023-10-08T13:22:42.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.622+0000 7f0caaffd700 1 -- 172.21.15.187:0/515227457 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0cb410f650 con 0x7f0ca00a1550 2023-10-08T13:22:42.626 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 msgr2=0x7f0ca00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:42.626 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 0x7f0ca00a3a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0005850 tx=0x7f0cb001a040 comp rx=0 tx=0).stop 2023-10-08T13:22:42.626 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 msgr2=0x7f0cb4196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:42.626 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00ada0 tx=0x7f0cac00c330 comp rx=0 tx=0).stop 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 shutdown_connections 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0ca00a1550 0x7f0ca00a3a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cb41056b0 0x7f0cb4196e50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb40ff750 0x7f0cb419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 --2- 172.21.15.187:0/515227457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cb4100110 0x7f0cb419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 >> 172.21.15.187:0/515227457 conn(0x7f0cb4075790 msgr2=0x7f0cb40fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 shutdown_connections 2023-10-08T13:22:42.627 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:22:42.625+0000 7f0cbc0b7700 1 -- 172.21.15.187:0/515227457 wait complete. 2023-10-08T13:22:43.048 DEBUG:teuthology.orchestra.run.smithi187:osd.5> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-08T13:22:43.050 INFO:tasks.cephadm:Deploying osd.6 on smithi139 with /dev/vg_nvme/lv_2... 2023-10-08T13:22:43.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:22:43.083 INFO:journalctl@ceph.osd.5.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:22:43.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:43.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:43.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:43.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:43.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:43.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:43.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:43.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:43.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:22:43.635 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:22:44.169 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:22:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:22:43.891+0000 7fe031be3640 -1 osd.5 0 log_to_monitors true 2023-10-08T13:22:44.408 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:44 smithi139 ceph-mon[99506]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:44.408 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:44 smithi139 ceph-mon[99506]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:44.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:44 smithi187 ceph-mon[104336]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:44.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:44 smithi187 ceph-mon[104336]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:44.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:44 smithi155 ceph-mon[103467]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:44.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:44 smithi155 ceph-mon[103467]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T13:22:45.186 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:22:45.186 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:22:45.187 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2023-10-08T13:22:45.187 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2023-10-08T13:22:45.187 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127534 s, 822 MB/s 2023-10-08T13:22:45.187 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2023-10-08T13:22:45.461 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:22:45.185+0000 7fe02725a700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T13:22:45.461 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:22:45.192+0000 7fe02084a700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.462 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:45 smithi187 ceph-mon[104336]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:45.587 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:22:45.587 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.587 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:22:45.587 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:45.587 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.588 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:45 smithi139 ceph-mon[99506]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:45.589 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: from='osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:22:45.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:45 smithi155 ceph-mon[103467]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-10-08T13:22:46.145 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:22:46.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:22:46.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:22:46.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] boot 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi187 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi187 to 8584M 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:46.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:46.478 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] boot 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi187 2023-10-08T13:22:46.564 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi187 to 8584M 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:46.565 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:22:46.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T13:22:46.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: osd.5 [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] boot 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: osdmap e38: 6 total, 6 up, 6 in 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi187 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi187 to 8584M 2023-10-08T13:22:46.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:46.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:46.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:22:46.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:22:47.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3931969229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c44100390 msgr2=0x7f3c4410c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:47.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3931969229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c44100390 0x7f3c4410c550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00b0a0 tx=0x7f3c3c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3931969229 shutdown_connections 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3931969229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c44100390 0x7f3c4410c550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3931969229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 0x7f3c44105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3931969229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c440ff9d0 0x7f3c440ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3931969229 >> 172.21.15.139:0/3931969229 conn(0x7f3c440765b0 msgr2=0x7f3c440769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3931969229 shutdown_connections 2023-10-08T13:22:47.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.362+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3931969229 wait complete. 2023-10-08T13:22:47.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 Processor -- start 2023-10-08T13:22:47.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 -- start start 2023-10-08T13:22:47.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:47.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c44100390 0x7f3c4419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:47.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 0x7f3c44195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44196330 con 0x7f3c440ff9d0 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441964a0 con 0x7f3c441057e0 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c4a92a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44196660 con 0x7f3c44100390 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37394/0 (socket says 172.21.15.139:37394) 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c43fff700 1 -- 172.21.15.139:0/3877113277 learned_addr learned my addr 172.21.15.139:0/3877113277 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.363+0000 7f3c48ec7700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 0x7f3c44195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 -- 172.21.15.139:0/3877113277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c44100390 msgr2=0x7f3c4419bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:47.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c437fe700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c44100390 0x7f3c4419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c44100390 0x7f3c4419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 -- 172.21.15.139:0/3877113277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 msgr2=0x7f3c44195b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 0x7f3c44195b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 -- 172.21.15.139:0/3877113277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009d00 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c43fff700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34009940 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c34010460 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400f620 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c44196940 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.364+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c441a29e0 con 0x7f3c440ff9d0 2023-10-08T13:22:47.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.365+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c44107c10 con 0x7f3c440ff9d0 2023-10-08T13:22:47.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.366+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3c340108d0 con 0x7f3c440ff9d0 2023-10-08T13:22:47.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.367+0000 7f3c417fa700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 0x7f3c300a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:22:47.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.367+0000 7f3c437fe700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 0x7f3c300a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:22:47.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.367+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f3c340cbd60 con 0x7f3c440ff9d0 2023-10-08T13:22:47.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.367+0000 7f3c437fe700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 0x7f3c300a3a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c006fd0 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:22:47.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.370+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3c34096190 con 0x7f3c440ff9d0 2023-10-08T13:22:47.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:47 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:22:47.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:47 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:22:47.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:47 smithi139 ceph-mon[99506]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:22:47.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:47 smithi139 ceph-mon[99506]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:47.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:22:47.568+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c44196ff0 con 0x7f3c300a1550 2023-10-08T13:22:47.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:47 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:22:47.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:47 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:22:47.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:47 smithi155 ceph-mon[103467]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:22:47.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:47 smithi155 ceph-mon[103467]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:47 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:22:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:47 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:22:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:47 smithi187 ceph-mon[104336]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T13:22:47.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:47 smithi187 ceph-mon[104336]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:48.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:48 smithi155 ceph-mon[103467]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:22:48.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:48 smithi155 ceph-mon[103467]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:48.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:48.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:48.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:48.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:48 smithi139 ceph-mon[99506]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:22:48.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:48 smithi139 ceph-mon[99506]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:48.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:48.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:48.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:48.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:48 smithi187 ceph-mon[104336]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T13:22:48.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:48 smithi187 ceph-mon[104336]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:22:48.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:22:48.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:22:48.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:49 smithi139 ceph-mon[99506]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:22:49.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:49 smithi139 ceph-mon[99506]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:49.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:49 smithi187 ceph-mon[104336]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:22:49.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:49 smithi187 ceph-mon[104336]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:49.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:49 smithi155 ceph-mon[103467]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T13:22:49.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:49 smithi155 ceph-mon[103467]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:50 smithi139 ceph-mon[99506]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:22:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]: dispatch 2023-10-08T13:22:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]': finished 2023-10-08T13:22:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:50 smithi139 ceph-mon[99506]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:22:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:22:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:50 smithi187 ceph-mon[104336]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:22:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]: dispatch 2023-10-08T13:22:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]': finished 2023-10-08T13:22:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:50 smithi187 ceph-mon[104336]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:22:50.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:22:50.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:50 smithi155 ceph-mon[103467]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T13:22:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]: dispatch 2023-10-08T13:22:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/930822266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b0ca25a-6499-4462-9664-e1c0cb8a12b2"}]': finished 2023-10-08T13:22:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:50 smithi155 ceph-mon[103467]: osdmap e43: 7 total, 6 up, 7 in 2023-10-08T13:22:50.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:22:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:51 smithi139 ceph-mon[99506]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:22:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3405576456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:51 smithi187 ceph-mon[104336]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:22:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3405576456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:51 smithi155 ceph-mon[103467]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:22:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3405576456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:22:53.863 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:53 smithi139 ceph-mon[99506]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:53 smithi187 ceph-mon[104336]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:53 smithi155 ceph-mon[103467]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:22:55.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:55 smithi139 ceph-mon[99506]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:22:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:55 smithi187 ceph-mon[104336]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:22:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:55 smithi155 ceph-mon[103467]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:22:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:56 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:22:56.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:56 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:56.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:56 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:22:56.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:56 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:57.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:56 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T13:22:57.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:56 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:22:57.852 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:57 smithi139 ceph-mon[99506]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:57.853 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:57 smithi139 ceph-mon[99506]: Deploying daemon osd.6 on smithi139 2023-10-08T13:22:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:57 smithi187 ceph-mon[104336]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:57 smithi187 ceph-mon[104336]: Deploying daemon osd.6 on smithi139 2023-10-08T13:22:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:57 smithi155 ceph-mon[103467]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:22:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:57 smithi155 ceph-mon[103467]: Deploying daemon osd.6 on smithi139 2023-10-08T13:22:59.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:22:59 smithi139 ceph-mon[99506]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:22:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:22:59 smithi187 ceph-mon[104336]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:00.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:22:59 smithi155 ceph-mon[103467]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:01.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:01 smithi139 ceph-mon[99506]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:01.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:01 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:01.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:01 smithi155 ceph-mon[103467]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:01.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:01 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:01 smithi187 ceph-mon[104336]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:01 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:03 smithi139 ceph-mon[99506]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:03 smithi187 ceph-mon[104336]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:03 smithi155 ceph-mon[103467]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:04.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.168+0000 7f3c417fa700 1 -- 172.21.15.139:0/3877113277 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3c44196ff0 con 0x7f3c300a1550 2023-10-08T13:23:04.169 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 6 on host 'smithi139' 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 msgr2=0x7f3c300a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 0x7f3c300a3a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c006fd0 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 msgr2=0x7f3c4419ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400dc60 comp rx=0 tx=0).stop 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 shutdown_connections 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3c300a1550 0x7f3c300a3a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c441057e0 0x7f3c44195b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c440ff9d0 0x7f3c4419ba60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:04.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 --2- 172.21.15.139:0/3877113277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c44100390 0x7f3c4419bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:04.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 >> 172.21.15.139:0/3877113277 conn(0x7f3c440765b0 msgr2=0x7f3c440fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:04.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 shutdown_connections 2023-10-08T13:23:04.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:04.170+0000 7f3c4a92a700 1 -- 172.21.15.139:0/3877113277 wait complete. 2023-10-08T13:23:04.633 DEBUG:teuthology.orchestra.run.smithi139:osd.6> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-08T13:23:04.635 INFO:tasks.cephadm:Deploying osd.7 on smithi155 with /dev/vg_nvme/lv_2... 2023-10-08T13:23:04.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:23:04.667 INFO:journalctl@ceph.osd.6.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:23:04.937 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:23:04.831+0000 7f8be4f4d640 -1 osd.6 0 log_to_monitors true 2023-10-08T13:23:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:04.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:04.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:05.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:05.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:05.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:05.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:05.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:05.223 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:23:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:05 smithi187 ceph-mon[104336]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:05 smithi187 ceph-mon[104336]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:23:05.977 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:05 smithi155 ceph-mon[103467]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:05.977 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:05 smithi155 ceph-mon[103467]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:23:06.042 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:05 smithi139 ceph-mon[99506]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:06.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:05 smithi139 ceph-mon[99506]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110825 s, 946 MB/s 2023-10-08T13:23:06.693 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-10-08T13:23:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:06 smithi187 ceph-mon[104336]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:23:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:06 smithi187 ceph-mon[104336]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:23:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:06 smithi187 ceph-mon[104336]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:23:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:06.995 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:23:06.716+0000 7f8bda5c4700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T13:23:06.995 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:23:06.725+0000 7f8bd43b5700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:23:06.995 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-mon[99506]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:23:06.995 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-mon[99506]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:23:06.995 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-mon[99506]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:23:06.995 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:07.078 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:06 smithi155 ceph-mon[103467]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T13:23:07.079 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:06 smithi155 ceph-mon[103467]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T13:23:07.079 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:06 smithi155 ceph-mon[103467]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:23:07.079 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:07.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2023-10-08T13:23:07.639 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:23:08.007 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.008 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:08.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:08.009 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:23:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:08.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- 172.21.15.155:0/2026887540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c100110 msgr2=0x7f583c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:08.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 --2- 172.21.15.155:0/2026887540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c100110 0x7f583c10c580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f583400b0a0 tx=0x7f583400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- 172.21.15.155:0/2026887540 shutdown_connections 2023-10-08T13:23:08.799 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 --2- 172.21.15.155:0/2026887540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c100110 0x7f583c10c580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 --2- 172.21.15.155:0/2026887540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c1056b0 0x7f583c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 --2- 172.21.15.155:0/2026887540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c0ff750 0x7f583c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- 172.21.15.155:0/2026887540 >> 172.21.15.155:0/2026887540 conn(0x7f583c075790 msgr2=0x7f583c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- 172.21.15.155:0/2026887540 shutdown_connections 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- 172.21.15.155:0/2026887540 wait complete. 2023-10-08T13:23:08.800 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 Processor -- start 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.797+0000 7f5842387700 1 -- start start 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c100110 0x7f583c1980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c1056b0 0x7f583c1a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c198960 con 0x7f583c1056b0 2023-10-08T13:23:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1a3120 con 0x7f583c0ff750 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5842387700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1a3260 con 0x7f583c100110 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45056/0 (socket says 172.21.15.155:45056) 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 -- 172.21.15.155:0/4207334881 learned_addr learned my addr 172.21.15.155:0/4207334881 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f5840924700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c1056b0 0x7f583c1a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583b7fe700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c100110 0x7f583c1980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 -- 172.21.15.155:0/4207334881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c100110 msgr2=0x7f583c1980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c100110 0x7f583c1980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 -- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c1056b0 msgr2=0x7f583c1a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c1056b0 0x7f583c1a2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 -- 172.21.15.155:0/4207334881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009d00 con 0x7f583c0ff750 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.798+0000 7f583bfff700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f582400d950 tx=0x7f582400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.799+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824009940 con 0x7f583c0ff750 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.799+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5824010460 con 0x7f583c0ff750 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.799+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c1a34e0 con 0x7f583c0ff750 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.799+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582400f620 con 0x7f583c0ff750 2023-10-08T13:23:08.803 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.799+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c1a39e0 con 0x7f583c0ff750 2023-10-08T13:23:08.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.800+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c107c40 con 0x7f583c0ff750 2023-10-08T13:23:08.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.801+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f58240108d0 con 0x7f583c0ff750 2023-10-08T13:23:08.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.801+0000 7f58397fa700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 0x7f58280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:08.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.801+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5180+0+0 (secure 0 0 0) 0x7f58240cbf20 con 0x7f583c0ff750 2023-10-08T13:23:08.804 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.801+0000 7f583b7fe700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 0x7f58280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.802+0000 7f583b7fe700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 0x7f58280a3990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f582c005950 tx=0x7f582c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:08.806+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f58240961c0 con 0x7f583c0ff750 2023-10-08T13:23:09.004 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:09.003+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f583c068750 con 0x7f58280a14d0 2023-10-08T13:23:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:23:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:23:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi139 2023-10-08T13:23:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi139 to 5722M 2023-10-08T13:23:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] boot 2023-10-08T13:23:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:23:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:23:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:23:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi139 2023-10-08T13:23:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi139 to 5722M 2023-10-08T13:23:09.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:09.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] boot 2023-10-08T13:23:09.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:23:09.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:23:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:23:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi139 2023-10-08T13:23:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi139 to 5722M 2023-10-08T13:23:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: osd.6 [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] boot 2023-10-08T13:23:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: osdmap e46: 7 total, 7 up, 7 in 2023-10-08T13:23:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T13:23:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:09 smithi155 ceph-mon[103467]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:09 smithi155 ceph-mon[103467]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:23:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:09 smithi139 ceph-mon[99506]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:09 smithi139 ceph-mon[99506]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:23:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:09 smithi187 ceph-mon[104336]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-10-08T13:23:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:09 smithi187 ceph-mon[104336]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T13:23:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:10.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:10 smithi155 ceph-mon[103467]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:10 smithi139 ceph-mon[99506]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:10 smithi187 ceph-mon[104336]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/2056013609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]': finished 2023-10-08T13:23:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:23:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:12.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:12.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/2056013609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]': finished 2023-10-08T13:23:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:23:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/2056013609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]: dispatch 2023-10-08T13:23:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a94a0e56-610f-4aae-a73e-80a5f7b7dbe6"}]': finished 2023-10-08T13:23:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: osdmap e48: 8 total, 7 up, 8 in 2023-10-08T13:23:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:13.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:12 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/3768178549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:13.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:12 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/3768178549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:13.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:12 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/3768178549' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:13 smithi155 ceph-mon[103467]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:13 smithi139 ceph-mon[99506]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:13 smithi187 ceph-mon[104336]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:15 smithi155 ceph-mon[103467]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:15 smithi139 ceph-mon[99506]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:15 smithi187 ceph-mon[104336]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:17 smithi155 ceph-mon[103467]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:17 smithi139 ceph-mon[99506]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:17 smithi187 ceph-mon[104336]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:19.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:23:19.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:19.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:18 smithi155 ceph-mon[103467]: Deploying daemon osd.7 on smithi155 2023-10-08T13:23:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:23:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:18 smithi139 ceph-mon[99506]: Deploying daemon osd.7 on smithi155 2023-10-08T13:23:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T13:23:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:18 smithi187 ceph-mon[104336]: Deploying daemon osd.7 on smithi155 2023-10-08T13:23:19.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:19 smithi155 ceph-mon[103467]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:19 smithi139 ceph-mon[99506]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:19 smithi187 ceph-mon[104336]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:21.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:21 smithi155 ceph-mon[103467]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:21 smithi139 ceph-mon[99506]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:21 smithi187 ceph-mon[104336]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:23.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:23.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:23 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:23 smithi155 ceph-mon[103467]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:23.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:23.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:23 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:23 smithi139 ceph-mon[99506]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:23 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:23.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:23 smithi187 ceph-mon[104336]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:25.264 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.262+0000 7f58397fa700 1 -- 172.21.15.155:0/4207334881 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f583c068750 con 0x7f58280a14d0 2023-10-08T13:23:25.264 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 7 on host 'smithi155' 2023-10-08T13:23:25.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 msgr2=0x7f58280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:25.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 0x7f58280a3990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f582c005950 tx=0x7f582c0058e0 comp rx=0 tx=0).stop 2023-10-08T13:23:25.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 msgr2=0x7f583c197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:25.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f582400d950 tx=0x7f582400dc60 comp rx=0 tx=0).stop 2023-10-08T13:23:25.266 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 shutdown_connections 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58280a14d0 0x7f58280a3990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f583c1056b0 0x7f583c1a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583c0ff750 0x7f583c197b60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 --2- 172.21.15.155:0/4207334881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f583c100110 0x7f583c1980a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.264+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 >> 172.21.15.155:0/4207334881 conn(0x7f583c075790 msgr2=0x7f583c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.265+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 shutdown_connections 2023-10-08T13:23:25.267 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:23:25.265+0000 7f5842387700 1 -- 172.21.15.155:0/4207334881 wait complete. 2023-10-08T13:23:25.729 DEBUG:teuthology.orchestra.run.smithi155:osd.7> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-08T13:23:25.732 INFO:tasks.cephadm:Deploying osd.8 on smithi187 with /dev/vg_nvme/lv_2... 2023-10-08T13:23:25.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T13:23:25.760 INFO:journalctl@ceph.osd.7.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:23:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:25 smithi155 ceph-mon[103467]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:25 smithi139 ceph-mon[99506]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:26.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:25 smithi187 ceph-mon[104336]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:26.302 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:23:26.468 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:23:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:23:26.106+0000 7f8a8b912640 -1 osd.7 0 log_to_monitors true 2023-10-08T13:23:27.095 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:26 smithi155 ceph-mon[103467]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.095 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:26 smithi155 ceph-mon[103467]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:26 smithi139 ceph-mon[99506]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:26 smithi139 ceph-mon[99506]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:26 smithi187 ceph-mon[104336]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:26 smithi187 ceph-mon[104336]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0157605 s, 665 MB/s 2023-10-08T13:23:27.928 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:27 smithi139 ceph-mon[99506]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.197 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:28.197 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:23:28.197 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:23:28.197 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:28.198 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.198 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-mon[103467]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.198 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:23:27.932+0000 7f8a80f89700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T13:23:28.198 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:23:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:23:27.940+0000 7f8a7ad7a700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:23:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T13:23:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T13:23:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: from='osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:27 smithi187 ceph-mon[104336]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:23:28.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi187:vg_nvme/lv_2 2023-10-08T13:23:28.907 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:23:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:23:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:23:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:29.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:23:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:23:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:29.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:30.085 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 -- 172.21.15.187:0/3833928196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92141004c0 msgr2=0x7f92141008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:30.085 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 --2- 172.21.15.187:0/3833928196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92141004c0 0x7f92141008a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9204009990 tx=0x7f9204009ca0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.085 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 -- 172.21.15.187:0/3833928196 shutdown_connections 2023-10-08T13:23:30.085 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 --2- 172.21.15.187:0/3833928196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9214104ae0 0x7f921410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 --2- 172.21.15.187:0/3833928196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92141004c0 0x7f92141008a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 --2- 172.21.15.187:0/3833928196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214100e70 0x7f92141043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 -- 172.21.15.187:0/3833928196 >> 172.21.15.187:0/3833928196 conn(0x7f9214074aa0 msgr2=0x7f9214074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.081+0000 7f92194df700 1 -- 172.21.15.187:0/3833928196 shutdown_connections 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 -- 172.21.15.187:0/3833928196 wait complete. 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 Processor -- start 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 -- start start 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92141004c0 0x7f921419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:30.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214104ae0 0x7f9214196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214197070 con 0x7f9214104ae0 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141971e0 con 0x7f92141004c0 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.082+0000 7f92194df700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92141973a0 con 0x7f9214100e70 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:40578/0 (socket says 172.21.15.187:40578) 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 -- 172.21.15.187:0/3172096786 learned_addr learned my addr 172.21.15.187:0/3172096786 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92137fe700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214104ae0 0x7f9214196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f9212ffd700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92141004c0 0x7f921419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 -- 172.21.15.187:0/3172096786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92141004c0 msgr2=0x7f921419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92141004c0 0x7f921419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 -- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214104ae0 msgr2=0x7f9214196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214104ae0 0x7f9214196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 -- 172.21.15.187:0/3172096786 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92040095f0 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92127fc700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f920800d950 tx=0x7f920800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208009930 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9208010460 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9214197680 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800f620 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.083+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92141a38c0 con 0x7f9214100e70 2023-10-08T13:23:30.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.084+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214108d50 con 0x7f9214100e70 2023-10-08T13:23:30.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.086+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9208010860 con 0x7f9214100e70 2023-10-08T13:23:30.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.086+0000 7f91fbfff700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 0x7f91fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:30.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.087+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5641+0+0 (secure 0 0 0) 0x7f92080cbee0 con 0x7f9214100e70 2023-10-08T13:23:30.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.087+0000 7f9212ffd700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 0x7f91fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:30.089 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.087+0000 7f9212ffd700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 0x7f91fc0a3990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9204005850 tx=0x7f920401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:30.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.090+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9208095fb0 con 0x7f9214100e70 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi155 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi155 to 5722M 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] boot 2023-10-08T13:23:30.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:23:30.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:30.287 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:30.286+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9214197ed0 con 0x7f91fc0a14d0 2023-10-08T13:23:30.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:23:30.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi155 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi155 to 5722M 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] boot 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:23:30.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:30.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:23:30.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:23:30.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi155 2023-10-08T13:23:30.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi155 to 5722M 2023-10-08T13:23:30.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-10-08T13:23:30.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: osd.7 [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] boot 2023-10-08T13:23:30.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: osdmap e51: 8 total, 8 up, 8 in 2023-10-08T13:23:30.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T13:23:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:23:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:31.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:30 smithi187 ceph-mon[104336]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:23:31.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:23:31.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:31.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:30 smithi155 ceph-mon[103467]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:30 smithi139 ceph-mon[99506]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T13:23:33.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:23:33.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:33.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/1846230650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]': finished 2023-10-08T13:23:33.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:23:33.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:33.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:23:33.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:33.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/1846230650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]': finished 2023-10-08T13:23:33.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:23:33.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T13:23:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: pgmap v144: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/1846230650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]: dispatch 2023-10-08T13:23:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53a4eb0-33db-4e79-9640-45d1717efe54"}]': finished 2023-10-08T13:23:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: osdmap e55: 9 total, 8 up, 9 in 2023-10-08T13:23:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/3684285868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:34.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/3684285868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:34.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/3684285868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:35.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:34 smithi187 ceph-mon[104336]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:35.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:34 smithi155 ceph-mon[103467]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:35.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:34 smithi139 ceph-mon[99506]: pgmap v146: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:37.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:37 smithi187 ceph-mon[104336]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:37 smithi139 ceph-mon[99506]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:37 smithi155 ceph-mon[103467]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:39.901 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:39 smithi187 ceph-mon[104336]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:39.902 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:23:39.902 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:39 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:39 smithi139 ceph-mon[99506]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:23:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:39 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:39 smithi155 ceph-mon[103467]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T13:23:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:39 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:40.844 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:40 smithi187 ceph-mon[104336]: Deploying daemon osd.8 on smithi187 2023-10-08T13:23:40.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:40 smithi139 ceph-mon[99506]: Deploying daemon osd.8 on smithi187 2023-10-08T13:23:41.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:40 smithi155 ceph-mon[103467]: Deploying daemon osd.8 on smithi187 2023-10-08T13:23:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:41 smithi139 ceph-mon[99506]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:41.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:41 smithi187 ceph-mon[104336]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:42.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:41 smithi155 ceph-mon[103467]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:43 smithi139 ceph-mon[99506]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:43 smithi187 ceph-mon[104336]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:43 smithi155 ceph-mon[103467]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:44.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:45.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:45.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:46.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:46.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:46.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.194+0000 7f91fbfff700 1 -- 172.21.15.187:0/3172096786 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9214197ed0 con 0x7f91fc0a14d0 2023-10-08T13:23:46.196 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 8 on host 'smithi187' 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.195+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 msgr2=0x7f91fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.195+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 0x7f91fc0a3990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9204005850 tx=0x7f920401a040 comp rx=0 tx=0).stop 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.195+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 msgr2=0x7f921419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.195+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f920800d950 tx=0x7f920800dc60 comp rx=0 tx=0).stop 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 shutdown_connections 2023-10-08T13:23:46.197 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91fc0a14d0 0x7f91fc0a3990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9214104ae0 0x7f9214196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92141004c0 0x7f921419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 --2- 172.21.15.187:0/3172096786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9214100e70 0x7f921419ce10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 >> 172.21.15.187:0/3172096786 conn(0x7f9214074aa0 msgr2=0x7f9214103870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 shutdown_connections 2023-10-08T13:23:46.198 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:23:46.196+0000 7f92194df700 1 -- 172.21.15.187:0/3172096786 wait complete. 2023-10-08T13:23:46.604 DEBUG:teuthology.orchestra.run.smithi187:osd.8> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-08T13:23:46.606 INFO:tasks.cephadm:Deploying osd.9 on smithi139 with /dev/vg_nvme/lv_1... 2023-10-08T13:23:46.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:23:46.635 INFO:journalctl@ceph.osd.8.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:23:47.177 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:23:47.418 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:47.419 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:47 smithi139 ceph-mon[99506]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:47.433 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:23:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:23:47.300+0000 7f7f02ea0640 -1 osd.8 0 log_to_monitors true 2023-10-08T13:23:47.434 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.434 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.434 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:47.434 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:47 smithi187 ceph-mon[104336]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:47.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:47.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:23:47.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:47 smithi155 ceph-mon[103467]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:48.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:48 smithi139 ceph-mon[99506]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:23:48.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:48 smithi187 ceph-mon[104336]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:23:48.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:48 smithi155 ceph-mon[103467]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111059 s, 944 MB/s 2023-10-08T13:23:48.760 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2023-10-08T13:23:49.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi139:vg_nvme/lv_1 2023-10-08T13:23:49.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:49 smithi139 ceph-mon[99506]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:23:49.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:49 smithi139 ceph-mon[99506]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:23:49.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:49 smithi139 ceph-mon[99506]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:23:49.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:49.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:49 smithi139 ceph-mon[99506]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:49.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-mon[104336]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:23:49.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-mon[104336]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:23:49.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-mon[104336]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:23:49.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:49.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-mon[104336]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:49.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:23:49.172+0000 7f7ef8517700 -1 osd.8 0 waiting for initial osdmap 2023-10-08T13:23:49.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:23:49 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:23:49.184+0000 7f7ef0b05700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:23:49.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:49 smithi155 ceph-mon[103467]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T13:23:49.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:49 smithi155 ceph-mon[103467]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T13:23:49.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:49 smithi155 ceph-mon[103467]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:23:49.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:49.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:49 smithi155 ceph-mon[103467]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:49.793 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi187 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.287 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.288 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi187 to 5722M 2023-10-08T13:23:50.288 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.288 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:50.288 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:50.288 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:23:50.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:23:50.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi187 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi187 to 5722M 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:50.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi187 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi187 to 5722M 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:23:50.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:23:50.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 -- 172.21.15.139:0/3129539955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54300ff750 msgr2=0x7f54300ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:50.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 --2- 172.21.15.139:0/3129539955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54300ff750 0x7f54300ffbd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f542c009990 tx=0x7f542c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 -- 172.21.15.139:0/3129539955 shutdown_connections 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 --2- 172.21.15.139:0/3129539955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430100110 0x7f543010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 --2- 172.21.15.139:0/3129539955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54301056b0 0x7f5430105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 --2- 172.21.15.139:0/3129539955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54300ff750 0x7f54300ffbd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 -- 172.21.15.139:0/3129539955 >> 172.21.15.139:0/3129539955 conn(0x7f5430075790 msgr2=0x7f5430075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 -- 172.21.15.139:0/3129539955 shutdown_connections 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.965+0000 7f54381b4700 1 -- 172.21.15.139:0/3129539955 wait complete. 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 Processor -- start 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 -- start start 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 0x7f5430197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:50.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 0x7f54301a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5430198810 con 0x7f5430100110 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301a2fd0 con 0x7f54300ff750 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f54381b4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54301a3110 con 0x7f54301056b0 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f543574f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f543574f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37538/0 (socket says 172.21.15.139:37538) 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f543574f700 1 -- 172.21.15.139:0/2045995554 learned_addr learned my addr 172.21.15.139:0/2045995554 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.966+0000 7f5435f50700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 0x7f5430197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5436751700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 0x7f54301a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 -- 172.21.15.139:0/2045995554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 msgr2=0x7f54301a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:50.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 0x7f54301a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 -- 172.21.15.139:0/2045995554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 msgr2=0x7f5430197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 0x7f5430197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 -- 172.21.15.139:0/2045995554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0095f0 con 0x7f5430100110 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5435f50700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 0x7f5430197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5436751700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 0x7f54301a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f543574f700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f542c000c00 tx=0x7f542c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c01d070 con 0x7f5430100110 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f542c00fde0 con 0x7f5430100110 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54301a3330 con 0x7f5430100110 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c017770 con 0x7f5430100110 2023-10-08T13:23:50.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.967+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54301a3740 con 0x7f5430100110 2023-10-08T13:23:50.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.968+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430107cd0 con 0x7f5430100110 2023-10-08T13:23:50.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.969+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f542c022aa0 con 0x7f5430100110 2023-10-08T13:23:50.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.970+0000 7f5426ffd700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 0x7f541c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:23:50.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.970+0000 7f5435f50700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 0x7f541c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:23:50.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.970+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f542c0cdb70 con 0x7f5430100110 2023-10-08T13:23:50.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.970+0000 7f5435f50700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 0x7f541c0a3990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5420005fd0 tx=0x7f542000a5e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:23:50.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:50.973+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f542c097b20 con 0x7f5430100110 2023-10-08T13:23:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:23:51.172+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5430068750 con 0x7f541c0a14d0 2023-10-08T13:23:51.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:23:51.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:23:51.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] boot 2023-10-08T13:23:51.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:23:51.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:23:51.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:51 smithi139 ceph-mon[99506]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] boot 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:23:51.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:23:51.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:51 smithi187 ceph-mon[104336]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: osd.8 [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] boot 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: osdmap e58: 9 total, 9 up, 9 in 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T13:23:51.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:51 smithi155 ceph-mon[103467]: pgmap v158: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T13:23:52.295 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:52 smithi139 ceph-mon[99506]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:52.295 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:52.295 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:52.295 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:52.295 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:52 smithi139 ceph-mon[99506]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:23:52.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:52 smithi187 ceph-mon[104336]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:52.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:52.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:52.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:52.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:52 smithi187 ceph-mon[104336]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:23:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:52 smithi155 ceph-mon[103467]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:23:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:23:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:23:52.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:23:52.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:52 smithi155 ceph-mon[103467]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T13:23:53.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:53 smithi139 ceph-mon[99506]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:23:53.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:53 smithi139 ceph-mon[99506]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:53.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:53 smithi187 ceph-mon[104336]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:23:53.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:53 smithi187 ceph-mon[104336]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:53.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:53 smithi155 ceph-mon[103467]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T13:23:53.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:53 smithi155 ceph-mon[103467]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:54.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:23:54.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]: dispatch 2023-10-08T13:23:54.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]': finished 2023-10-08T13:23:54.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:23:54.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:23:54.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3313284242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:54.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:23:54.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]: dispatch 2023-10-08T13:23:54.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]': finished 2023-10-08T13:23:54.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:23:54.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:23:54.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3313284242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:54.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T13:23:54.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]: dispatch 2023-10-08T13:23:54.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2746639897' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b3fbe3-9a87-4a39-b045-3d243900ce93"}]': finished 2023-10-08T13:23:54.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: osdmap e63: 10 total, 9 up, 10 in 2023-10-08T13:23:54.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:23:54.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3313284242' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:23:55.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:55 smithi139 ceph-mon[99506]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:55.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:55 smithi187 ceph-mon[104336]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:55.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:55 smithi155 ceph-mon[103467]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:23:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:57 smithi139 ceph-mon[99506]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:23:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:57 smithi187 ceph-mon[104336]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:23:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:57 smithi155 ceph-mon[103467]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2023-10-08T13:23:59.914 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:23:59 smithi139 ceph-mon[99506]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:23:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:23:59 smithi187 ceph-mon[104336]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:24:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:23:59 smithi155 ceph-mon[103467]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-10-08T13:24:00.891 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:00 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:24:00.891 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:00 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:00 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:24:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:00 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:00 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T13:24:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:00 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:01 smithi139 ceph-mon[99506]: Deploying daemon osd.9 on smithi139 2023-10-08T13:24:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:01 smithi139 ceph-mon[99506]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:01 smithi187 ceph-mon[104336]: Deploying daemon osd.9 on smithi139 2023-10-08T13:24:01.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:01 smithi187 ceph-mon[104336]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:01 smithi155 ceph-mon[103467]: Deploying daemon osd.9 on smithi139 2023-10-08T13:24:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:01 smithi155 ceph-mon[103467]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:03.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:03 smithi139 ceph-mon[99506]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T13:24:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:03 smithi187 ceph-mon[104336]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T13:24:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:03 smithi155 ceph-mon[103467]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-10-08T13:24:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:05 smithi139 ceph-mon[99506]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T13:24:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:05 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:05 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:05 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:05 smithi187 ceph-mon[104336]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T13:24:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:05 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:05 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:05 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:05 smithi155 ceph-mon[103467]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2023-10-08T13:24:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:05 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:05 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:05 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:07.674 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.673+0000 7f5426ffd700 1 -- 172.21.15.139:0/2045995554 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5430068750 con 0x7f541c0a14d0 2023-10-08T13:24:07.675 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 9 on host 'smithi139' 2023-10-08T13:24:07.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 msgr2=0x7f541c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:07.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 0x7f541c0a3990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5420005fd0 tx=0x7f542000a5e0 comp rx=0 tx=0).stop 2023-10-08T13:24:07.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 msgr2=0x7f5430197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:07.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f542c000c00 tx=0x7f542c00f880 comp rx=0 tx=0).stop 2023-10-08T13:24:07.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 shutdown_connections 2023-10-08T13:24:07.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f541c0a14d0 0x7f541c0a3990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54301056b0 0x7f54301a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54300ff750 0x7f5430197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 --2- 172.21.15.139:0/2045995554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5430100110 0x7f5430197f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.675+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 >> 172.21.15.139:0/2045995554 conn(0x7f5430075790 msgr2=0x7f54300fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.676+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 shutdown_connections 2023-10-08T13:24:07.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:07.676+0000 7f54381b4700 1 -- 172.21.15.139:0/2045995554 wait complete. 2023-10-08T13:24:08.101 DEBUG:teuthology.orchestra.run.smithi139:osd.9> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-08T13:24:08.104 INFO:tasks.cephadm:Deploying osd.10 on smithi155 with /dev/vg_nvme/lv_1... 2023-10-08T13:24:08.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:24:08.137 INFO:journalctl@ceph.osd.9.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:24:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:24:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:24:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T13:24:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:08.679 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:24:09.067 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:24:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:24:08.806+0000 7ff34e271640 -1 osd.9 0 log_to_monitors true 2023-10-08T13:24:09.067 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:08 smithi139 ceph-mon[99506]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:24:09.199 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:08 smithi155 ceph-mon[103467]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:24:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:08 smithi187 ceph-mon[104336]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T13:24:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:09 smithi155 ceph-mon[103467]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:09 smithi155 ceph-mon[103467]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:24:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:09 smithi155 ceph-mon[103467]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:24:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:09 smithi155 ceph-mon[103467]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:24:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:10.137 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:24:10.137 INFO:teuthology.orchestra.run.smithi155.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:24:10.138 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10+0 records in 2023-10-08T13:24:10.138 INFO:teuthology.orchestra.run.smithi155.stderr:10+0 records out 2023-10-08T13:24:10.138 INFO:teuthology.orchestra.run.smithi155.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111377 s, 941 MB/s 2023-10-08T13:24:10.138 INFO:teuthology.orchestra.run.smithi155.stderr:--> Zapping successful for: 2023-10-08T13:24:10.187 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:24:09.903+0000 7ff3438e8700 -1 osd.9 0 waiting for initial osdmap 2023-10-08T13:24:10.187 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:24:09.918+0000 7ff33b6d5700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:24:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-mon[99506]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:10.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-mon[99506]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:24:10.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-mon[99506]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:24:10.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-mon[99506]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:24:10.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:09 smithi187 ceph-mon[104336]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:09 smithi187 ceph-mon[104336]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T13:24:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:09 smithi187 ceph-mon[104336]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T13:24:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:09 smithi187 ceph-mon[104336]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2023-10-08T13:24:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:10.536 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi155:vg_nvme/lv_1 2023-10-08T13:24:11.095 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:24:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:24:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:24:11.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:11.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:24:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:24:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:11.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:11.262 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:11.263 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:11.264 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:11.264 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:24:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi139 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi139 to 4292M 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] boot 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:24:12.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.152 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 -- 172.21.15.155:0/3673865281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841057c0 msgr2=0x7efc84105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 --2- 172.21.15.155:0/3673865281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841057c0 0x7efc84105ba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efc740098f0 tx=0x7efc74009c00 comp rx=0 tx=0).stop 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 -- 172.21.15.155:0/3673865281 shutdown_connections 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 --2- 172.21.15.155:0/3673865281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc84101260 0x7efc8410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 --2- 172.21.15.155:0/3673865281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841057c0 0x7efc84105ba0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 --2- 172.21.15.155:0/3673865281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc841008a0 0x7efc84100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 -- 172.21.15.155:0/3673865281 >> 172.21.15.155:0/3673865281 conn(0x7efc840779e0 msgr2=0x7efc84077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 -- 172.21.15.155:0/3673865281 shutdown_connections 2023-10-08T13:24:12.153 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.151+0000 7efc88954700 1 -- 172.21.15.155:0/3673865281 wait complete. 2023-10-08T13:24:12.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 Processor -- start 2023-10-08T13:24:12.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 -- start start 2023-10-08T13:24:12.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:12.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc84101260 0x7efc84073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:12.155 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 0x7efc84073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841a5060 con 0x7efc841057c0 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841a51d0 con 0x7efc841008a0 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc88954700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc841a5390 con 0x7efc84101260 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45204/0 (socket says 172.21.15.155:45204) 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 -- 172.21.15.155:0/2688185321 learned_addr learned my addr 172.21.15.155:0/2688185321 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc81d9b700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc84101260 0x7efc84073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc82d9d700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 0x7efc84073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 -- 172.21.15.155:0/2688185321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc84101260 msgr2=0x7efc84073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc84101260 0x7efc84073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:12.156 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 -- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 msgr2=0x7efc84073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 0x7efc84073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc8259c700 1 -- 172.21.15.155:0/2688185321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009520 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.152+0000 7efc82d9d700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 0x7efc84073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc8259c700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc74009230 tx=0x7efc7400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7401c070 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc841a5610 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc7400bba0 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc740038e0 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.153+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc841a5a80 con 0x7efc841008a0 2023-10-08T13:24:12.157 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.154+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc84108d80 con 0x7efc841008a0 2023-10-08T13:24:12.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.155+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7efc74020030 con 0x7efc841008a0 2023-10-08T13:24:12.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.155+0000 7efc737fe700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 0x7efc6c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:12.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.155+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6476+0+0 (secure 0 0 0) 0x7efc740cd950 con 0x7efc841008a0 2023-10-08T13:24:12.158 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.155+0000 7efc81d9b700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 0x7efc6c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:12.159 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.156+0000 7efc81d9b700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 0x7efc6c0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc84074220 tx=0x7efc7800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:12.160 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.159+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc74097770 con 0x7efc841008a0 2023-10-08T13:24:12.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi139 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi139 to 4292M 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:12.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] boot 2023-10-08T13:24:12.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:24:12.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:24:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:24:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi139 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi139 to 4292M 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: osd.9 [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] boot 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: osdmap e66: 10 total, 10 up, 10 in 2023-10-08T13:24:12.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T13:24:12.360 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:12.359+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7efc8404e530 con 0x7efc6c0a14d0 2023-10-08T13:24:13.439 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:24:13.440 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:13.440 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:13.440 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:13.440 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:13.440 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:13 smithi155 ceph-mon[103467]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:24:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:13.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:13.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:13 smithi139 ceph-mon[99506]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: from='client.24440 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:13 smithi187 ceph-mon[104336]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/2920316792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]': finished 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:24:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:15.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.155:0/428393484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/2920316792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]': finished 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:24:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:15.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.155:0/428393484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/2920316792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]: dispatch 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1"}]': finished 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: osdmap e68: 11 total, 10 up, 11 in 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.155:0/428393484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:17 smithi139 ceph-mon[99506]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:17 smithi187 ceph-mon[104336]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:17 smithi155 ceph-mon[103467]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:19.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:19 smithi155 ceph-mon[103467]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:19.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:19 smithi139 ceph-mon[99506]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:19 smithi187 ceph-mon[104336]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:21 smithi155 ceph-mon[103467]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:24:21.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:21.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:21 smithi139 ceph-mon[99506]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:21.690 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:24:21.690 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:21 smithi187 ceph-mon[104336]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T13:24:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:22.578 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:22 smithi155 ceph-mon[103467]: Deploying daemon osd.10 on smithi155 2023-10-08T13:24:22.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:22 smithi139 ceph-mon[99506]: Deploying daemon osd.10 on smithi155 2023-10-08T13:24:22.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:22 smithi187 ceph-mon[104336]: Deploying daemon osd.10 on smithi155 2023-10-08T13:24:23.507 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:23 smithi155 ceph-mon[103467]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:23.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:23 smithi139 ceph-mon[99506]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:23.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:23 smithi187 ceph-mon[104336]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:25 smithi139 ceph-mon[99506]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:25 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:25 smithi187 ceph-mon[104336]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:25 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:25 smithi155 ceph-mon[103467]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:26.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:26.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:25 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:27.838 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:27 smithi155 ceph-mon[103467]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:27.867 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 10 on host 'smithi155' 2023-10-08T13:24:27.868 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.867+0000 7efc737fe700 1 -- 172.21.15.155:0/2688185321 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7efc8404e530 con 0x7efc6c0a14d0 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.869+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 msgr2=0x7efc6c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.869+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 0x7efc6c0a3990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc84074220 tx=0x7efc7800b410 comp rx=0 tx=0).stop 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.869+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 msgr2=0x7efc84072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.869+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc74009230 tx=0x7efc7400fa00 comp rx=0 tx=0).stop 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.869+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 shutdown_connections 2023-10-08T13:24:27.870 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efc6c0a14d0 0x7efc6c0a3990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc841057c0 0x7efc84073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc841008a0 0x7efc84072af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 --2- 172.21.15.155:0/2688185321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc84101260 0x7efc84073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 >> 172.21.15.155:0/2688185321 conn(0x7efc840779e0 msgr2=0x7efc840fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 shutdown_connections 2023-10-08T13:24:27.871 INFO:teuthology.orchestra.run.smithi155.stderr:2023-10-08T13:24:27.870+0000 7efc88954700 1 -- 172.21.15.155:0/2688185321 wait complete. 2023-10-08T13:24:27.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:27 smithi139 ceph-mon[99506]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:27 smithi187 ceph-mon[104336]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:28.274 DEBUG:teuthology.orchestra.run.smithi155:osd.10> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-08T13:24:28.277 INFO:tasks.cephadm:Deploying osd.11 on smithi187 with /dev/vg_nvme/lv_1... 2023-10-08T13:24:28.277 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T13:24:28.306 INFO:journalctl@ceph.osd.10.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:24:28.846 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:24:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:28 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.097 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.097 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.098 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.098 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:28 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:28 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:29.553 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:24:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:24:29.278+0000 7ff6e4b7f640 -1 osd.10 0 log_to_monitors true 2023-10-08T13:24:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:29 smithi155 ceph-mon[103467]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:29 smithi155 ceph-mon[103467]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:29 smithi155 ceph-mon[103467]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:29 smithi139 ceph-mon[99506]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:29 smithi139 ceph-mon[99506]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:29 smithi139 ceph-mon[99506]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:29 smithi187 ceph-mon[104336]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:30.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:29 smithi187 ceph-mon[104336]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:29 smithi187 ceph-mon[104336]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T13:24:30.360 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T13:24:30.360 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T13:24:30.360 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-10-08T13:24:30.361 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-10-08T13:24:30.361 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111968 s, 936 MB/s 2023-10-08T13:24:30.361 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-10-08T13:24:30.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi187:vg_nvme/lv_1 2023-10-08T13:24:31.346 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:24:31.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:24:31.042+0000 7ff6da1f6700 -1 osd.10 0 waiting for initial osdmap 2023-10-08T13:24:31.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:24:31.056+0000 7ff6d1fe3700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:24:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:24:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:24:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:31.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:31 smithi155 ceph-mon[103467]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:24:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:24:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:31.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:31 smithi139 ceph-mon[99506]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: from='osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2023-10-08T13:24:31.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:31 smithi187 ceph-mon[104336]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi155 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi155 to 4292M 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi155 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi155 to 4292M 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2023-10-08T13:24:32.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T13:24:32.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi155 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi155 to 4292M 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:32.439 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:32.548 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 -- 172.21.15.187:0/729081835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 msgr2=0x7f72440ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:32.548 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 --2- 172.21.15.187:0/729081835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72440ffb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7234009990 tx=0x7f7234009ca0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.548 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 -- 172.21.15.187:0/729081835 shutdown_connections 2023-10-08T13:24:32.548 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 --2- 172.21.15.187:0/729081835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441000a0 0x7f724410c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 --2- 172.21.15.187:0/729081835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441045b0 0x7f7244104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 --2- 172.21.15.187:0/729081835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72440ffb60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 -- 172.21.15.187:0/729081835 >> 172.21.15.187:0/729081835 conn(0x7f72440766c0 msgr2=0x7f7244076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 -- 172.21.15.187:0/729081835 shutdown_connections 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.545+0000 7f724a199700 1 -- 172.21.15.187:0/729081835 wait complete. 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 Processor -- start 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 -- start start 2023-10-08T13:24:32.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441000a0 0x7f7244195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441045b0 0x7f7244196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441a5030 con 0x7f72441045b0 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441a51a0 con 0x7f72441000a0 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f724a199700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72441a5360 con 0x7f72440ff6e0 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:32.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:40722/0 (socket says 172.21.15.187:40722) 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 -- 172.21.15.187:0/2857249359 learned_addr learned my addr 172.21.15.187:0/2857249359 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f7242ffd700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441000a0 0x7f7244195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f7243fff700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441045b0 0x7f7244196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 -- 172.21.15.187:0/2857249359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441000a0 msgr2=0x7f7244195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441000a0 0x7f7244195e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 -- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441045b0 msgr2=0x7f7244196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:32.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441045b0 0x7f7244196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:32.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.546+0000 7f72437fe700 1 -- 172.21.15.187:0/2857249359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340095f0 con 0x7f72440ff6e0 2023-10-08T13:24:32.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f72437fe700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f723800b530 tx=0x7f723800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:32.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238011830 con 0x7f72440ff6e0 2023-10-08T13:24:32.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72441a5640 con 0x7f72440ff6e0 2023-10-08T13:24:32.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7238011e50 con 0x7f72440ff6e0 2023-10-08T13:24:32.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723800f2e0 con 0x7f72440ff6e0 2023-10-08T13:24:32.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.547+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72441a5b40 con 0x7f72440ff6e0 2023-10-08T13:24:32.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.548+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7244107c20 con 0x7f72440ff6e0 2023-10-08T13:24:32.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.549+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f7238010580 con 0x7f72440ff6e0 2023-10-08T13:24:32.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.549+0000 7f7240ff9700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 0x7f722c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:32.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.550+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6942+0+0 (secure 0 0 0) 0x7f72380cc940 con 0x7f72440ff6e0 2023-10-08T13:24:32.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.550+0000 7f7242ffd700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 0x7f722c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:32.556 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.550+0000 7f7242ffd700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 0x7f722c0a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7234006010 tx=0x7f72340036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:32.556 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.553+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7238096460 con 0x7f72440ff6e0 2023-10-08T13:24:32.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:32.749+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7244069000 con 0x7f722c0a14d0 2023-10-08T13:24:33.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:24:33.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] boot 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:33.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:33 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:24:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:24:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] boot 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:33.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:33 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:33.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:24:33.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:24:33.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: osd.10 [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] boot 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: osdmap e71: 11 total, 11 up, 11 in 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T13:24:33.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:33 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:34 smithi187 ceph-mon[104336]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:24:34.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:34 smithi155 ceph-mon[103467]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:24:34.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:34 smithi139 ceph-mon[99506]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T13:24:35.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:35 smithi155 ceph-mon[103467]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:24:35.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:35 smithi155 ceph-mon[103467]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:35.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:35 smithi139 ceph-mon[99506]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:24:35.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:35 smithi139 ceph-mon[99506]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:35.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:35 smithi187 ceph-mon[104336]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T13:24:35.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:35 smithi187 ceph-mon[104336]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:36.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:24:36.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/482996668' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]': finished 2023-10-08T13:24:36.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:24:36.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:36.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:36 smithi155 ceph-mon[103467]: from='client.? 172.21.15.187:0/2731592261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:36.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:24:36.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/482996668' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]': finished 2023-10-08T13:24:36.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:24:36.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:36.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.187:0/2731592261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/482996668' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]: dispatch 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec8bf58f-7d6f-4a86-b95c-8b104705fcaf"}]': finished 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:36.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:36 smithi187 ceph-mon[104336]: from='client.? 172.21.15.187:0/2731592261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T13:24:37.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:37 smithi155 ceph-mon[103467]: pgmap v197: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:24:37.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:37 smithi139 ceph-mon[99506]: pgmap v197: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:24:37.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:37 smithi187 ceph-mon[104336]: pgmap v197: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-10-08T13:24:39.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:39 smithi139 ceph-mon[99506]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2023-10-08T13:24:39.971 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:39 smithi187 ceph-mon[104336]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2023-10-08T13:24:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:39 smithi155 ceph-mon[103467]: pgmap v198: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2023-10-08T13:24:41.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:41 smithi187 ceph-mon[104336]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-08T13:24:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:41 smithi139 ceph-mon[99506]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-08T13:24:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:41 smithi155 ceph-mon[103467]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2023-10-08T13:24:42.450 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:24:42.450 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:42.450 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:42 smithi187 ceph-mon[104336]: Deploying daemon osd.11 on smithi187 2023-10-08T13:24:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:24:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:42 smithi139 ceph-mon[99506]: Deploying daemon osd.11 on smithi187 2023-10-08T13:24:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T13:24:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:42.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:42 smithi155 ceph-mon[103467]: Deploying daemon osd.11 on smithi187 2023-10-08T13:24:43.647 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:43 smithi187 ceph-mon[104336]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:43.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:43 smithi139 ceph-mon[99506]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:43 smithi155 ceph-mon[103467]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T13:24:45.790 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:45 smithi187 ceph-mon[104336]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:45 smithi139 ceph-mon[99506]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:45 smithi155 ceph-mon[103467]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:46.956 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:46.956 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:46.956 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:47 smithi187 ceph-mon[104336]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:47 smithi155 ceph-mon[103467]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:47 smithi139 ceph-mon[99506]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:48.457 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.457+0000 7f7240ff9700 1 -- 172.21.15.187:0/2857249359 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f7244069000 con 0x7f722c0a14d0 2023-10-08T13:24:48.458 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 11 on host 'smithi187' 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 msgr2=0x7f722c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 0x7f722c0a3990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7234006010 tx=0x7f72340036c0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 msgr2=0x7f72441958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f723800b530 tx=0x7f723800b8f0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 shutdown_connections 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f722c0a14d0 0x7f722c0a3990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.460 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72441045b0 0x7f7244196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.461 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72440ff6e0 0x7f72441958e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.461 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 --2- 172.21.15.187:0/2857249359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72441000a0 0x7f7244195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:48.461 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.459+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 >> 172.21.15.187:0/2857249359 conn(0x7f72440766c0 msgr2=0x7f72440fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:48.461 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.460+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 shutdown_connections 2023-10-08T13:24:48.461 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:24:48.460+0000 7f724a199700 1 -- 172.21.15.187:0/2857249359 wait complete. 2023-10-08T13:24:48.835 DEBUG:teuthology.orchestra.run.smithi187:osd.11> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-08T13:24:48.837 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-08T13:24:48.837 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T13:24:48.868 INFO:journalctl@ceph.osd.11.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:24:49.412 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:24:49.597 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.597 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.598 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-mon[104336]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:49.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.690 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.690 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:49 smithi139 ceph-mon[99506]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:49.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:49.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:49 smithi155 ceph-mon[103467]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:49.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:24:49 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:24:49.778+0000 7ffb1beb0640 -1 osd.11 0 log_to_monitors true 2023-10-08T13:24:50.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- 172.21.15.139:0/2591492763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 msgr2=0x7f9f24105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:50.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/2591492763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f24105b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f20009990 tx=0x7f9f20009ca0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- 172.21.15.139:0/2591492763 shutdown_connections 2023-10-08T13:24:50.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/2591492763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f2410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/2591492763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f24105b90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/2591492763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f240ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- 172.21.15.139:0/2591492763 >> 172.21.15.139:0/2591492763 conn(0x7f9f240764a0 msgr2=0x7f9f240768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- 172.21.15.139:0/2591492763 shutdown_connections 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- 172.21.15.139:0/2591492763 wait complete. 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 Processor -- start 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.778+0000 7f9f2bccc700 1 -- start start 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f24197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f241a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:50.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24198890 con 0x7f9f241057b0 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f241a3050 con 0x7f9f24100400 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f241a3190 con 0x7f9f240ffa40 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29a68700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f241a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29a68700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:37414/0 (socket says 172.21.15.139:37414) 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29a68700 1 -- 172.21.15.139:0/1377613433 learned_addr learned my addr 172.21.15.139:0/1377613433 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29267700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f24197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 -- 172.21.15.139:0/1377613433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 msgr2=0x7f9f24197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 -- 172.21.15.139:0/1377613433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 msgr2=0x7f9f24197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f24197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 -- 172.21.15.139:0/1377613433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200095f0 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29a68700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f29267700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f24197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2a269700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f241a2b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00be20 tx=0x7f9f1c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00cc10 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f1c00cd70 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f241a3410 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0126c0 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.779+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f241a38c0 con 0x7f9f241057b0 2023-10-08T13:24:50.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.780+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24107c60 con 0x7f9f241057b0 2023-10-08T13:24:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.782+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9f1c012820 con 0x7f9f241057b0 2023-10-08T13:24:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.782+0000 7f9f1affd700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 0x7f9f100a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.782+0000 7f9f29a68700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 0x7f9f100a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.782+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7046+0+0 (secure 0 0 0) 0x7f9f1c006e40 con 0x7f9f241057b0 2023-10-08T13:24:50.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.782+0000 7f9f29a68700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 0x7f9f100a3990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000b5c0 tx=0x7f9f2001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:50.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.786+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f1c096150 con 0x7f9f241057b0 2023-10-08T13:24:50.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:50 smithi155 ceph-mon[103467]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:50 smithi155 ceph-mon[103467]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:50 smithi139 ceph-mon[99506]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:50 smithi139 ceph-mon[99506]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:50 smithi187 ceph-mon[104336]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:50 smithi187 ceph-mon[104336]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T13:24:50.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.977+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9f24069420 con 0x7f9f241057b0 2023-10-08T13:24:50.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.977+0000 7f9f1affd700 1 -- 172.21.15.139:0/1377613433 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9f1c099770 con 0x7f9f241057b0 2023-10-08T13:24:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 msgr2=0x7f9f100a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 0x7f9f100a3990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000b5c0 tx=0x7f9f2001a040 comp rx=0 tx=0).stop 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 msgr2=0x7f9f241a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f241a2b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00be20 tx=0x7f9f1c009ed0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 shutdown_connections 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9f100a14d0 0x7f9f100a3990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f241057b0 0x7f9f241a2b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f240ffa40 0x7f9f24197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 --2- 172.21.15.139:0/1377613433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f24100400 0x7f9f24197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:50.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 >> 172.21.15.139:0/1377613433 conn(0x7f9f240764a0 msgr2=0x7f9f240fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:50.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 shutdown_connections 2023-10-08T13:24:50.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:50.980+0000 7f9f2bccc700 1 -- 172.21.15.139:0/1377613433 wait complete. 2023-10-08T13:24:51.355 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1696771472,"num_in_osds":12,"osd_in_since":1696771475,"num_remapped_pgs":0} 2023-10-08T13:24:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:24:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:24:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1377613433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:51.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:51.689 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.726 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:24:51.503+0000 7ffb11527700 -1 osd.11 0 waiting for initial osdmap 2023-10-08T13:24:51.726 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:24:51.518+0000 7ffb09b15700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T13:24:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1377613433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:51.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T13:24:51.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T13:24:51.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1377613433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:51.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:52.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: Detected new or changed devices on smithi187 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi187 to 4292M 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:52.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:52.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:52.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:52.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: Detected new or changed devices on smithi187 2023-10-08T13:24:52.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi187 to 4292M 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:52.927 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:24:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: Detected new or changed devices on smithi187 2023-10-08T13:24:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi187 to 4292M 2023-10-08T13:24:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-10-08T13:24:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T13:24:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:24:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:24:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:24:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:24:53.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: purged_snaps scrub starts 2023-10-08T13:24:53.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: purged_snaps scrub ok 2023-10-08T13:24:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] boot 2023-10-08T13:24:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:24:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:53 smithi155 ceph-mon[103467]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:53.923 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: purged_snaps scrub starts 2023-10-08T13:24:53.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: purged_snaps scrub ok 2023-10-08T13:24:53.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] boot 2023-10-08T13:24:53.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:24:53.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:53.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:53 smithi139 ceph-mon[99506]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: purged_snaps scrub starts 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: purged_snaps scrub ok 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: osd.11 [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] boot 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: osdmap e78: 12 total, 12 up, 12 in 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T13:24:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:53 smithi187 ceph-mon[104336]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 -- 172.21.15.139:0/2948273621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc284068b30 msgr2=0x7fc28410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 --2- 172.21.15.139:0/2948273621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc284068b30 0x7fc28410d670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b0a0 tx=0x7fc27c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 -- 172.21.15.139:0/2948273621 shutdown_connections 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 --2- 172.21.15.139:0/2948273621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc284068b30 0x7fc28410d670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 --2- 172.21.15.139:0/2948273621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2841067a0 0x7fc284106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 --2- 172.21.15.139:0/2948273621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 0x7fc2840685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 -- 172.21.15.139:0/2948273621 >> 172.21.15.139:0/2948273621 conn(0x7fc284075790 msgr2=0x7fc284075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 -- 172.21.15.139:0/2948273621 shutdown_connections 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 -- 172.21.15.139:0/2948273621 wait complete. 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.137+0000 7fc289eba700 1 Processor -- start 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 -- start start 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 0x7fc284198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 0x7fc2841993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419dd90 con 0x7fc2841067a0 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419df00 con 0x7fc284068b30 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc289eba700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419e0c0 con 0x7fc284068190 2023-10-08T13:24:54.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37720/0 (socket says 172.21.15.139:37720) 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 -- 172.21.15.139:0/3728778457 learned_addr learned my addr 172.21.15.139:0/3728778457 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc2837fe700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 0x7fc284198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc282ffd700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 0x7fc2841993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 -- 172.21.15.139:0/3728778457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 msgr2=0x7fc284198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 0x7fc284198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 -- 172.21.15.139:0/3728778457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 msgr2=0x7fc2841993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 0x7fc2841993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 -- 172.21.15.139:0/3728778457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c009d00 con 0x7fc2841067a0 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc282ffd700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 0x7fc2841993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:24:54.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.138+0000 7fc283fff700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b070 tx=0x7fc27c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:54.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.139+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00e040 con 0x7fc2841067a0 2023-10-08T13:24:54.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.139+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc27c009440 con 0x7fc2841067a0 2023-10-08T13:24:54.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.139+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28419e340 con 0x7fc2841067a0 2023-10-08T13:24:54.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.139+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c01b450 con 0x7fc2841067a0 2023-10-08T13:24:54.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.139+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2841a5c00 con 0x7fc2841067a0 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.140+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284101ee0 con 0x7fc2841067a0 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.141+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc27c004cf0 con 0x7fc2841067a0 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.141+0000 7fc280ff9700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 0x7fc2700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.141+0000 7fc2837fe700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 0x7fc2700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.141+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc27c0ce5f0 con 0x7fc2841067a0 2023-10-08T13:24:54.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.142+0000 7fc2837fe700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 0x7fc2700a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00abd0 tx=0x7fc26c00a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:54.145 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.145+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc27c0980b0 con 0x7fc2841067a0 2023-10-08T13:24:54.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.336+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc28419a1a0 con 0x7fc2841067a0 2023-10-08T13:24:54.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.336+0000 7fc280ff9700 1 -- 172.21.15.139:0/3728778457 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7fc27c011390 con 0x7fc2841067a0 2023-10-08T13:24:54.337 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:24:54.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 msgr2=0x7fc2700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:54.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 0x7fc2700a3990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00abd0 tx=0x7fc26c00a380 comp rx=0 tx=0).stop 2023-10-08T13:24:54.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 msgr2=0x7fc28419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b070 tx=0x7fc27c007870 comp rx=0 tx=0).stop 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 shutdown_connections 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc2700a14d0 0x7fc2700a3990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2841067a0 0x7fc28419d780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc284068190 0x7fc284198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 --2- 172.21.15.139:0/3728778457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc284068b30 0x7fc2841993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 >> 172.21.15.139:0/3728778457 conn(0x7fc284075790 msgr2=0x7fc2840fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 shutdown_connections 2023-10-08T13:24:54.340 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:54.338+0000 7fc289eba700 1 -- 172.21.15.139:0/3728778457 wait complete. 2023-10-08T13:24:54.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:54 smithi139 ceph-mon[99506]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:24:54.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3728778457' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:54.784 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1696771492,"num_in_osds":12,"osd_in_since":1696771475,"num_remapped_pgs":0} 2023-10-08T13:24:54.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:24:54.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:54 smithi155 ceph-mon[103467]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:24:54.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3728778457' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:54 smithi187 ceph-mon[104336]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T13:24:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3728778457' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T13:24:55.343 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:24:55.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:55 smithi155 ceph-mon[103467]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:55.883 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:55 smithi139 ceph-mon[99506]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:55 smithi187 ceph-mon[104336]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 -- 172.21.15.139:0/1764015897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9401056b0 msgr2=0x7fe940105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1764015897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9401056b0 0x7fe940105a90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe930009990 tx=0x7fe930009ca0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 -- 172.21.15.139:0/1764015897 shutdown_connections 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1764015897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe940100110 0x7fe94010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1764015897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9401056b0 0x7fe940105a90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1764015897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9400ff750 0x7fe9400ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.676+0000 7fe9484f9700 1 -- 172.21.15.139:0/1764015897 >> 172.21.15.139:0/1764015897 conn(0x7fe940075790 msgr2=0x7fe940075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:56.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.677+0000 7fe9484f9700 1 -- 172.21.15.139:0/1764015897 shutdown_connections 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.677+0000 7fe9484f9700 1 -- 172.21.15.139:0/1764015897 wait complete. 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.677+0000 7fe9484f9700 1 Processor -- start 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.677+0000 7fe9484f9700 1 -- start start 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe940100110 0x7fe94019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 0x7fe940196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940197270 con 0x7fe9400ff750 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401973e0 con 0x7fe940100110 2023-10-08T13:24:56.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401975a0 con 0x7fe9401056b0 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37738/0 (socket says 172.21.15.139:37738) 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 -- 172.21.15.139:0/1500307031 learned_addr learned my addr 172.21.15.139:0/1500307031 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe945a94700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe940100110 0x7fe94019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946a96700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 0x7fe940196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 -- 172.21.15.139:0/1500307031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 msgr2=0x7fe940196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 0x7fe940196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 -- 172.21.15.139:0/1500307031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe940100110 msgr2=0x7fe94019cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:56.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe940100110 0x7fe94019cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 -- 172.21.15.139:0/1500307031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9300095f0 con 0x7fe9400ff750 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946a96700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 0x7fe940196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe946295700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9300098e0 tx=0x7fe93000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93001d070 con 0x7fe9400ff750 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe930022470 con 0x7fe9400ff750 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe940197820 con 0x7fe9400ff750 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930017650 con 0x7fe9400ff750 2023-10-08T13:24:56.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.678+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9401a3990 con 0x7fe9400ff750 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.679+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940107cb0 con 0x7fe9400ff750 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.680+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fe9300225e0 con 0x7fe9400ff750 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.681+0000 7fe9377fe700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 0x7fe92c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.681+0000 7fe945a94700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 0x7fe92c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.681+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fe9300cd9b0 con 0x7fe9400ff750 2023-10-08T13:24:56.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.681+0000 7fe945a94700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 0x7fe92c0a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe940198230 tx=0x7fe93c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:56.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.685+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe930097470 con 0x7fe9400ff750 2023-10-08T13:24:56.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.873+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe940197fa0 con 0x7fe9400ff750 2023-10-08T13:24:56.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.875+0000 7fe9377fe700 1 -- 172.21.15.139:0/1500307031 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18764 (secure 0 0 0) 0x7fe93009aa90 con 0x7fe9400ff750 2023-10-08T13:24:56.876 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:24:56.876 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":79,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:24:53.504638+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 msgr2=0x7fe92c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 0x7fe92c0a3a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe940198230 tx=0x7fe93c00b410 comp rx=0 tx=0).stop 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 msgr2=0x7fe94019ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe9300098e0 tx=0x7fe93000f670 comp rx=0 tx=0).stop 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 shutdown_connections 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe92c0a1550 0x7fe92c0a3a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9401056b0 0x7fe940196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9400ff750 0x7fe94019ca10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 --2- 172.21.15.139:0/1500307031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe940100110 0x7fe94019cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:56.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 >> 172.21.15.139:0/1500307031 conn(0x7fe940075790 msgr2=0x7fe9400fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:56.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 shutdown_connections 2023-10-08T13:24:56.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:56.877+0000 7fe9484f9700 1 -- 172.21.15.139:0/1500307031 wait complete. 2023-10-08T13:24:57.198 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:24:57.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-08T13:24:57.756 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:24:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:57 smithi139 ceph-mon[99506]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:57 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1500307031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:24:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:57 smithi187 ceph-mon[104336]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:57 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1500307031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:24:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:57 smithi155 ceph-mon[103467]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:57 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1500307031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 -- 172.21.15.139:0/2432943349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89501056b0 msgr2=0x7f8950105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 --2- 172.21.15.139:0/2432943349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89501056b0 0x7f8950105a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8940009990 tx=0x7f8940009ca0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 -- 172.21.15.139:0/2432943349 shutdown_connections 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 --2- 172.21.15.139:0/2432943349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8950100110 0x7f895010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 --2- 172.21.15.139:0/2432943349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f89501056b0 0x7f8950105a90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 --2- 172.21.15.139:0/2432943349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89500ff750 0x7f89500ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 -- 172.21.15.139:0/2432943349 >> 172.21.15.139:0/2432943349 conn(0x7f8950075790 msgr2=0x7f8950075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 -- 172.21.15.139:0/2432943349 shutdown_connections 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.078+0000 7f8954ea2700 1 -- 172.21.15.139:0/2432943349 wait complete. 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 Processor -- start 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 -- start start 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89500ff750 0x7f895019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 0x7f8950195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89501960c0 con 0x7f8950100110 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950196230 con 0x7f89500ff750 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f8954ea2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89501963f0 con 0x7f89501056b0 2023-10-08T13:24:59.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37750/0 (socket says 172.21.15.139:37750) 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 -- 172.21.15.139:0/1700269386 learned_addr learned my addr 172.21.15.139:0/1700269386 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894ed9d700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 0x7f8950195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894e59c700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89500ff750 0x7f895019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 -- 172.21.15.139:0/1700269386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 msgr2=0x7f8950195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 0x7f8950195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 -- 172.21.15.139:0/1700269386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89500ff750 msgr2=0x7f895019b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89500ff750 0x7f895019b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894dd9b700 1 -- 172.21.15.139:0/1700269386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400095f0 con 0x7f8950100110 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.079+0000 7f894ed9d700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 0x7f8950195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f894dd9b700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f894400b530 tx=0x7f894400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:59.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011830 con 0x7f8950100110 2023-10-08T13:24:59.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8944011e50 con 0x7f8950100110 2023-10-08T13:24:59.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89501966d0 con 0x7f8950100110 2023-10-08T13:24:59.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400f2e0 con 0x7f8950100110 2023-10-08T13:24:59.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.080+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89501a28c0 con 0x7f8950100110 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.081+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8950107c40 con 0x7f8950100110 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.083+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f8944010580 con 0x7f8950100110 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.083+0000 7f893f7fe700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 0x7f89380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.083+0000 7f894e59c700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 0x7f89380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.083+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f89440cca30 con 0x7f8950100110 2023-10-08T13:24:59.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.084+0000 7f894e59c700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 0x7f89380a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8940006010 tx=0x7f894000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:24:59.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.087+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8944096460 con 0x7f8950100110 2023-10-08T13:24:59.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.275+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8950196ed0 con 0x7f8950100110 2023-10-08T13:24:59.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.275+0000 7f893f7fe700 1 -- 172.21.15.139:0/1700269386 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8944099a80 con 0x7f8950100110 2023-10-08T13:24:59.277 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 msgr2=0x7f89380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 0x7f89380a3990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8940006010 tx=0x7f894000b540 comp rx=0 tx=0).stop 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 msgr2=0x7f895019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f894400b530 tx=0x7f894400b8f0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 shutdown_connections 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89380a14d0 0x7f89380a3990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89501056b0 0x7f8950195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89500ff750 0x7f895019b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 --2- 172.21.15.139:0/1700269386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8950100110 0x7f895019be10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:24:59.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 >> 172.21.15.139:0/1700269386 conn(0x7f8950075790 msgr2=0x7f89500fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:24:59.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 shutdown_connections 2023-10-08T13:24:59.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:24:59.278+0000 7f8954ea2700 1 -- 172.21.15.139:0/1700269386 wait complete. 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.a on smithi139 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.d on smithi139 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.g on smithi139 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.j on smithi139 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.b on smithi155 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.e on smithi155 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.h on smithi155 2023-10-08T13:24:59.600 INFO:tasks.cephadm:Adding mds.k on smithi155 2023-10-08T13:24:59.601 INFO:tasks.cephadm:Adding mds.c on smithi187 2023-10-08T13:24:59.601 INFO:tasks.cephadm:Adding mds.f on smithi187 2023-10-08T13:24:59.601 INFO:tasks.cephadm:Adding mds.i on smithi187 2023-10-08T13:24:59.601 INFO:tasks.cephadm:Adding mds.l on smithi187 2023-10-08T13:24:59.601 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l' 2023-10-08T13:24:59.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:59 smithi139 ceph-mon[99506]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:59.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:24:59 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1700269386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:24:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:59 smithi187 ceph-mon[104336]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:24:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:24:59 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1700269386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:59 smithi155 ceph-mon[103467]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:00.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:24:59 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1700269386' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:00.177 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:25:01.362 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 -- 172.21.15.187:0/960798270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d01056b0 msgr2=0x7f14d0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 --2- 172.21.15.187:0/960798270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d01056b0 0x7f14d0105a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009990 tx=0x7f14cc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 -- 172.21.15.187:0/960798270 shutdown_connections 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 --2- 172.21.15.187:0/960798270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d0100110 0x7f14d010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 --2- 172.21.15.187:0/960798270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d01056b0 0x7f14d0105a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 --2- 172.21.15.187:0/960798270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00ff750 0x7f14d00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 -- 172.21.15.187:0/960798270 >> 172.21.15.187:0/960798270 conn(0x7f14d0075790 msgr2=0x7f14d0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 -- 172.21.15.187:0/960798270 shutdown_connections 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 -- 172.21.15.187:0/960798270 wait complete. 2023-10-08T13:25:01.363 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.361+0000 7f14d7da4700 1 Processor -- start 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 -- start start 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0100110 0x7f14d0197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d01056b0 0x7f14d01a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d0198850 con 0x7f14d01056b0 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d01a3010 con 0x7f14d0100110 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d7da4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d01a3150 con 0x7f14d00ff750 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:01.364 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:40850/0 (socket says 172.21.15.187:40850) 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 -- 172.21.15.187:0/1839469823 learned_addr learned my addr 172.21.15.187:0/1839469823 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d533f700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0100110 0x7f14d0197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d6341700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d01056b0 0x7f14d01a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 -- 172.21.15.187:0/1839469823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0100110 msgr2=0x7f14d0197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0100110 0x7f14d0197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 -- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d01056b0 msgr2=0x7f14d01a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d01056b0 0x7f14d01a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 -- 172.21.15.187:0/1839469823 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0095f0 con 0x7f14d00ff750 2023-10-08T13:25:01.365 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.362+0000 7f14d5b40700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000c00 tx=0x7f14cc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:01.366 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.365+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc01d070 con 0x7f14d00ff750 2023-10-08T13:25:01.366 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.365+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14cc022470 con 0x7f14d00ff750 2023-10-08T13:25:01.366 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.365+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d0195840 con 0x7f14d00ff750 2023-10-08T13:25:01.367 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.365+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc017650 con 0x7f14d00ff750 2023-10-08T13:25:01.367 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.365+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d0195d30 con 0x7f14d00ff750 2023-10-08T13:25:01.367 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.366+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d0107cb0 con 0x7f14d00ff750 2023-10-08T13:25:01.367 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.367+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f14cc0225e0 con 0x7f14d00ff750 2023-10-08T13:25:01.368 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.367+0000 7f14c6ffd700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 0x7f14bc0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:01.368 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.367+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f14cc0cdaa0 con 0x7f14d00ff750 2023-10-08T13:25:01.368 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.368+0000 7f14d533f700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 0x7f14bc0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:01.368 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.368+0000 7f14d533f700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 0x7f14bc0a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14d00689a0 tx=0x7f14c0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:01.372 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.372+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f14cc097560 con 0x7f14d00ff750 2023-10-08T13:25:01.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:01 smithi187 ceph-mon[104336]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:01.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.569+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f14d0068750 con 0x7f14bc0a1550 2023-10-08T13:25:01.577 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.577+0000 7f14c6ffd700 1 -- 172.21.15.187:0/1839469823 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f14d0068750 con 0x7f14bc0a1550 2023-10-08T13:25:01.578 INFO:teuthology.orchestra.run.smithi187.stdout:Scheduled mds.all update... 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 msgr2=0x7f14bc0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 0x7f14bc0a3a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14d00689a0 tx=0x7f14c0009260 comp rx=0 tx=0).stop 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 msgr2=0x7f14d0197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000c00 tx=0x7f14cc004730 comp rx=0 tx=0).stop 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 shutdown_connections 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.579+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14bc0a1550 0x7f14bc0a3a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14d01056b0 0x7f14d01a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14d00ff750 0x7f14d0197a50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 --2- 172.21.15.187:0/1839469823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0100110 0x7f14d0197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:01.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 >> 172.21.15.187:0/1839469823 conn(0x7f14d0075790 msgr2=0x7f14d00fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:01.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 shutdown_connections 2023-10-08T13:25:01.581 INFO:teuthology.orchestra.run.smithi187.stderr:2023-10-08T13:25:01.580+0000 7f14d7da4700 1 -- 172.21.15.187:0/1839469823 wait complete. 2023-10-08T13:25:01.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:01 smithi139 ceph-mon[99506]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:01 smithi155 ceph-mon[103467]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:02.140 DEBUG:teuthology.orchestra.run.smithi139:mds.a> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-08T13:25:02.143 DEBUG:teuthology.orchestra.run.smithi139:mds.d> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-08T13:25:02.180 INFO:journalctl@ceph.mds.a.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:25:02.181 DEBUG:teuthology.orchestra.run.smithi139:mds.g> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-08T13:25:02.210 INFO:journalctl@ceph.mds.d.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:25:02.211 DEBUG:teuthology.orchestra.run.smithi139:mds.j> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-08T13:25:02.238 INFO:journalctl@ceph.mds.g.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:25:02.239 DEBUG:teuthology.orchestra.run.smithi155:mds.b> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-08T13:25:02.243 DEBUG:teuthology.orchestra.run.smithi155:mds.e> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-08T13:25:02.265 INFO:journalctl@ceph.mds.j.smithi139.stdout:-- Logs begin at Sun 2023-10-08 13:03:59 UTC. -- 2023-10-08T13:25:02.280 INFO:journalctl@ceph.mds.b.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:25:02.281 DEBUG:teuthology.orchestra.run.smithi155:mds.h> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-08T13:25:02.310 INFO:journalctl@ceph.mds.e.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:25:02.311 DEBUG:teuthology.orchestra.run.smithi155:mds.k> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-08T13:25:02.338 INFO:journalctl@ceph.mds.h.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:25:02.339 DEBUG:teuthology.orchestra.run.smithi187:mds.c> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-08T13:25:02.341 DEBUG:teuthology.orchestra.run.smithi187:mds.f> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-08T13:25:02.365 INFO:journalctl@ceph.mds.k.smithi155.stdout:-- Logs begin at Sun 2023-10-08 13:04:18 UTC. -- 2023-10-08T13:25:02.370 INFO:journalctl@ceph.mds.c.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:25:02.372 DEBUG:teuthology.orchestra.run.smithi187:mds.i> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-08T13:25:02.397 INFO:journalctl@ceph.mds.f.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:25:02.398 DEBUG:teuthology.orchestra.run.smithi187:mds.l> sudo journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-08T13:25:02.424 INFO:journalctl@ceph.mds.i.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:25:02.425 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-08T13:25:02.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:02.451 INFO:journalctl@ceph.mds.l.smithi187.stdout:-- Logs begin at Sun 2023-10-08 13:04:00 UTC. -- 2023-10-08T13:25:02.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- 172.21.15.139:0/2433927073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a80ff550 msgr2=0x7fb8a80ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/2433927073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a80ff550 0x7fb8a80ff9d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8940099c0 tx=0x7fb894009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- 172.21.15.139:0/2433927073 shutdown_connections 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/2433927073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80fff10 0x7fb8a810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/2433927073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a8105610 0x7fb8a81059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/2433927073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a80ff550 0x7fb8a80ff9d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- 172.21.15.139:0/2433927073 >> 172.21.15.139:0/2433927073 conn(0x7fb8a80fb060 msgr2=0x7fb8a80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- 172.21.15.139:0/2433927073 shutdown_connections 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- 172.21.15.139:0/2433927073 wait complete. 2023-10-08T13:25:02.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 Processor -- start 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.560+0000 7fb8aefdd700 1 -- start start 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 0x7fb8a8197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a80fff10 0x7fb8a8197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8198640 con 0x7fb8a8105610 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81a2e50 con 0x7fb8a80ff550 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81a2f90 con 0x7fb8a80fff10 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37764/0 (socket says 172.21.15.139:37764) 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 -- 172.21.15.139:0/1893480601 learned_addr learned my addr 172.21.15.139:0/1893480601 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:02.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8a7fff700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a80fff10 0x7fb8a8197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8acd79700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 0x7fb8a8197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 -- 172.21.15.139:0/1893480601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a80fff10 msgr2=0x7fb8a8197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a80fff10 0x7fb8a8197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 -- 172.21.15.139:0/1893480601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 msgr2=0x7fb8a8197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 0x7fb8a8197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 -- 172.21.15.139:0/1893480601 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940095f0 con 0x7fb8a8105610 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8acd79700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 0x7fb8a8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8ad57a700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0007ee0 tx=0x7fb8a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0017070 con 0x7fb8a8105610 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a000f040 con 0x7fb8a8105610 2023-10-08T13:25:02.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a81a3220 con 0x7fb8a8105610 2023-10-08T13:25:02.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.561+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0005740 con 0x7fb8a8105610 2023-10-08T13:25:02.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.562+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81a36b0 con 0x7fb8a8105610 2023-10-08T13:25:02.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.562+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a8107ab0 con 0x7fb8a8105610 2023-10-08T13:25:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.563+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb8a000dc60 con 0x7fb8a8105610 2023-10-08T13:25:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.564+0000 7fb8a5ffb700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 0x7fb8980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.564+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb8a00cc1c0 con 0x7fb8a8105610 2023-10-08T13:25:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.564+0000 7fb8acd79700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 0x7fb8980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.564+0000 7fb8acd79700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 0x7fb8980a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005950 tx=0x7fb89c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:02.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.568+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb8a0095bf0 con 0x7fb8a8105610 2023-10-08T13:25:02.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:25:02.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: Saving service mds.all spec with placement smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2023-10-08T13:25:02.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:02.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:02 smithi187 ceph-mon[104336]: Deploying daemon mds.l on smithi187 2023-10-08T13:25:02.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.763+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8a80691d0 con 0x7fb8a8105610 2023-10-08T13:25:02.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.764+0000 7fb8a5ffb700 1 -- 172.21.15.139:0/1893480601 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18764 (secure 0 0 0) 0x7fb8a0099210 con 0x7fb8a8105610 2023-10-08T13:25:02.766 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:02.767 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":79,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:24:53.504638+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 msgr2=0x7fb8980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 0x7fb8980a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005950 tx=0x7fb89c0058e0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 msgr2=0x7fb8a81a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0007ee0 tx=0x7fb8a000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 shutdown_connections 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb8980a14d0 0x7fb8980a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8a8105610 0x7fb8a81a2910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8a80ff550 0x7fb8a8197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 --2- 172.21.15.139:0/1893480601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a80fff10 0x7fb8a8197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 >> 172.21.15.139:0/1893480601 conn(0x7fb8a80fb060 msgr2=0x7fb8a80fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:02.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 shutdown_connections 2023-10-08T13:25:02.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.767+0000 7fb8aefdd700 1 -- 172.21.15.139:0/1893480601 wait complete. 2023-10-08T13:25:02.779 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:25:02.779 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: Saving service mds.all spec with placement smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:02 smithi139 ceph-mon[99506]: Deploying daemon mds.l on smithi187 2023-10-08T13:25:02.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:25:02.782 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:25:02.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: Saving service mds.all spec with placement smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:02.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:02.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:02.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:02.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:02.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:02 smithi155 ceph-mon[103467]: Deploying daemon mds.l on smithi187 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 -- 172.21.15.139:0/3242371388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 msgr2=0x7f93b410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 --2- 172.21.15.139:0/3242371388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b410d590 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00b0d0 tx=0x7f93ac00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 -- 172.21.15.139:0/3242371388 shutdown_connections 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 --2- 172.21.15.139:0/3242371388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b410d590 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 --2- 172.21.15.139:0/3242371388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b4067ce0 0x7f93b40680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 --2- 172.21.15.139:0/3242371388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b41051c0 0x7f93b4105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 -- 172.21.15.139:0/3242371388 >> 172.21.15.139:0/3242371388 conn(0x7f93b4076780 msgr2=0x7f93b4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 -- 172.21.15.139:0/3242371388 shutdown_connections 2023-10-08T13:25:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 -- 172.21.15.139:0/3242371388 wait complete. 2023-10-08T13:25:02.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.904+0000 7f93b9222700 1 Processor -- start 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 -- start start 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b4067ce0 0x7f93b419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b41051c0 0x7f93b419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4197180 con 0x7f93b4105b80 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41972f0 con 0x7f93b4067ce0 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41974b0 con 0x7f93b41051c0 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37776/0 (socket says 172.21.15.139:37776) 2023-10-08T13:25:02.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 -- 172.21.15.139:0/2134681527 learned_addr learned my addr 172.21.15.139:0/2134681527 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b259c700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b41051c0 0x7f93b419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b2d9d700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b4067ce0 0x7f93b419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 -- 172.21.15.139:0/2134681527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b41051c0 msgr2=0x7f93b419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b41051c0 0x7f93b419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 -- 172.21.15.139:0/2134681527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b4067ce0 msgr2=0x7f93b419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b4067ce0 0x7f93b419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 -- 172.21.15.139:0/2134681527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac009d00 con 0x7f93b4105b80 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b359e700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0094c0 tx=0x7f93ac0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00e040 con 0x7f93b4105b80 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4197730 con 0x7f93b4105b80 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93ac01d940 con 0x7f93b4105b80 2023-10-08T13:25:02.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.905+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac01b9f0 con 0x7f93b4105b80 2023-10-08T13:25:02.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.906+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b41a39e0 con 0x7f93b4105b80 2023-10-08T13:25:02.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.906+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4108c70 con 0x7f93b4105b80 2023-10-08T13:25:02.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.908+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f93ac01bb50 con 0x7f93b4105b80 2023-10-08T13:25:02.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.908+0000 7f939bfff700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 0x7f939c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:02.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.908+0000 7f93b2d9d700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 0x7f939c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:02.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.908+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f93ac0ce530 con 0x7f93b4105b80 2023-10-08T13:25:02.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.909+0000 7f93b2d9d700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 0x7f939c0a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93a8005950 tx=0x7f93a800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:02.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:02.912+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f93ac097ff0 con 0x7f93b4105b80 2023-10-08T13:25:03.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.103+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93b4067560 con 0x7f93b4105b80 2023-10-08T13:25:03.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.103+0000 7f939bfff700 1 -- 172.21.15.139:0/2134681527 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93ac09b610 con 0x7f93b4105b80 2023-10-08T13:25:03.105 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:25:03.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 msgr2=0x7f939c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 0x7f939c0a3990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93a8005950 tx=0x7f93a800b410 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 msgr2=0x7f93b4196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0094c0 tx=0x7f93ac0094f0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 shutdown_connections 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f939c0a14d0 0x7f939c0a3990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93b4105b80 0x7f93b4196b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93b4067ce0 0x7f93b419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 --2- 172.21.15.139:0/2134681527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b41051c0 0x7f93b419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.105+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 >> 172.21.15.139:0/2134681527 conn(0x7f93b4076780 msgr2=0x7f93b40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:03.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.106+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 shutdown_connections 2023-10-08T13:25:03.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.106+0000 7f93b9222700 1 -- 172.21.15.139:0/2134681527 wait complete. 2023-10-08T13:25:03.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:03.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- 172.21.15.139:0/1592396998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb40feb50 msgr2=0x7f4fb40fefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/1592396998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb40feb50 0x7f4fb40fefd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- 172.21.15.139:0/1592396998 shutdown_connections 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/1592396998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40ff510 0x7f4fb410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/1592396998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb4106630 0x7f4fb4106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/1592396998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb40feb50 0x7f4fb40fefd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- 172.21.15.139:0/1592396998 >> 172.21.15.139:0/1592396998 conn(0x7f4fb4075a90 msgr2=0x7f4fb40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- 172.21.15.139:0/1592396998 shutdown_connections 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- 172.21.15.139:0/1592396998 wait complete. 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 Processor -- start 2023-10-08T13:25:03.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.239+0000 7f4fbadd6700 1 -- start start 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40feb50 0x7f4fb4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 0x7f4fb4196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb419b910 con 0x7f4fb4106630 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb419ba80 con 0x7f4fb40ff510 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb419bc40 con 0x7f4fb40feb50 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb8b72700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40feb50 0x7f4fb4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37790/0 (socket says 172.21.15.139:37790) 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 -- 172.21.15.139:0/434998051 learned_addr learned my addr 172.21.15.139:0/434998051 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:03.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb3fff700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 0x7f4fb4196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 -- 172.21.15.139:0/434998051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40feb50 msgr2=0x7f4fb4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40feb50 0x7f4fb4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 -- 172.21.15.139:0/434998051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 msgr2=0x7f4fb4196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 0x7f4fb4196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 -- 172.21.15.139:0/434998051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00095f0 con 0x7f4fb4106630 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb3fff700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 0x7f4fb4196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb9373700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fac007ee0 tx=0x7f4fac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac017070 con 0x7f4fb4106630 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fac00f040 con 0x7f4fb4106630 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb419bf20 con 0x7f4fb4106630 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.240+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac005740 con 0x7f4fb4106630 2023-10-08T13:25:03.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.241+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb41a37d0 con 0x7f4fb4106630 2023-10-08T13:25:03.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.242+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb4108c40 con 0x7f4fb4106630 2023-10-08T13:25:03.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.242+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f4fac00dc60 con 0x7f4fb4106630 2023-10-08T13:25:03.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.243+0000 7f4fb1ffb700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 0x7f4fa40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:03.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.243+0000 7f4fb8b72700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 0x7f4fa40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:03.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.243+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f4fac0cc130 con 0x7f4fb4106630 2023-10-08T13:25:03.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.243+0000 7f4fb8b72700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 0x7f4fa40a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005950 tx=0x7f4fa800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:03.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.247+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4fac095b60 con 0x7f4fb4106630 2023-10-08T13:25:03.476 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 systemd[1]: Starting Ceph mds.l for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:03.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.483+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fb4101e70 con 0x7f4fb4106630 2023-10-08T13:25:03.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.483+0000 7f4fb1ffb700 1 -- 172.21.15.139:0/434998051 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f4fac099180 con 0x7f4fb4106630 2023-10-08T13:25:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:03.484 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-08T13:25:03.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 msgr2=0x7f4fa40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 0x7f4fa40a3a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8005950 tx=0x7f4fa800b410 comp rx=0 tx=0).stop 2023-10-08T13:25:03.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 msgr2=0x7f4fb419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4fac007ee0 tx=0x7f4fac00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 shutdown_connections 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4fa40a1550 0x7f4fa40a3a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4fb4106630 0x7f4fb419b340 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fb40feb50 0x7f4fb4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 --2- 172.21.15.139:0/434998051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4fb40ff510 0x7f4fb4196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 >> 172.21.15.139:0/434998051 conn(0x7f4fb4075a90 msgr2=0x7f4fb40fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 shutdown_connections 2023-10-08T13:25:03.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:03.485+0000 7f4fbadd6700 1 -- 172.21.15.139:0/434998051 wait complete. 2023-10-08T13:25:03.488 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 1 2023-10-08T13:25:03.745 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-mon[104336]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:03.745 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1893480601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:03.745 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2134681527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:03.746 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/434998051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:03.746 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 podman[141327]: 2023-10-08T13:25:03.746 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-mds[141367]: -- 172.21.15.187:0/1253895728 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56047d5b91e0 con 0x56047d58e800 2023-10-08T13:25:03.746 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 bash[141327]: 2604dbdf70b26c1a18ed6efa3bcec642dc27d5a98f874011047e444f5994f1f5 2023-10-08T13:25:03.746 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-l[141343]: starting mds.l at 2023-10-08T13:25:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:03 smithi155 ceph-mon[103467]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:03 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1893480601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:03 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2134681527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:03 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/434998051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:03 smithi139 ceph-mon[99506]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:03 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1893480601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:03 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2134681527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:03 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/434998051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:04.226 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:25:03 smithi187 systemd[1]: Started Ceph mds.l for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:04.968 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6832/2027109215,v1:172.21.15.187:6833/2027109215] up:boot 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: fsmap 1 up:standby 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:04.969 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:04 smithi155 ceph-mon[103467]: Deploying daemon mds.k on smithi155 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6832/2027109215,v1:172.21.15.187:6833/2027109215] up:boot 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: fsmap 1 up:standby 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:04.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:04 smithi187 ceph-mon[104336]: Deploying daemon mds.k on smithi155 2023-10-08T13:25:05.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6832/2027109215,v1:172.21.15.187:6833/2027109215] up:boot 2023-10-08T13:25:05.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: fsmap 1 up:standby 2023-10-08T13:25:05.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T13:25:05.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:05.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:04 smithi139 ceph-mon[99506]: Deploying daemon mds.k on smithi155 2023-10-08T13:25:05.304 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 systemd[1]: Starting Ceph mds.k for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:05.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 -- 172.21.15.139:0/941682224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 msgr2=0x7feac8106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 --2- 172.21.15.139:0/941682224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8106a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feab8009990 tx=0x7feab8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 -- 172.21.15.139:0/941682224 shutdown_connections 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 --2- 172.21.15.139:0/941682224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100ff0 0x7feac810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 --2- 172.21.15.139:0/941682224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8106a20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 --2- 172.21.15.139:0/941682224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100630 0x7feac8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 -- 172.21.15.139:0/941682224 >> 172.21.15.139:0/941682224 conn(0x7feac80fc140 msgr2=0x7feac80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 -- 172.21.15.139:0/941682224 shutdown_connections 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.636+0000 7feace83f700 1 -- 172.21.15.139:0/941682224 wait complete. 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 Processor -- start 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 -- start start 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 0x7feac819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac8196f60 con 0x7feac8106640 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac81970d0 con 0x7feac8100630 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feace83f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac8197290 con 0x7feac8100ff0 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feac7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feac7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:56320/0 (socket says 172.21.15.139:56320) 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37802/0 (socket says 172.21.15.139:37802) 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feac7fff700 1 -- 172.21.15.139:0/4207343323 learned_addr learned my addr 172.21.15.139:0/4207343323 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feac77fe700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 0x7feac819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 -- 172.21.15.139:0/4207343323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 msgr2=0x7feac819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 0x7feac819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 -- 172.21.15.139:0/4207343323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 msgr2=0x7feac819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.637+0000 7feaccddc700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feaccddc700 1 -- 172.21.15.139:0/4207343323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab80095f0 con 0x7feac8106640 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feac77fe700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 0x7feac819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feac7fff700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feaccddc700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feac000be20 tx=0x7feac0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000cc10 con 0x7feac8106640 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feac000cd70 con 0x7feac8106640 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac8197570 con 0x7feac8106640 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00126c0 con 0x7feac8106640 2023-10-08T13:25:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.638+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac81a37c0 con 0x7feac8106640 2023-10-08T13:25:05.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.639+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac8108bc0 con 0x7feac8106640 2023-10-08T13:25:05.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.640+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7feac0012840 con 0x7feac8106640 2023-10-08T13:25:05.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.641+0000 7feac57fa700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 0x7feab00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:05.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.641+0000 7feac7fff700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 0x7feab00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:05.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.641+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7feac0006e40 con 0x7feac8106640 2023-10-08T13:25:05.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.641+0000 7feac7fff700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 0x7feab00a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feab800b5c0 tx=0x7feab801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:05.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.645+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feac0096160 con 0x7feac8106640 2023-10-08T13:25:05.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:05 smithi155 ceph-mon[103467]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:05.847 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 podman[140233]: 2023-10-08T13:25:05.847 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 ceph-mds[140273]: -- 172.21.15.155:0/2770518478 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557962f891e0 con 0x557962f5ec00 2023-10-08T13:25:05.847 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 bash[140233]: c2827106d6e5ef9299f13ac501d5d5f4baffbf73f754ec7f3ce9d00613142b4d 2023-10-08T13:25:05.848 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: starting mds.k at 2023-10-08T13:25:05.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.881+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feac8101d70 con 0x7feac8106640 2023-10-08T13:25:05.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.882+0000 7feac57fa700 1 -- 172.21.15.139:0/4207343323 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7feac0099780 con 0x7feac8106640 2023-10-08T13:25:05.882 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:05.882 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T13:25:05.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 msgr2=0x7feab00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:05.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 0x7feab00a3990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feab800b5c0 tx=0x7feab801a040 comp rx=0 tx=0).stop 2023-10-08T13:25:05.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 msgr2=0x7feac8196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:05.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feac000be20 tx=0x7feac0009ed0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 shutdown_connections 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feab00a14d0 0x7feab00a3990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feac8106640 0x7feac8196900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feac8100630 0x7feac819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 --2- 172.21.15.139:0/4207343323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feac8100ff0 0x7feac819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 >> 172.21.15.139:0/4207343323 conn(0x7feac80fc140 msgr2=0x7feac80fca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 shutdown_connections 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:05.884+0000 7feace83f700 1 -- 172.21.15.139:0/4207343323 wait complete. 2023-10-08T13:25:05.885 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 2 2023-10-08T13:25:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:05 smithi139 ceph-mon[99506]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:05 smithi187 ceph-mon[104336]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:06.346 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:25:05 smithi155 systemd[1]: Started Ceph mds.k for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:06.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4207343323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:06.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:06.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:06 smithi139 ceph-mon[99506]: Deploying daemon mds.j on smithi139 2023-10-08T13:25:07.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4207343323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:07.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:06 smithi155 ceph-mon[103467]: Deploying daemon mds.j on smithi139 2023-10-08T13:25:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4207343323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:07.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:07.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:07.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:06 smithi187 ceph-mon[104336]: Deploying daemon mds.j on smithi139 2023-10-08T13:25:07.687 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:07 smithi139 systemd[1]: Starting Ceph mds.j for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:07.897 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:08.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 -- 172.21.15.139:0/2166123374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c381005e0 msgr2=0x7f2c3810c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:08.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 --2- 172.21.15.139:0/2166123374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c381005e0 0x7f2c3810c490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b0a0 tx=0x7f2c3000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 -- 172.21.15.139:0/2166123374 shutdown_connections 2023-10-08T13:25:08.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 --2- 172.21.15.139:0/2166123374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c381005e0 0x7f2c3810c490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 --2- 172.21.15.139:0/2166123374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 0x7f2c381059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 --2- 172.21.15.139:0/2166123374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c380ffc20 0x7f2c381000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 -- 172.21.15.139:0/2166123374 >> 172.21.15.139:0/2166123374 conn(0x7f2c38075a60 msgr2=0x7f2c380fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 -- 172.21.15.139:0/2166123374 shutdown_connections 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.035+0000 7f2c3d399700 1 -- 172.21.15.139:0/2166123374 wait complete. 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 Processor -- start 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 -- start start 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 0x7f2c3819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 0x7f2c38196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38196ea0 con 0x7f2c380ffc20 2023-10-08T13:25:08.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c38197010 con 0x7f2c381055d0 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c3d399700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c381971d0 con 0x7f2c381005e0 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37812/0 (socket says 172.21.15.139:37812) 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 -- 172.21.15.139:0/841449664 learned_addr learned my addr 172.21.15.139:0/841449664 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c377fe700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 0x7f2c38196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c2ffff700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 0x7f2c3819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 -- 172.21.15.139:0/841449664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 msgr2=0x7f2c3819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 0x7f2c3819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 -- 172.21.15.139:0/841449664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 msgr2=0x7f2c38196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 0x7f2c38196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 -- 172.21.15.139:0/841449664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c30009d00 con 0x7f2c380ffc20 2023-10-08T13:25:08.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c2ffff700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 0x7f2c3819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.036+0000 7f2c36ffd700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c9b0 tx=0x7f2c2800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28007b00 con 0x7f2c380ffc20 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c381974b0 con 0x7f2c380ffc20 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c28007c60 con 0x7f2c380ffc20 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c28018660 con 0x7f2c380ffc20 2023-10-08T13:25:08.040 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c381a36f0 con 0x7f2c380ffc20 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.037+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c38108bf0 con 0x7f2c380ffc20 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.039+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f2c2800f450 con 0x7f2c380ffc20 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.039+0000 7f2c34ff9700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 0x7f2c240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.039+0000 7f2c2ffff700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 0x7f2c240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.039+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f2c280cc8a0 con 0x7f2c380ffc20 2023-10-08T13:25:08.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.039+0000 7f2c2ffff700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 0x7f2c240a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c20005fd0 tx=0x7f2c20005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:08.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.043+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c280962d0 con 0x7f2c380ffc20 2023-10-08T13:25:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:07 smithi155 ceph-mon[103467]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:07 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6832/3719268095,v1:172.21.15.155:6833/3719268095] up:boot 2023-10-08T13:25:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:07 smithi155 ceph-mon[103467]: fsmap 2 up:standby 2023-10-08T13:25:08.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:07 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:25:08.130 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:07 smithi139 podman[157224]: 2023-10-08T13:25:08.130 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:07 smithi139 ceph-mon[99506]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:08.130 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:07 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6832/3719268095,v1:172.21.15.155:6833/3719268095] up:boot 2023-10-08T13:25:08.130 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:07 smithi139 ceph-mon[99506]: fsmap 2 up:standby 2023-10-08T13:25:08.130 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:07 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:25:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:07 smithi187 ceph-mon[104336]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:07 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6832/3719268095,v1:172.21.15.155:6833/3719268095] up:boot 2023-10-08T13:25:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:07 smithi187 ceph-mon[104336]: fsmap 2 up:standby 2023-10-08T13:25:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:07 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:25:08.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.291+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c38100e40 con 0x7f2c380ffc20 2023-10-08T13:25:08.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.291+0000 7f2c34ff9700 1 -- 172.21.15.139:0/841449664 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f2c280998f0 con 0x7f2c380ffc20 2023-10-08T13:25:08.291 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:08.291 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T13:25:08.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 msgr2=0x7f2c240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:08.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 0x7f2c240a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c20005fd0 tx=0x7f2c20005dc0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 msgr2=0x7f2c3819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:08.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c9b0 tx=0x7f2c2800ccc0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 shutdown_connections 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2c240a14d0 0x7f2c240a3990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c381055d0 0x7f2c38196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c380ffc20 0x7f2c3819c700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 --2- 172.21.15.139:0/841449664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c381005e0 0x7f2c3819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 >> 172.21.15.139:0/841449664 conn(0x7f2c38075a60 msgr2=0x7f2c380fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 shutdown_connections 2023-10-08T13:25:08.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:08.293+0000 7f2c3d399700 1 -- 172.21.15.139:0/841449664 wait complete. 2023-10-08T13:25:08.295 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 3 2023-10-08T13:25:08.437 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:08 smithi139 ceph-mds[157307]: -- 172.21.15.139:0/871199636 <== mon.0 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564c651391e0 con 0x564c6510e800 2023-10-08T13:25:08.437 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-j[157246]: starting mds.j at 2023-10-08T13:25:08.438 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:08 smithi139 bash[157224]: 08a8859909ad8e06978129371e41c715ac27f6fb70faacb339c1698e7bbcb42d 2023-10-08T13:25:08.438 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:25:08 smithi139 systemd[1]: Started Ceph mds.j for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:09.532 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/841449664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: Deploying daemon mds.d on smithi139 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6834/516841200,v1:172.21.15.139:6835/516841200] up:boot 2023-10-08T13:25:09.533 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: fsmap 3 up:standby 2023-10-08T13:25:09.534 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:25:09.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/841449664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:09.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:09.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: Deploying daemon mds.d on smithi139 2023-10-08T13:25:09.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:09.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6834/516841200,v1:172.21.15.139:6835/516841200] up:boot 2023-10-08T13:25:09.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: fsmap 3 up:standby 2023-10-08T13:25:09.598 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:25:09.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/841449664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: Deploying daemon mds.d on smithi139 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6834/516841200,v1:172.21.15.139:6835/516841200] up:boot 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: fsmap 3 up:standby 2023-10-08T13:25:09.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T13:25:10.187 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:09 smithi139 systemd[1]: Starting Ceph mds.d for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:10.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 -- 172.21.15.139:0/2741954944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a4105610 msgr2=0x7f73a41059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2741954944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a4105610 0x7f73a41059f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f73980099c0 tx=0x7f7398009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 -- 172.21.15.139:0/2741954944 shutdown_connections 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2741954944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40fff10 0x7f73a410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2741954944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a4105610 0x7f73a41059f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2741954944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a40ff550 0x7f73a40ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.437+0000 7f73aab3d700 1 -- 172.21.15.139:0/2741954944 >> 172.21.15.139:0/2741954944 conn(0x7f73a40fb060 msgr2=0x7f73a40fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.438+0000 7f73aab3d700 1 -- 172.21.15.139:0/2741954944 shutdown_connections 2023-10-08T13:25:10.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.438+0000 7f73aab3d700 1 -- 172.21.15.139:0/2741954944 wait complete. 2023-10-08T13:25:10.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.438+0000 7f73aab3d700 1 Processor -- start 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.438+0000 7f73aab3d700 1 -- start start 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40ff550 0x7f73a419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 0x7f73a4195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4195dd0 con 0x7f73a40fff10 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4195f40 con 0x7f73a40ff550 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4196100 con 0x7f73a4105610 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37840/0 (socket says 172.21.15.139:37840) 2023-10-08T13:25:10.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 -- 172.21.15.139:0/2897666412 learned_addr learned my addr 172.21.15.139:0/2897666412 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a88d9700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40ff550 0x7f73a419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a90da700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 0x7f73a4195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 -- 172.21.15.139:0/2897666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 msgr2=0x7f73a4195770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 0x7f73a4195770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 -- 172.21.15.139:0/2897666412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40ff550 msgr2=0x7f73a419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40ff550 0x7f73a419b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 -- 172.21.15.139:0/2897666412 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980095f0 con 0x7f73a40fff10 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a90da700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 0x7f73a4195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a3fff700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f739000d950 tx=0x7f739000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:10.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390009940 con 0x7f73a40fff10 2023-10-08T13:25:10.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7390010460 con 0x7f73a40fff10 2023-10-08T13:25:10.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739000f620 con 0x7f73a40fff10 2023-10-08T13:25:10.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.439+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a41963e0 con 0x7f73a40fff10 2023-10-08T13:25:10.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.440+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a41a2630 con 0x7f73a40fff10 2023-10-08T13:25:10.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.440+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4107a90 con 0x7f73a40fff10 2023-10-08T13:25:10.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.441+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f73900108d0 con 0x7f73a40fff10 2023-10-08T13:25:10.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.442+0000 7f73a1ffb700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 0x7f73940a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:10.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.442+0000 7f73a88d9700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 0x7f73940a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:10.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.442+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f73900cc760 con 0x7f73a40fff10 2023-10-08T13:25:10.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.442+0000 7f73a88d9700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 0x7f73940a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7398009990 tx=0x7f7398003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:10.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.447+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7390096190 con 0x7f73a40fff10 2023-10-08T13:25:10.496 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:10 smithi139 podman[157608]: 2023-10-08T13:25:10.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.691+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73a410f470 con 0x7f73a40fff10 2023-10-08T13:25:10.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.692+0000 7f73a1ffb700 1 -- 172.21.15.139:0/2897666412 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2913 (secure 0 0 0) 0x7f73900997b0 con 0x7f73a40fff10 2023-10-08T13:25:10.693 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:10.693 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T13:25:10.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 msgr2=0x7f73940a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 0x7f73940a3a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7398009990 tx=0x7f7398003680 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 msgr2=0x7f73a419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f739000d950 tx=0x7f739000dc60 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 shutdown_connections 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73940a1550 0x7f73940a3a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73a4105610 0x7f73a4195770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a40ff550 0x7f73a419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 --2- 172.21.15.139:0/2897666412 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73a40fff10 0x7f73a419bb80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 >> 172.21.15.139:0/2897666412 conn(0x7f73a40fb060 msgr2=0x7f73a40fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 shutdown_connections 2023-10-08T13:25:10.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:10.694+0000 7f73aab3d700 1 -- 172.21.15.139:0/2897666412 wait complete. 2023-10-08T13:25:10.697 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 4 2023-10-08T13:25:10.937 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:10 smithi139 ceph-mds[157691]: -- 172.21.15.139:0/2638863115 <== mon.0 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f1396bf1e0 con 0x55f139695000 2023-10-08T13:25:10.937 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: starting mds.d at 2023-10-08T13:25:10.937 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:10 smithi139 bash[157608]: c6d3c438c3450357f3970daad91d48b029c77e0f488488f209c54c11081c8f49 2023-10-08T13:25:10.938 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:25:10 smithi139 systemd[1]: Started Ceph mds.d for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:11.886 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:11.886 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2897666412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:11.887 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:11.888 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: Deploying daemon mds.e on smithi155 2023-10-08T13:25:11.888 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6836/2085954073,v1:172.21.15.139:6837/2085954073] up:boot 2023-10-08T13:25:11.888 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: fsmap 4 up:standby 2023-10-08T13:25:11.888 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:11 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:25:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2897666412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: Deploying daemon mds.e on smithi155 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6836/2085954073,v1:172.21.15.139:6837/2085954073] up:boot 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: fsmap 4 up:standby 2023-10-08T13:25:11.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:11 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:25:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2897666412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: Deploying daemon mds.e on smithi155 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6836/2085954073,v1:172.21.15.139:6837/2085954073] up:boot 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: fsmap 4 up:standby 2023-10-08T13:25:11.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:11 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:25:12.499 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:25:12 smithi155 systemd[1]: Starting Ceph mds.e for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:12.709 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:12.780 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:25:12 smithi155 podman[140571]: 2023-10-08T13:25:12.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 -- 172.21.15.139:0/2789514723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940ff8f0 msgr2=0x7fee9410bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:12.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 --2- 172.21.15.139:0/2789514723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940ff8f0 0x7fee9410bba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00b0d0 tx=0x7fee8c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 -- 172.21.15.139:0/2789514723 shutdown_connections 2023-10-08T13:25:12.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 --2- 172.21.15.139:0/2789514723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940ff8f0 0x7fee9410bba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 --2- 172.21.15.139:0/2789514723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee94103ca0 0x7fee94104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 --2- 172.21.15.139:0/2789514723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940fef30 0x7fee940ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 -- 172.21.15.139:0/2789514723 >> 172.21.15.139:0/2789514723 conn(0x7fee94074820 msgr2=0x7fee94074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 -- 172.21.15.139:0/2789514723 shutdown_connections 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.846+0000 7fee99e1c700 1 -- 172.21.15.139:0/2789514723 wait complete. 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 Processor -- start 2023-10-08T13:25:12.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 -- start start 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940ff8f0 0x7fee94197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee94103ca0 0x7fee941a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee94198810 con 0x7fee940fef30 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941a2fa0 con 0x7fee940ff8f0 2023-10-08T13:25:12.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee99e1c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941a3110 con 0x7fee94103ca0 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37866/0 (socket says 172.21.15.139:37866) 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 -- 172.21.15.139:0/1612688526 learned_addr learned my addr 172.21.15.139:0/1612688526 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee92ffd700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940ff8f0 0x7fee94197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 -- 172.21.15.139:0/1612688526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee94103ca0 msgr2=0x7fee941a2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee94103ca0 0x7fee941a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 -- 172.21.15.139:0/1612688526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940ff8f0 msgr2=0x7fee94197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940ff8f0 0x7fee94197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.847+0000 7fee937fe700 1 -- 172.21.15.139:0/1612688526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c009d00 con 0x7fee940fef30 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee937fe700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee8400c920 tx=0x7fee8400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84007b00 con 0x7fee940fef30 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee8400ce70 con 0x7fee940fef30 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee941a33f0 con 0x7fee940fef30 2023-10-08T13:25:12.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840054e0 con 0x7fee940fef30 2023-10-08T13:25:12.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.848+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee941a3900 con 0x7fee940fef30 2023-10-08T13:25:12.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.849+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee941003d0 con 0x7fee940fef30 2023-10-08T13:25:12.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.850+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fee84004750 con 0x7fee940fef30 2023-10-08T13:25:12.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.850+0000 7fee90ff9700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 0x7fee7c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.850+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fee840cc8c0 con 0x7fee940fef30 2023-10-08T13:25:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.850+0000 7fee92ffd700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 0x7fee7c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.851+0000 7fee92ffd700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 0x7fee7c0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee9410fd50 tx=0x7fee8800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:12.854+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fee840962f0 con 0x7fee940fef30 2023-10-08T13:25:13.096 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:25:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: starting mds.e at 2023-10-08T13:25:13.096 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:25:12 smithi155 bash[140571]: 98586beb2c7308126a288a7bb5a9ad58c422a114ac9a111b9cad52c7d0dd3166 2023-10-08T13:25:13.096 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:25:12 smithi155 systemd[1]: Started Ceph mds.e for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:13.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.104+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee940678a0 con 0x7fee940fef30 2023-10-08T13:25:13.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.104+0000 7fee90ff9700 1 -- 172.21.15.139:0/1612688526 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3707 (secure 0 0 0) 0x7fee8401de90 con 0x7fee940fef30 2023-10-08T13:25:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:13.106 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 msgr2=0x7fee7c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 0x7fee7c0a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee9410fd50 tx=0x7fee8800a300 comp rx=0 tx=0).stop 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 msgr2=0x7fee941979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee8400c920 tx=0x7fee8400cc30 comp rx=0 tx=0).stop 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 shutdown_connections 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fee7c0a14d0 0x7fee7c0a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee94103ca0 0x7fee941a2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:13.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee940fef30 0x7fee941979e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:13.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 --2- 172.21.15.139:0/1612688526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee940ff8f0 0x7fee94197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:13.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.106+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 >> 172.21.15.139:0/1612688526 conn(0x7fee94074820 msgr2=0x7fee940fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:13.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.107+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 shutdown_connections 2023-10-08T13:25:13.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:13.107+0000 7fee99e1c700 1 -- 172.21.15.139:0/1612688526 wait complete. 2023-10-08T13:25:13.109 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 5 2023-10-08T13:25:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: Deploying daemon mds.f on smithi187 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1612688526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6834/4262434274,v1:172.21.15.155:6835/4262434274] up:boot 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: fsmap 5 up:standby 2023-10-08T13:25:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:13 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:25:14.122 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:14.122 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.122 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.122 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.122 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: Deploying daemon mds.f on smithi187 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1612688526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6834/4262434274,v1:172.21.15.155:6835/4262434274] up:boot 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: fsmap 5 up:standby 2023-10-08T13:25:14.123 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:13 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:25:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:14.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:14.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:14.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:14.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:14.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: Deploying daemon mds.f on smithi187 2023-10-08T13:25:14.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1612688526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:14.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6834/4262434274,v1:172.21.15.155:6835/4262434274] up:boot 2023-10-08T13:25:14.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: fsmap 5 up:standby 2023-10-08T13:25:14.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:13 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:25:14.477 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 systemd[1]: Starting Ceph mds.f for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:14.916 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 podman[141676]: 2023-10-08T13:25:15.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:15.226 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 bash[141676]: f27171503217e495ece339ba6d16cbc041316e8b5b61818b87ff01fc529f90cd 2023-10-08T13:25:15.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 ceph-mds[141716]: -- 172.21.15.187:0/82173474 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x561588f971e0 con 0x561588f58800 2023-10-08T13:25:15.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 ceph-mds[141716]: -- 172.21.15.187:0/82173474 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561588f831e0 con 0x561588f58800 2023-10-08T13:25:15.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: starting mds.f at 2023-10-08T13:25:15.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:25:14 smithi187 systemd[1]: Started Ceph mds.f for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:15.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/1558830153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4100ff0 msgr2=0x7f3fe410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:15.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/1558830153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4100ff0 0x7f3fe410d500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00b0a0 tx=0x7f3fdc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/1558830153 shutdown_connections 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/1558830153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4100ff0 0x7f3fe410d500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/1558830153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4106640 0x7f3fe4106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/1558830153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100630 0x7f3fe4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/1558830153 >> 172.21.15.139:0/1558830153 conn(0x7f3fe40fc1a0 msgr2=0x7f3fe40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/1558830153 shutdown_connections 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/1558830153 wait complete. 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 Processor -- start 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.255+0000 7f3fe9c4c700 1 -- start start 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 0x7f3fe419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:15.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 0x7f3fe419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4194cd0 con 0x7f3fe4106640 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4194e40 con 0x7f3fe4100630 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4195000 con 0x7f3fe4100ff0 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 0x7f3fe419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37884/0 (socket says 172.21.15.139:37884) 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 -- 172.21.15.139:0/915737350 learned_addr learned my addr 172.21.15.139:0/915737350 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:15.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe37fe700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 0x7f3fe419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 -- 172.21.15.139:0/915737350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 msgr2=0x7f3fe419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 0x7f3fe419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 -- 172.21.15.139:0/915737350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 msgr2=0x7f3fe419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 0x7f3fe419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 -- 172.21.15.139:0/915737350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009d00 con 0x7f3fe4106640 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe37fe700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 0x7f3fe419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe2ffd700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 0x7f3fe419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe3fff700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00b070 tx=0x7f3fdc0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00e040 con 0x7f3fe4106640 2023-10-08T13:25:15.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe4195280 con 0x7f3fe4106640 2023-10-08T13:25:15.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fdc0094c0 con 0x7f3fe4106640 2023-10-08T13:25:15.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0044e0 con 0x7f3fe4106640 2023-10-08T13:25:15.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.256+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41a1530 con 0x7f3fe4106640 2023-10-08T13:25:15.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.257+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4108c50 con 0x7f3fe4106640 2023-10-08T13:25:15.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.258+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3fdc004640 con 0x7f3fe4106640 2023-10-08T13:25:15.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.259+0000 7f3fe0ff9700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 0x7f3fcc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:15.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.259+0000 7f3fe37fe700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 0x7f3fcc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:15.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.259+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3fdc0cd860 con 0x7f3fe4106640 2023-10-08T13:25:15.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.259+0000 7f3fe37fe700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 0x7f3fcc0a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009c90 tx=0x7f3fd4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:15.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.263+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3fdc097320 con 0x7f3fe4106640 2023-10-08T13:25:15.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.508+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fe4195b30 con 0x7f3fe4106640 2023-10-08T13:25:15.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.508+0000 7f3fe0ff9700 1 -- 172.21.15.139:0/915737350 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4501 (secure 0 0 0) 0x7f3fdc09a940 con 0x7f3fe4106640 2023-10-08T13:25:15.510 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:15.510 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 msgr2=0x7f3fcc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 0x7f3fcc0a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009c90 tx=0x7f3fd4009260 comp rx=0 tx=0).stop 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 msgr2=0x7f3fe4194670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00b070 tx=0x7f3fdc0077f0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 shutdown_connections 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3fcc0a14d0 0x7f3fcc0a3990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fe4106640 0x7f3fe4194670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fe4100630 0x7f3fe419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 --2- 172.21.15.139:0/915737350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4100ff0 0x7f3fe419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 >> 172.21.15.139:0/915737350 conn(0x7f3fe40fc1a0 msgr2=0x7f3fe40fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 shutdown_connections 2023-10-08T13:25:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:15.511+0000 7f3fe9c4c700 1 -- 172.21.15.139:0/915737350 wait complete. 2023-10-08T13:25:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 6 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:15.926 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/915737350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/915737350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/915737350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:16.800 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:16 smithi187 systemd[1]: Starting Ceph mds.c for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:17.073 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:16 smithi187 ceph-mon[104336]: Deploying daemon mds.c on smithi187 2023-10-08T13:25:17.074 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:16 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:boot 2023-10-08T13:25:17.074 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:16 smithi187 ceph-mon[104336]: fsmap 6 up:standby 2023-10-08T13:25:17.074 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:16 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:25:17.074 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:16 smithi187 podman[142015]: 2023-10-08T13:25:17.075 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mds[142055]: -- 172.21.15.187:0/2565543152 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec3fba31e0 con 0x55ec3fb78800 2023-10-08T13:25:17.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:16 smithi139 ceph-mon[99506]: Deploying daemon mds.c on smithi187 2023-10-08T13:25:17.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:16 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:boot 2023-10-08T13:25:17.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:16 smithi139 ceph-mon[99506]: fsmap 6 up:standby 2023-10-08T13:25:17.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:16 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:25:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:16 smithi155 ceph-mon[103467]: Deploying daemon mds.c on smithi187 2023-10-08T13:25:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:16 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:boot 2023-10-08T13:25:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:16 smithi155 ceph-mon[103467]: fsmap 6 up:standby 2023-10-08T13:25:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:16 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:25:17.476 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: starting mds.c at 2023-10-08T13:25:17.476 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:17 smithi187 bash[142015]: 6d84acf594e3a37c3f8da3d3b7aa787edf25aa5b1c8d9206045ceeb8450760a6 2023-10-08T13:25:17.476 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:25:17 smithi187 systemd[1]: Started Ceph mds.c for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:17.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:17.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 -- 172.21.15.139:0/2304439141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 msgr2=0x7fb39810a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2304439141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39810a6e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb388009990 tx=0x7fb388009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 -- 172.21.15.139:0/2304439141 shutdown_connections 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2304439141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 0x7fb39810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2304439141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 0x7fb398101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2304439141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39810a6e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 -- 172.21.15.139:0/2304439141 >> 172.21.15.139:0/2304439141 conn(0x7fb3980fb060 msgr2=0x7fb3980fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 -- 172.21.15.139:0/2304439141 shutdown_connections 2023-10-08T13:25:17.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.658+0000 7fb39dba2700 1 -- 172.21.15.139:0/2304439141 wait complete. 2023-10-08T13:25:17.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 Processor -- start 2023-10-08T13:25:17.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 -- start start 2023-10-08T13:25:17.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 0x7fb39819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:17.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 0x7fb3981969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb398197020 con 0x7fb398102200 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb398197190 con 0x7fb3981018e0 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.659+0000 7fb39dba2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb398197350 con 0x7fb39810acb0 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37896/0 (socket says 172.21.15.139:37896) 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 -- 172.21.15.139:0/2320396183 learned_addr learned my addr 172.21.15.139:0/2320396183 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb3977fe700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 0x7fb39819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb397fff700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 0x7fb3981969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 -- 172.21.15.139:0/2320396183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 msgr2=0x7fb3981969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 0x7fb3981969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 -- 172.21.15.139:0/2320396183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 msgr2=0x7fb39819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 0x7fb39819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 -- 172.21.15.139:0/2320396183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880095f0 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb396ffd700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb388005910 tx=0x7fb388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38801d070 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb388022470 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3981975d0 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388017650 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.660+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3981a3880 con 0x7fb398102200 2023-10-08T13:25:17.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.661+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398105dd0 con 0x7fb398102200 2023-10-08T13:25:17.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.662+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb3880225e0 con 0x7fb398102200 2023-10-08T13:25:17.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.663+0000 7fb394ff9700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 0x7fb3840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:17.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.663+0000 7fb3977fe700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 0x7fb3840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:17.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.663+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb3880ce050 con 0x7fb398102200 2023-10-08T13:25:17.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.663+0000 7fb3977fe700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 0x7fb3840a3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb380009c60 tx=0x7fb380009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:17.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.666+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb388097b10 con 0x7fb398102200 2023-10-08T13:25:17.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.904+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb398197e80 con 0x7fb398102200 2023-10-08T13:25:17.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.905+0000 7fb394ff9700 1 -- 172.21.15.139:0/2320396183 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6089 (secure 0 0 0) 0x7fb38809b130 con 0x7fb398102200 2023-10-08T13:25:17.906 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:17.906 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 msgr2=0x7fb3840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 0x7fb3840a3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb380009c60 tx=0x7fb380009260 comp rx=0 tx=0).stop 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 msgr2=0x7fb39819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb388005910 tx=0x7fb388004730 comp rx=0 tx=0).stop 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 shutdown_connections 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb3840a14d0 0x7fb3840a3990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb39810acb0 0x7fb3981969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3981018e0 0x7fb39819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 --2- 172.21.15.139:0/2320396183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb398102200 0x7fb39819cdd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:17.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 >> 172.21.15.139:0/2320396183 conn(0x7fb3980fb060 msgr2=0x7fb3980fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:17.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 shutdown_connections 2023-10-08T13:25:17.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:17.907+0000 7fb39dba2700 1 -- 172.21.15.139:0/2320396183 wait complete. 2023-10-08T13:25:17.909 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 8 2023-10-08T13:25:18.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:17 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:17 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:18.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:17 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:18 smithi155 systemd[1]: Starting Ceph mds.h for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:18 smithi155 ceph-mon[103467]: Deploying daemon mds.h on smithi155 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:18 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:boot 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:18 smithi155 ceph-mon[103467]: fsmap 7 up:standby 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:18 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:25:19.081 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:18 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2320396183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:18 smithi139 ceph-mon[99506]: Deploying daemon mds.h on smithi155 2023-10-08T13:25:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:18 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:boot 2023-10-08T13:25:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:18 smithi139 ceph-mon[99506]: fsmap 7 up:standby 2023-10-08T13:25:19.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:18 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:25:19.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:18 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2320396183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:18 smithi187 ceph-mon[104336]: Deploying daemon mds.h on smithi155 2023-10-08T13:25:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:18 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:boot 2023-10-08T13:25:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:18 smithi187 ceph-mon[104336]: fsmap 7 up:standby 2023-10-08T13:25:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:18 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:25:19.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:18 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2320396183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:19.346 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:19 smithi155 podman[140914]: 2023-10-08T13:25:19.346 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mds[140954]: -- 172.21.15.155:0/2302726786 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ceb29971e0 con 0x55ceb296d000 2023-10-08T13:25:19.347 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:19 smithi155 bash[140914]: 6e6f5aab30851755958ad9f3a78f6c2256f71f8805caeb6654852ddcbfe10404 2023-10-08T13:25:19.347 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: starting mds.h at 2023-10-08T13:25:19.846 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:25:19 smithi155 systemd[1]: Started Ceph mds.h for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:19.921 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:20.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 -- 172.21.15.139:0/2510251749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c105690 msgr2=0x7fd37c105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 --2- 172.21.15.139:0/2510251749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c105690 0x7fd37c105a70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd3700099c0 tx=0x7fd370009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 -- 172.21.15.139:0/2510251749 shutdown_connections 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 --2- 172.21.15.139:0/2510251749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c100660 0x7fd37c10c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 --2- 172.21.15.139:0/2510251749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c105690 0x7fd37c105a70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 --2- 172.21.15.139:0/2510251749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c0ffcc0 0x7fd37c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 -- 172.21.15.139:0/2510251749 >> 172.21.15.139:0/2510251749 conn(0x7fd37c075a90 msgr2=0x7fd37c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 -- 172.21.15.139:0/2510251749 shutdown_connections 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.054+0000 7fd383417700 1 -- 172.21.15.139:0/2510251749 wait complete. 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 Processor -- start 2023-10-08T13:25:20.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 -- start start 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c0ffcc0 0x7fd37c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c105690 0x7fd37c1a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c198620 con 0x7fd37c100660 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a2e50 con 0x7fd37c0ffcc0 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd383417700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1a2f90 con 0x7fd37c105690 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3809b2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3809b2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37910/0 (socket says 172.21.15.139:37910) 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3809b2700 1 -- 172.21.15.139:0/2849656500 learned_addr learned my addr 172.21.15.139:0/2849656500 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3811b3700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c0ffcc0 0x7fd37c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:20.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3819b4700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c105690 0x7fd37c1a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.055+0000 7fd3809b2700 1 -- 172.21.15.139:0/2849656500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c105690 msgr2=0x7fd37c1a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd3809b2700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c105690 0x7fd37c1a2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd3809b2700 1 -- 172.21.15.139:0/2849656500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c0ffcc0 msgr2=0x7fd37c197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd3809b2700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c0ffcc0 0x7fd37c197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd3809b2700 1 -- 172.21.15.139:0/2849656500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700095f0 con 0x7fd37c100660 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd3809b2700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d980 tx=0x7fd37800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378009b40 con 0x7fd37c100660 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd37800b6e0 con 0x7fd37c100660 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c1a31f0 con 0x7fd37c100660 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800f620 con 0x7fd37c100660 2023-10-08T13:25:20.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.056+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c1a3700 con 0x7fd37c100660 2023-10-08T13:25:20.061 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.057+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c107a40 con 0x7fd37c100660 2023-10-08T13:25:20.061 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.058+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd378010460 con 0x7fd37c100660 2023-10-08T13:25:20.061 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.058+0000 7fd36e7fc700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 0x7fd3680a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:20.062 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.058+0000 7fd3811b3700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 0x7fd3680a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:20.062 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.059+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fd3780ccc20 con 0x7fd37c100660 2023-10-08T13:25:20.062 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.059+0000 7fd3811b3700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 0x7fd3680a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd370009990 tx=0x7fd370003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:20.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.063+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd378096650 con 0x7fd37c100660 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:20.130 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:19 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:20.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:19 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:20.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.300+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd37c0ff150 con 0x7fd37c100660 2023-10-08T13:25:20.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.301+0000 7fd36e7fc700 1 -- 172.21.15.139:0/2849656500 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6883 (secure 0 0 0) 0x7fd378099c70 con 0x7fd37c100660 2023-10-08T13:25:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:20.302 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.302+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 msgr2=0x7fd3680a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.302+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 0x7fd3680a3990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd370009990 tx=0x7fd370003680 comp rx=0 tx=0).stop 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.302+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 msgr2=0x7fd37c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.302+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd37800d980 tx=0x7fd37800dc90 comp rx=0 tx=0).stop 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 shutdown_connections 2023-10-08T13:25:20.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3680a14d0 0x7fd3680a3990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c105690 0x7fd37c1a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd37c0ffcc0 0x7fd37c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 --2- 172.21.15.139:0/2849656500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd37c100660 0x7fd37c197dd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 >> 172.21.15.139:0/2849656500 conn(0x7fd37c075a90 msgr2=0x7fd37c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 shutdown_connections 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:20.303+0000 7fd383417700 1 -- 172.21.15.139:0/2849656500 wait complete. 2023-10-08T13:25:20.305 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 9 2023-10-08T13:25:20.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:20.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:20.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:20.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:20.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:19 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:20 smithi187 systemd[1]: Starting Ceph mds.i for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:20 smithi187 ceph-mon[104336]: Deploying daemon mds.i on smithi187 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:20 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:boot 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:20 smithi187 ceph-mon[104336]: fsmap 8 up:standby 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:20 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:25:20.962 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:20 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2849656500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:21.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:20 smithi139 ceph-mon[99506]: Deploying daemon mds.i on smithi187 2023-10-08T13:25:21.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:20 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:boot 2023-10-08T13:25:21.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:20 smithi139 ceph-mon[99506]: fsmap 8 up:standby 2023-10-08T13:25:21.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:20 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:25:21.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:20 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2849656500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:21.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:20 smithi155 ceph-mon[103467]: Deploying daemon mds.i on smithi187 2023-10-08T13:25:21.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:20 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:boot 2023-10-08T13:25:21.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:20 smithi155 ceph-mon[103467]: fsmap 8 up:standby 2023-10-08T13:25:21.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:20 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:25:21.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:20 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2849656500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:21.498 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:21 smithi187 podman[142356]: 2023-10-08T13:25:21.498 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mds[142396]: -- 172.21.15.187:0/1905520988 <== mon.1 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606943411e0 con 0x560694316800 2023-10-08T13:25:21.498 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: starting mds.i at 2023-10-08T13:25:21.876 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:21 smithi187 bash[142356]: f4a161e82502766930dd83454c6a75c62da1b7258652f08f02bf2e4d6413f0c4 2023-10-08T13:25:21.876 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:21 smithi187 systemd[1]: Started Ceph mds.i for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:22.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:22.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:21 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:22.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:22.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:22.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:22.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:21 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:22.317 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:22.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:22.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:22.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:22.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:22.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:21 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 -- 172.21.15.139:0/380117537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c105600 msgr2=0x7fc91c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 --2- 172.21.15.139:0/380117537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c105600 0x7fc91c1059e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9100099c0 tx=0x7fc910009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 -- 172.21.15.139:0/380117537 shutdown_connections 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 --2- 172.21.15.139:0/380117537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0fff00 0x7fc91c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 --2- 172.21.15.139:0/380117537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c105600 0x7fc91c1059e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 --2- 172.21.15.139:0/380117537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0ff540 0x7fc91c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 -- 172.21.15.139:0/380117537 >> 172.21.15.139:0/380117537 conn(0x7fc91c0fb030 msgr2=0x7fc91c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 -- 172.21.15.139:0/380117537 shutdown_connections 2023-10-08T13:25:22.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.447+0000 7fc920953700 1 -- 172.21.15.139:0/380117537 wait complete. 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 Processor -- start 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 -- start start 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0fff00 0x7fc91c195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c105600 0x7fc91c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c19a910 con 0x7fc91c0ff540 2023-10-08T13:25:22.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c19aa80 con 0x7fc91c0fff00 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc920953700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c19ac40 con 0x7fc91c105600 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc91a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc91a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37920/0 (socket says 172.21.15.139:37920) 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.448+0000 7fc91a59c700 1 -- 172.21.15.139:0/3233373402 learned_addr learned my addr 172.21.15.139:0/3233373402 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 -- 172.21.15.139:0/3233373402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c105600 msgr2=0x7fc91c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc919d9b700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0fff00 0x7fc91c195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c105600 0x7fc91c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 -- 172.21.15.139:0/3233373402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0fff00 msgr2=0x7fc91c195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0fff00 0x7fc91c195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 -- 172.21.15.139:0/3233373402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100095f0 con 0x7fc91c0ff540 2023-10-08T13:25:22.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc91a59c700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc910009990 tx=0x7fc910005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91001d070 con 0x7fc91c0ff540 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc910004ca0 con 0x7fc91c0ff540 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c19aec0 con 0x7fc91c0ff540 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000f9d0 con 0x7fc91c0ff540 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.449+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c067a10 con 0x7fc91c0ff540 2023-10-08T13:25:22.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.450+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c19b180 con 0x7fc91c0ff540 2023-10-08T13:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.452+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc9100047e0 con 0x7fc91c0ff540 2023-10-08T13:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.452+0000 7fc90b7fe700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 0x7fc9040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.452+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc9100cd740 con 0x7fc91c0ff540 2023-10-08T13:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.452+0000 7fc919d9b700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 0x7fc9040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:22.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.453+0000 7fc919d9b700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 0x7fc9040a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc91c196f80 tx=0x7fc90c0094f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:22.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.456+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc910097200 con 0x7fc91c0ff540 2023-10-08T13:25:22.705 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.704+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc91c100c60 con 0x7fc91c0ff540 2023-10-08T13:25:22.705 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.704+0000 7fc90b7fe700 1 -- 172.21.15.139:0/3233373402 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7679 (secure 0 0 0) 0x7fc9100203b0 con 0x7fc91c0ff540 2023-10-08T13:25:22.706 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:22.706 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 msgr2=0x7fc9040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 0x7fc9040a3a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc91c196f80 tx=0x7fc90c0094f0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 msgr2=0x7fc91c195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc910009990 tx=0x7fc910005e80 comp rx=0 tx=0).stop 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 shutdown_connections 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc9040a1550 0x7fc9040a3a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c105600 0x7fc91c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc91c0ff540 0x7fc91c195a30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 --2- 172.21.15.139:0/3233373402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc91c0fff00 0x7fc91c195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 >> 172.21.15.139:0/3233373402 conn(0x7fc91c0fb030 msgr2=0x7fc91c0fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 shutdown_connections 2023-10-08T13:25:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:22.707+0000 7fc920953700 1 -- 172.21.15.139:0/3233373402 wait complete. 2023-10-08T13:25:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 10 2023-10-08T13:25:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:22 smithi139 ceph-mon[99506]: Deploying daemon mds.g on smithi139 2023-10-08T13:25:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:22 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:boot 2023-10-08T13:25:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:22 smithi139 ceph-mon[99506]: fsmap 9 up:standby 2023-10-08T13:25:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:22 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:25:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:22 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3233373402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:23.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:22 smithi187 ceph-mon[104336]: Deploying daemon mds.g on smithi139 2023-10-08T13:25:23.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:22 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:boot 2023-10-08T13:25:23.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:22 smithi187 ceph-mon[104336]: fsmap 9 up:standby 2023-10-08T13:25:23.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:22 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:25:23.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:22 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3233373402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:23.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:22 smithi155 ceph-mon[103467]: Deploying daemon mds.g on smithi139 2023-10-08T13:25:23.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:22 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:boot 2023-10-08T13:25:23.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:22 smithi155 ceph-mon[103467]: fsmap 9 up:standby 2023-10-08T13:25:23.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:22 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:25:23.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:22 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3233373402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:23.594 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 systemd[1]: Starting Ceph mds.g for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:23.868 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 podman[158219]: 2023-10-08T13:25:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:23 smithi139 ceph-mon[99506]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:24.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 bash[158219]: 8eecb365316fa1256a0c1c9abd60dfcc9f1bb2cac3fd9a6f79a541f4a1e9a7fa 2023-10-08T13:25:24.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 ceph-mds[158259]: -- 172.21.15.139:0/1603971131 <== mon.0 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563b688d91e0 con 0x563b688aec00 2023-10-08T13:25:24.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: starting mds.g at 2023-10-08T13:25:24.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:25:23 smithi139 systemd[1]: Started Ceph mds.g for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:23 smithi187 ceph-mon[104336]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:24.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:23 smithi155 ceph-mon[103467]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:24.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.850+0000 7f3a96a37700 1 -- 172.21.15.139:0/535962663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 msgr2=0x7f3a901000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.850+0000 7f3a96a37700 1 --2- 172.21.15.139:0/535962663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a901000e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009990 tx=0x7f3a80009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 -- 172.21.15.139:0/535962663 shutdown_connections 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 --2- 172.21.15.139:0/535962663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 0x7f3a9010c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 --2- 172.21.15.139:0/535962663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 0x7f3a90105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 --2- 172.21.15.139:0/535962663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a901000e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 -- 172.21.15.139:0/535962663 >> 172.21.15.139:0/535962663 conn(0x7f3a90075a90 msgr2=0x7f3a900fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:24.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 -- 172.21.15.139:0/535962663 shutdown_connections 2023-10-08T13:25:24.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 -- 172.21.15.139:0/535962663 wait complete. 2023-10-08T13:25:24.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 Processor -- start 2023-10-08T13:25:24.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.851+0000 7f3a96a37700 1 -- start start 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 0x7f3a9019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 0x7f3a90196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90197070 con 0x7f3a900ffc60 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901971e0 con 0x7f3a90100620 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901973a0 con 0x7f3a901057e0 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37942/0 (socket says 172.21.15.139:37942) 2023-10-08T13:25:24.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 -- 172.21.15.139:0/3946546299 learned_addr learned my addr 172.21.15.139:0/3946546299 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a94fd4700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 0x7f3a90196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8f7fe700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 0x7f3a9019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 -- 172.21.15.139:0/3946546299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 msgr2=0x7f3a90196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 0x7f3a90196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 -- 172.21.15.139:0/3946546299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 msgr2=0x7f3a9019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 0x7f3a9019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 -- 172.21.15.139:0/3946546299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800095f0 con 0x7f3a900ffc60 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8ffff700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c970 tx=0x7f3a7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004220 con 0x7f3a900ffc60 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a78007d60 con 0x7f3a900ffc60 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a90197680 con 0x7f3a900ffc60 2023-10-08T13:25:24.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003c90 con 0x7f3a900ffc60 2023-10-08T13:25:24.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.852+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901a3880 con 0x7f3a900ffc60 2023-10-08T13:25:24.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.853+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90100f10 con 0x7f3a900ffc60 2023-10-08T13:25:24.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.855+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3a78004380 con 0x7f3a900ffc60 2023-10-08T13:25:24.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.856+0000 7f3a8d7fa700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 0x7f3a7c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:24.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.856+0000 7f3a8f7fe700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 0x7f3a7c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:24.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.856+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3a780cc8e0 con 0x7f3a900ffc60 2023-10-08T13:25:24.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.857+0000 7f3a8f7fe700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 0x7f3a7c0a3990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003730 tx=0x7f3a800036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:24.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:24.860+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a78096310 con 0x7f3a900ffc60 2023-10-08T13:25:25.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.106+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a90066bc0 con 0x7f3a900ffc60 2023-10-08T13:25:25.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.106+0000 7f3a8d7fa700 1 -- 172.21.15.139:0/3946546299 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8474 (secure 0 0 0) 0x7f3a78099930 con 0x7f3a900ffc60 2023-10-08T13:25:25.108 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:25.108 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 msgr2=0x7f3a7c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 0x7f3a7c0a3990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3a80003730 tx=0x7f3a800036c0 comp rx=0 tx=0).stop 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 msgr2=0x7f3a9019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800c970 tx=0x7f3a7800cc80 comp rx=0 tx=0).stop 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 shutdown_connections 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3a7c0a14d0 0x7f3a7c0a3990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a901057e0 0x7f3a90196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:25.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a900ffc60 0x7f3a9019c890 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:25.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 --2- 172.21.15.139:0/3946546299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a90100620 0x7f3a9019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:25.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 >> 172.21.15.139:0/3946546299 conn(0x7f3a90075a90 msgr2=0x7f3a900fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:25.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 shutdown_connections 2023-10-08T13:25:25.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:25.109+0000 7f3a96a37700 1 -- 172.21.15.139:0/3946546299 wait complete. 2023-10-08T13:25:25.111 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 11 2023-10-08T13:25:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6838/4169446012,v1:172.21.15.139:6839/4169446012] up:boot 2023-10-08T13:25:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: fsmap 10 up:standby 2023-10-08T13:25:25.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:24 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:25:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:25.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:25.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:25.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6838/4169446012,v1:172.21.15.139:6839/4169446012] up:boot 2023-10-08T13:25:25.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: fsmap 10 up:standby 2023-10-08T13:25:25.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:24 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:25:25.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6838/4169446012,v1:172.21.15.139:6839/4169446012] up:boot 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: fsmap 10 up:standby 2023-10-08T13:25:25.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:24 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:25:25.902 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:25 smithi139 systemd[1]: Starting Ceph mds.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:26.152 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:25 smithi139 podman[158605]: 2023-10-08T13:25:26.152 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:25 smithi139 ceph-mon[99506]: Deploying daemon mds.a on smithi139 2023-10-08T13:25:26.152 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:25 smithi139 ceph-mon[99506]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:26.152 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:25 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3946546299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:25 smithi187 ceph-mon[104336]: Deploying daemon mds.a on smithi139 2023-10-08T13:25:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:25 smithi187 ceph-mon[104336]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:25 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3946546299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:26.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:25 smithi155 ceph-mon[103467]: Deploying daemon mds.a on smithi139 2023-10-08T13:25:26.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:25 smithi155 ceph-mon[103467]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:26.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:25 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3946546299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:26.437 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:26 smithi139 bash[158605]: ac1c4ff4981e2181eaf9581ca871ab9926afb84579dbe7a02d9d27e737e9a78e 2023-10-08T13:25:26.437 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:26 smithi139 systemd[1]: Started Ceph mds.a for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:26.437 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:26 smithi139 ceph-mds[158645]: -- 172.21.15.139:0/344399043 <== mon.0 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f9d0db1e0 con 0x555f9d0b1000 2023-10-08T13:25:26.438 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:25:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: starting mds.a at 2023-10-08T13:25:27.122 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:27.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 -- 172.21.15.139:0/1973407456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64040feb50 msgr2=0x7f64040fefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:27.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 --2- 172.21.15.139:0/1973407456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64040feb50 0x7f64040fefd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009990 tx=0x7f63f0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 -- 172.21.15.139:0/1973407456 shutdown_connections 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 --2- 172.21.15.139:0/1973407456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040ff510 0x7f640410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 --2- 172.21.15.139:0/1973407456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6404106630 0x7f6404106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 --2- 172.21.15.139:0/1973407456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64040feb50 0x7f64040fefd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 -- 172.21.15.139:0/1973407456 >> 172.21.15.139:0/1973407456 conn(0x7f6404075a90 msgr2=0x7f64040fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 -- 172.21.15.139:0/1973407456 shutdown_connections 2023-10-08T13:25:27.268 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.266+0000 7f640ab59700 1 -- 172.21.15.139:0/1973407456 wait complete. 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 Processor -- start 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 -- start start 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040feb50 0x7f6404196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64040ff510 0x7f6404196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:27.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419b950 con 0x7f6404106630 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419bac0 con 0x7f64040feb50 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f640ab59700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640419bc80 con 0x7f64040ff510 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f64090f6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f64090f6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37976/0 (socket says 172.21.15.139:37976) 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f64090f6700 1 -- 172.21.15.139:0/170357567 learned_addr learned my addr 172.21.15.139:0/170357567 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f64088f5700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040feb50 0x7f6404196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.267+0000 7f6403fff700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64040ff510 0x7f6404196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 -- 172.21.15.139:0/170357567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64040ff510 msgr2=0x7f6404196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64040ff510 0x7f6404196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 -- 172.21.15.139:0/170357567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040feb50 msgr2=0x7f6404196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040feb50 0x7f6404196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 -- 172.21.15.139:0/170357567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00095f0 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f64090f6700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f63fc007ee0 tx=0x7f63fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc017070 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63fc00f040 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640419bf60 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc005740 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.268+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64041a3810 con 0x7f6404106630 2023-10-08T13:25:27.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.269+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6404108c40 con 0x7f6404106630 2023-10-08T13:25:27.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.270+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f63fc00dc60 con 0x7f6404106630 2023-10-08T13:25:27.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.270+0000 7f6401ffb700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 0x7f63f40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:27.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.270+0000 7f64088f5700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 0x7f63f40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:27.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.271+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f63fc0cc1c0 con 0x7f6404106630 2023-10-08T13:25:27.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.271+0000 7f64088f5700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 0x7f63f40a3a10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005950 tx=0x7f63f800a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:27.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.275+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f63fc095b50 con 0x7f6404106630 2023-10-08T13:25:27.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:27.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: Deploying daemon mds.b on smithi155 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6840/3823660758,v1:172.21.15.139:6841/3823660758] up:boot 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: fsmap 11 up:standby 2023-10-08T13:25:27.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:27 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:25:27.475 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.475 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.475 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: Deploying daemon mds.b on smithi155 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6840/3823660758,v1:172.21.15.139:6841/3823660758] up:boot 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: fsmap 11 up:standby 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:27 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:25:27.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: Deploying daemon mds.b on smithi155 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6840/3823660758,v1:172.21.15.139:6841/3823660758] up:boot 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: fsmap 11 up:standby 2023-10-08T13:25:27.477 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:27 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:25:27.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.509+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6404197d70 con 0x7f6404106630 2023-10-08T13:25:27.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.509+0000 7f6401ffb700 1 -- 172.21.15.139:0/170357567 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9269 (secure 0 0 0) 0x7f63fc099170 con 0x7f6404106630 2023-10-08T13:25:27.514 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:27.514 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 msgr2=0x7f63f40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 0x7f63f40a3a10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63f8005950 tx=0x7f63f800a300 comp rx=0 tx=0).stop 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 msgr2=0x7f640419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f63fc007ee0 tx=0x7f63fc00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 shutdown_connections 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63f40a1550 0x7f63f40a3a10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6404106630 0x7f640419b380 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64040feb50 0x7f6404196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 --2- 172.21.15.139:0/170357567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64040ff510 0x7f6404196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 >> 172.21.15.139:0/170357567 conn(0x7f6404075a90 msgr2=0x7f64040fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 shutdown_connections 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:27.512+0000 7f640ab59700 1 -- 172.21.15.139:0/170357567 wait complete. 2023-10-08T13:25:27.516 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 12 2023-10-08T13:25:27.846 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:27 smithi155 systemd[1]: Starting Ceph mds.b for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:25:28.301 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:28 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/170357567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:28.301 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:27 smithi155 podman[141262]: 2023-10-08T13:25:28.301 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:28 smithi155 ceph-mds[141302]: -- 172.21.15.155:0/1314710384 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557d13e2b1e0 con 0x557d13e00c00 2023-10-08T13:25:28.301 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: starting mds.b at 2023-10-08T13:25:28.301 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:28 smithi155 bash[141262]: a2e7923543b631931e9297d1ba933a813bf8167d3582557c46a9011fe7bfa62c 2023-10-08T13:25:28.476 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:28 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/170357567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:28.596 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:25:28 smithi155 systemd[1]: Started Ceph mds.b for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:25:28.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:28 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/170357567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:29.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:29.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.596 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:boot 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: fsmap 12 up:standby 2023-10-08T13:25:29.597 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:29 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 -- 172.21.15.139:0/3708552552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 msgr2=0x7f2a1010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/3708552552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1010d510 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800b0a0 tx=0x7f2a0800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 -- 172.21.15.139:0/3708552552 shutdown_connections 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/3708552552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1010d510 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/3708552552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/3708552552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 0x7f2a10100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 -- 172.21.15.139:0/3708552552 >> 172.21.15.139:0/3708552552 conn(0x7f2a100fc170 msgr2=0x7f2a100fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:29.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 -- 172.21.15.139:0/3708552552 shutdown_connections 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.663+0000 7f2a17c5d700 1 -- 172.21.15.139:0/3708552552 wait complete. 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.664+0000 7f2a17c5d700 1 Processor -- start 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.664+0000 7f2a17c5d700 1 -- start start 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 0x7f2a1019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10196ea0 con 0x7f2a10101000 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10197010 con 0x7f2a10100640 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101971d0 con 0x7f2a10106650 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a151f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:29.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a151f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:37986/0 (socket says 172.21.15.139:37986) 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a151f8700 1 -- 172.21.15.139:0/1903379490 learned_addr learned my addr 172.21.15.139:0/1903379490 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a159f9700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 0x7f2a1019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 -- 172.21.15.139:0/1903379490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 msgr2=0x7f2a1019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 0x7f2a1019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 -- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 msgr2=0x7f2a1019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 -- 172.21.15.139:0/1903379490 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009d00 con 0x7f2a10106650 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a151f8700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a161fa700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10196840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800b0a0 tx=0x7f2a08007870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:29.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800e040 con 0x7f2a10106650 2023-10-08T13:25:29.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a10197450 con 0x7f2a10106650 2023-10-08T13:25:29.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a08004e60 con 0x7f2a10106650 2023-10-08T13:25:29.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a101a3750 con 0x7f2a10106650 2023-10-08T13:25:29.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.665+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0801ddd0 con 0x7f2a10106650 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.667+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a10108c60 con 0x7f2a10106650 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.668+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f2a0801d470 con 0x7f2a10106650 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.668+0000 7f2a06ffd700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 0x7f29fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.668+0000 7f2a159f9700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 0x7f29fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.668+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f2a080cdb20 con 0x7f2a10106650 2023-10-08T13:25:29.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.669+0000 7f2a159f9700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 0x7f29fc0a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a10068f90 tx=0x7f2a0c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:29.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.676+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a080975e0 con 0x7f2a10106650 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:29.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:boot 2023-10-08T13:25:29.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: fsmap 12 up:standby 2023-10-08T13:25:29.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:29 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:25:29.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:boot 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: fsmap 12 up:standby 2023-10-08T13:25:29.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:29 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:25:29.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.946+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a10197d20 con 0x7f2a10106650 2023-10-08T13:25:29.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.947+0000 7f2a06ffd700 1 -- 172.21.15.139:0/1903379490 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10064 (secure 0 0 0) 0x7f2a0809ac00 con 0x7f2a10106650 2023-10-08T13:25:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:29.948 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24628,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T13:25:29.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 msgr2=0x7f29fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:29.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 0x7f29fc0a3990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a10068f90 tx=0x7f2a0c009260 comp rx=0 tx=0).stop 2023-10-08T13:25:29.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 msgr2=0x7f2a10196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10196840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800b0a0 tx=0x7f2a08007870 comp rx=0 tx=0).stop 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 shutdown_connections 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29fc0a14d0 0x7f29fc0a3990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a10106650 0x7f2a10196840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a10100640 0x7f2a1019c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 --2- 172.21.15.139:0/1903379490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2a10101000 0x7f2a1019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 >> 172.21.15.139:0/1903379490 conn(0x7f2a100fc170 msgr2=0x7f2a100fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 shutdown_connections 2023-10-08T13:25:29.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:29.949+0000 7f2a17c5d700 1 -- 172.21.15.139:0/1903379490 wait complete. 2023-10-08T13:25:29.952 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 13 2023-10-08T13:25:29.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:30.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 -- 172.21.15.139:0/1662841987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780ff540 msgr2=0x7fef780ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 --2- 172.21.15.139:0/1662841987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780ff540 0x7fef780ff9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0099c0 tx=0x7fef6c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 -- 172.21.15.139:0/1662841987 shutdown_connections 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 --2- 172.21.15.139:0/1662841987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef780fff00 0x7fef7810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 --2- 172.21.15.139:0/1662841987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef78105600 0x7fef781059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 --2- 172.21.15.139:0/1662841987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780ff540 0x7fef780ff9c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 -- 172.21.15.139:0/1662841987 >> 172.21.15.139:0/1662841987 conn(0x7fef780fb030 msgr2=0x7fef780fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 -- 172.21.15.139:0/1662841987 shutdown_connections 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.087+0000 7fef8046b700 1 -- 172.21.15.139:0/1662841987 wait complete. 2023-10-08T13:25:30.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 Processor -- start 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 -- start start 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 0x7fef78197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef78105600 0x7fef781a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78198630 con 0x7fef780fff00 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781a2e40 con 0x7fef78105600 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef8046b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781a2f80 con 0x7fef780ff540 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef7da06700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef7da06700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38000/0 (socket says 172.21.15.139:38000) 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef7da06700 1 -- 172.21.15.139:0/2594613117 learned_addr learned my addr 172.21.15.139:0/2594613117 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef7ea08700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef78105600 0x7fef781a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.088+0000 7fef7e207700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 0x7fef78197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 -- 172.21.15.139:0/2594613117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef78105600 msgr2=0x7fef781a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef78105600 0x7fef781a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 -- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 msgr2=0x7fef78197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 -- 172.21.15.139:0/2594613117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68009c40 con 0x7fef780ff540 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7da06700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef7e207700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 0x7fef78197880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68018070 con 0x7fef780ff540 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x7fef780ff540 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0095f0 con 0x7fef780ff540 2023-10-08T13:25:30.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68004280 con 0x7fef780ff540 2023-10-08T13:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.089+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef781a3580 con 0x7fef780ff540 2023-10-08T13:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.090+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef78107aa0 con 0x7fef780ff540 2023-10-08T13:25:30.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.091+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fef6800ca10 con 0x7fef780ff540 2023-10-08T13:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.092+0000 7fef777fe700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 0x7fef600a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.092+0000 7fef7da06700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 0x7fef600a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.092+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fef680cc260 con 0x7fef780ff540 2023-10-08T13:25:30.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.092+0000 7fef7da06700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 0x7fef600a3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef78068040 tx=0x7fef6c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.096+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fef68095c80 con 0x7fef780ff540 2023-10-08T13:25:30.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.302+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef78067df0 con 0x7fef780ff540 2023-10-08T13:25:30.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.303+0000 7fef777fe700 1 -- 172.21.15.139:0/2594613117 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18764 (secure 0 0 0) 0x7fef680992a0 con 0x7fef780ff540 2023-10-08T13:25:30.305 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:30.305 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":79,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:24:53.504638+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 msgr2=0x7fef600a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 0x7fef600a3a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef78068040 tx=0x7fef6c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 msgr2=0x7fef78197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 0x7fef78197880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef6800efc0 tx=0x7fef6800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 shutdown_connections 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fef600a1550 0x7fef600a3a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef78105600 0x7fef781a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef780ff540 0x7fef78197880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 --2- 172.21.15.139:0/2594613117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fef780fff00 0x7fef78197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 >> 172.21.15.139:0/2594613117 conn(0x7fef780fb030 msgr2=0x7fef780fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 shutdown_connections 2023-10-08T13:25:30.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.306+0000 7fef8046b700 1 -- 172.21.15.139:0/2594613117 wait complete. 2023-10-08T13:25:30.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:25:30.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:25:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 -- 172.21.15.139:0/2135148245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa581010e0 msgr2=0x7ffa5810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 --2- 172.21.15.139:0/2135148245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa581010e0 0x7ffa5810d5f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000b0a0 tx=0x7ffa5000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 -- 172.21.15.139:0/2135148245 shutdown_connections 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 --2- 172.21.15.139:0/2135148245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa581010e0 0x7ffa5810d5f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 --2- 172.21.15.139:0/2135148245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa58106730 0x7ffa58106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 --2- 172.21.15.139:0/2135148245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 0x7ffa58100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 -- 172.21.15.139:0/2135148245 >> 172.21.15.139:0/2135148245 conn(0x7ffa580fc230 msgr2=0x7ffa580fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 -- 172.21.15.139:0/2135148245 shutdown_connections 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.450+0000 7ffa5f160700 1 -- 172.21.15.139:0/2135148245 wait complete. 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 Processor -- start 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 -- start start 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 0x7ffa5819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa581010e0 0x7ffa5819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58196ff0 con 0x7ffa58106730 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58197160 con 0x7ffa58100720 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5f160700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa58197320 con 0x7ffa581010e0 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38016/0 (socket says 172.21.15.139:38016) 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 -- 172.21.15.139:0/661741692 learned_addr learned my addr 172.21.15.139:0/661741692 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa57fff700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa581010e0 0x7ffa5819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5cefc700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 0x7ffa5819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 -- 172.21.15.139:0/661741692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa581010e0 msgr2=0x7ffa5819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa581010e0 0x7ffa5819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 -- 172.21.15.139:0/661741692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 msgr2=0x7ffa5819c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 0x7ffa5819c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.451+0000 7ffa5d6fd700 1 -- 172.21.15.139:0/661741692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50009d00 con 0x7ffa58106730 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa5d6fd700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000b070 tx=0x7ffa50008ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000e040 con 0x7ffa58106730 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5001d470 con 0x7ffa58106730 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa581975a0 con 0x7ffa58106730 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500052a0 con 0x7ffa58106730 2023-10-08T13:25:30.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.452+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa58072c00 con 0x7ffa58106730 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.453+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa58108d20 con 0x7ffa58106730 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.455+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ffa5001d5e0 con 0x7ffa58106730 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.455+0000 7ffa55ffb700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 0x7ffa480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.455+0000 7ffa5cefc700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 0x7ffa480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.455+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ffa500cded0 con 0x7ffa58106730 2023-10-08T13:25:30.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.456+0000 7ffa5cefc700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 0x7ffa480a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c004150 tx=0x7ffa4c00f7d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.459+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffa50097990 con 0x7ffa58106730 2023-10-08T13:25:30.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.657+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa58066ca0 con 0x7ffa58106730 2023-10-08T13:25:30.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.657+0000 7ffa55ffb700 1 -- 172.21.15.139:0/661741692 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa50024350 con 0x7ffa58106730 2023-10-08T13:25:30.659 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:25:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 msgr2=0x7ffa480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 0x7ffa480a3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c004150 tx=0x7ffa4c00f7d0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 msgr2=0x7ffa58196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000b070 tx=0x7ffa50008ff0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 shutdown_connections 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa480a14d0 0x7ffa480a3990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa58106730 0x7ffa58196990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa58100720 0x7ffa5819c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 --2- 172.21.15.139:0/661741692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa581010e0 0x7ffa5819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 >> 172.21.15.139:0/661741692 conn(0x7ffa580fc230 msgr2=0x7ffa580fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 shutdown_connections 2023-10-08T13:25:30.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.659+0000 7ffa5f160700 1 -- 172.21.15.139:0/661741692 wait complete. 2023-10-08T13:25:30.671 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:30 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1903379490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:30.672 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:30 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2594613117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:30.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T13:25:30.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:30 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1903379490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:30.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:30 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2594613117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:30.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- 172.21.15.139:0/3423466064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc105600 msgr2=0x7faddc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 --2- 172.21.15.139:0/3423466064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc105600 0x7faddc1059e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fadd80099c0 tx=0x7fadd8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- 172.21.15.139:0/3423466064 shutdown_connections 2023-10-08T13:25:30.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 --2- 172.21.15.139:0/3423466064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0fff00 0x7faddc10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 --2- 172.21.15.139:0/3423466064 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc105600 0x7faddc1059e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 --2- 172.21.15.139:0/3423466064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc0ff540 0x7faddc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- 172.21.15.139:0/3423466064 >> 172.21.15.139:0/3423466064 conn(0x7faddc0fb030 msgr2=0x7faddc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- 172.21.15.139:0/3423466064 shutdown_connections 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- 172.21.15.139:0/3423466064 wait complete. 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 Processor -- start 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.798+0000 7fade470a700 1 -- start start 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 0x7faddc19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc105600 0x7faddc195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc195ea0 con 0x7faddc0fff00 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc196010 con 0x7faddc105600 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc1961d0 con 0x7faddc0ff540 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38028/0 (socket says 172.21.15.139:38028) 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 -- 172.21.15.139:0/622901169 learned_addr learned my addr 172.21.15.139:0/622901169 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade2ca7700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc105600 0x7faddc195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade24a6700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 0x7faddc19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 -- 172.21.15.139:0/622901169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 msgr2=0x7faddc19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 0x7faddc19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 -- 172.21.15.139:0/622901169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc105600 msgr2=0x7faddc195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:30.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc105600 0x7faddc195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 -- 172.21.15.139:0/622901169 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80095f0 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade24a6700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 0x7faddc19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade1ca5700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d950 tx=0x7fadd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0009940 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc1964b0 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadd0010460 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000f620 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.799+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc1a26f0 con 0x7faddc0fff00 2023-10-08T13:25:30.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.800+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc107a80 con 0x7faddc0fff00 2023-10-08T13:25:30.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.801+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fadd00108d0 con 0x7faddc0fff00 2023-10-08T13:25:30.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.802+0000 7fadcf7fe700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 0x7fadc80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:30.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.802+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fadd00cc820 con 0x7faddc0fff00 2023-10-08T13:25:30.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.802+0000 7fade24a6700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 0x7fadc80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:30.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.802+0000 7fade24a6700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 0x7fadc80a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f50 tx=0x7fadd8005c00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:30.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:30.805+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fadd0096250 con 0x7faddc0fff00 2023-10-08T13:25:30.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:30 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1903379490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:30.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:30 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2594613117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:31.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.018+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faddc100c60 con 0x7faddc0fff00 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.019+0000 7fadcf7fe700 1 -- 172.21.15.139:0/622901169 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7fadd0020090 con 0x7faddc0fff00 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "poolnum": 1, 2023-10-08T13:25:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "poolname": ".mgr" 2023-10-08T13:25:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:25:31.021 INFO:teuthology.orchestra.run.smithi139.stdout:] 2023-10-08T13:25:31.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 msgr2=0x7fadc80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:31.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 0x7fadc80a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009f50 tx=0x7fadd8005c00 comp rx=0 tx=0).stop 2023-10-08T13:25:31.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 msgr2=0x7faddc19bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:31.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fadd000d950 tx=0x7fadd000dc60 comp rx=0 tx=0).stop 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 shutdown_connections 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fadc80a14d0 0x7fadc80a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faddc105600 0x7faddc195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faddc0ff540 0x7faddc19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 --2- 172.21.15.139:0/622901169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faddc0fff00 0x7faddc19bc40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 >> 172.21.15.139:0/622901169 conn(0x7faddc0fb030 msgr2=0x7faddc0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:31.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 shutdown_connections 2023-10-08T13:25:31.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.021+0000 7fade470a700 1 -- 172.21.15.139:0/622901169 wait complete. 2023-10-08T13:25:31.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T13:25:31.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T13:25:31.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 -- 172.21.15.139:0/2945066912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0110100000 msgr2=0x7f011010c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:31.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 --2- 172.21.15.139:0/2945066912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0110100000 0x7f011010c510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f010800b0a0 tx=0x7f010800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 -- 172.21.15.139:0/2945066912 shutdown_connections 2023-10-08T13:25:31.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 --2- 172.21.15.139:0/2945066912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0110100000 0x7f011010c510 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.165 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 --2- 172.21.15.139:0/2945066912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 0x7f0110105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.165 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 --2- 172.21.15.139:0/2945066912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01100ff640 0x7f01100ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.165 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 -- 172.21.15.139:0/2945066912 >> 172.21.15.139:0/2945066912 conn(0x7f01100767c0 msgr2=0x7f0110076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:31.165 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 -- 172.21.15.139:0/2945066912 shutdown_connections 2023-10-08T13:25:31.165 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.163+0000 7f0115cf8700 1 -- 172.21.15.139:0/2945066912 wait complete. 2023-10-08T13:25:31.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 Processor -- start 2023-10-08T13:25:31.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 -- start start 2023-10-08T13:25:31.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:31.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 0x7f011019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:31.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 0x7f0110196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:31.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01101970f0 con 0x7f01100ff640 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110197260 con 0x7f0110105650 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f0115cf8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0110197420 con 0x7f0110100000 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f010f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f010f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38040/0 (socket says 172.21.15.139:38040) 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f010f7fe700 1 -- 172.21.15.139:0/1371070199 learned_addr learned my addr 172.21.15.139:0/1371070199 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:31.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f010effd700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 0x7f011019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.164+0000 7f010ffff700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 0x7f0110196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 -- 172.21.15.139:0/1371070199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 msgr2=0x7f011019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 0x7f011019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 -- 172.21.15.139:0/1371070199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 msgr2=0x7f0110196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 0x7f0110196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 -- 172.21.15.139:0/1371070199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108009d00 con 0x7f01100ff640 2023-10-08T13:25:31.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010effd700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 0x7f011019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010f7fe700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f010000e9a0 tx=0x7f010000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100009790 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0110197700 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0100010430 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100018680 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.165+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01101a3900 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.166+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0110100d80 con 0x7f01100ff640 2023-10-08T13:25:31.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.168+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f01000105a0 con 0x7f01100ff640 2023-10-08T13:25:31.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.169+0000 7f010cff9700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 0x7f00f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:31.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.169+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f0100014070 con 0x7f01100ff640 2023-10-08T13:25:31.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.169+0000 7f010effd700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 0x7f00f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:31.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.169+0000 7f010effd700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 0x7f00f80a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0110197c00 tx=0x7f0104009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:31.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.172+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f01000966e0 con 0x7f01100ff640 2023-10-08T13:25:31.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:31.423+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0110066ca0 con 0x7f01100ff640 2023-10-08T13:25:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/661741692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/622901169' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:25:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:31 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/661741692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/622901169' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:31 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/661741692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/622901169' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:31 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:32.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.412+0000 7f010cff9700 1 -- 172.21.15.139:0/1371070199 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0100099d00 con 0x7f01100ff640 2023-10-08T13:25:32.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.414+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 msgr2=0x7f00f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:32.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.414+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 0x7f00f80a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0110197c00 tx=0x7f0104009260 comp rx=0 tx=0).stop 2023-10-08T13:25:32.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.414+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 msgr2=0x7f011019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:32.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.414+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f010000e9a0 tx=0x7f010000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 shutdown_connections 2023-10-08T13:25:32.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00f80a14d0 0x7f00f80a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0110105650 0x7f0110196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01100ff640 0x7f011019c910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 --2- 172.21.15.139:0/1371070199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0110100000 0x7f011019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 >> 172.21.15.139:0/1371070199 conn(0x7f01100767c0 msgr2=0x7f0110103530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:32.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 shutdown_connections 2023-10-08T13:25:32.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.415+0000 7f0115cf8700 1 -- 172.21.15.139:0/1371070199 wait complete. 2023-10-08T13:25:32.419 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' created 2023-10-08T13:25:32.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-08T13:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 -- 172.21.15.139:0/1257237244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc1056b0 msgr2=0x7fcbcc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 --2- 172.21.15.139:0/1257237244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc105a90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400b0a0 tx=0x7fcbc400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 -- 172.21.15.139:0/1257237244 shutdown_connections 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 --2- 172.21.15.139:0/1257237244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 --2- 172.21.15.139:0/1257237244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc105a90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 --2- 172.21.15.139:0/1257237244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 -- 172.21.15.139:0/1257237244 >> 172.21.15.139:0/1257237244 conn(0x7fcbcc076780 msgr2=0x7fcbcc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 -- 172.21.15.139:0/1257237244 shutdown_connections 2023-10-08T13:25:32.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.564+0000 7fcbd117c700 1 -- 172.21.15.139:0/1257237244 wait complete. 2023-10-08T13:25:32.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 Processor -- start 2023-10-08T13:25:32.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 -- start start 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc1a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc198730 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc1a2f60 con 0x7fcbcc0ff620 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbd117c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc1a30a0 con 0x7fcbcc1056b0 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:32.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38056/0 (socket says 172.21.15.139:38056) 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbca59c700 1 -- 172.21.15.139:0/3005006456 learned_addr learned my addr 172.21.15.139:0/3005006456 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbcad9d700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbcb59e700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc1a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.565+0000 7fcbca59c700 1 -- 172.21.15.139:0/3005006456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 msgr2=0x7fcbcc1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbca59c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc1a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbca59c700 1 -- 172.21.15.139:0/3005006456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 msgr2=0x7fcbcc1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbca59c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbca59c700 1 -- 172.21.15.139:0/3005006456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009d00 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbcb59e700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc1a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbcad9d700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbca59c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400d980 tx=0x7fcbb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4009b40 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc1a3300 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbb400b6e0 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400f620 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.566+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc1a3810 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.567+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc107c10 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.568+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fcbb4010460 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.569+0000 7fcbc3fff700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 0x7fcbb80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.569+0000 7fcbcad9d700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 0x7fcbb80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.569+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7712+0+0 (secure 0 0 0) 0x7fcbb40cce20 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.569+0000 7fcbcad9d700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 0x7fcbb80a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009610 tx=0x7fcbc400b720 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:32.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.572+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcbb4096660 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:32 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:25:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:32 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:32.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:32 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:25:32.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:32.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:32.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:32.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:32 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:32.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:32.777+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fcbcc067560 con 0x7fcbcc0fffe0 2023-10-08T13:25:32.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:32 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T13:25:32.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:32.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:32.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:32.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:32 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:25:33.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.420+0000 7fcbc3fff700 1 -- 172.21.15.139:0/3005006456 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) v1 ==== 171+0+0 (secure 0 0 0) 0x7fcbb4099c80 con 0x7fcbcc0fffe0 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.424+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 msgr2=0x7fcbb80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 0x7fcbb80a3990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009610 tx=0x7fcbc400b720 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 msgr2=0x7fcbcc197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400d980 tx=0x7fcbb400dc90 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 shutdown_connections 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcbb80a14d0 0x7fcbb80a3990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbcc1056b0 0x7fcbcc1a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbcc0ff620 0x7fcbcc1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 --2- 172.21.15.139:0/3005006456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcbcc0fffe0 0x7fcbcc197ee0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.425+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 >> 172.21.15.139:0/3005006456 conn(0x7fcbcc076780 msgr2=0x7fcbcc0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:33.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.426+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 shutdown_connections 2023-10-08T13:25:33.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.438+0000 7fcbd117c700 1 -- 172.21.15.139:0/3005006456 wait complete. 2023-10-08T13:25:33.446 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' created 2023-10-08T13:25:33.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 -- 172.21.15.139:0/4276473838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 msgr2=0x7f562010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 --2- 172.21.15.139:0/4276473838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f562010d610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f561800b0a0 tx=0x7f561800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 -- 172.21.15.139:0/4276473838 shutdown_connections 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 --2- 172.21.15.139:0/4276473838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f562010d610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 --2- 172.21.15.139:0/4276473838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620106750 0x7f5620106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 --2- 172.21.15.139:0/4276473838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620068d80 0x7f5620069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 -- 172.21.15.139:0/4276473838 >> 172.21.15.139:0/4276473838 conn(0x7f56200767f0 msgr2=0x7f5620076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 -- 172.21.15.139:0/4276473838 shutdown_connections 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 -- 172.21.15.139:0/4276473838 wait complete. 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.593+0000 7f56261f5700 1 Processor -- start 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 -- start start 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620068d80 0x7f56200ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620106750 0x7f5620100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201a4fc0 con 0x7f5620069740 2023-10-08T13:25:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201a5130 con 0x7f5620068d80 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f56261f5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201a52f0 con 0x7f5620106750 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38078/0 (socket says 172.21.15.139:38078) 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 -- 172.21.15.139:0/4147613580 learned_addr learned my addr 172.21.15.139:0/4147613580 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561f7fe700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620068d80 0x7f56200ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561ffff700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620106750 0x7f5620100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 -- 172.21.15.139:0/4147613580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620106750 msgr2=0x7f5620100100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620106750 0x7f5620100100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 -- 172.21.15.139:0/4147613580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620068d80 msgr2=0x7f56200ff660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:33.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620068d80 0x7f56200ff660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 -- 172.21.15.139:0/4147613580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009d00 con 0x7f5620069740 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561effd700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f561000d950 tx=0x7f561000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.594+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5610009940 con 0x7f5620069740 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.595+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56201a55d0 con 0x7f5620069740 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.595+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5610010460 con 0x7f5620069740 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.595+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561000f620 con 0x7f5620069740 2023-10-08T13:25:33.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.595+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56201a5b30 con 0x7f5620069740 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.595+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5620108d60 con 0x7f5620069740 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.597+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f56100108d0 con 0x7f5620069740 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.597+0000 7f561cff9700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 0x7f56080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.597+0000 7f561f7fe700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 0x7f56080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.597+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8094+0+0 (secure 0 0 0) 0x7f56100ccb10 con 0x7f5620069740 2023-10-08T13:25:33.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.598+0000 7f561f7fe700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 0x7f56080a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5614009be0 tx=0x7f5614009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:33.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.601+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5610096250 con 0x7f5620069740 2023-10-08T13:25:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:25:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:33 smithi139 ceph-mon[99506]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:25:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:33 smithi139 ceph-mon[99506]: pgmap v230: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:33.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:25:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:25:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:33 smithi187 ceph-mon[104336]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:25:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:33 smithi187 ceph-mon[104336]: pgmap v230: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:25:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1371070199' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T13:25:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:33 smithi155 ceph-mon[103467]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T13:25:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:33 smithi155 ceph-mon[103467]: pgmap v230: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2023-10-08T13:25:33.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:33.851+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5620100b40 con 0x7f5620069740 2023-10-08T13:25:34.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.422+0000 7f561cff9700 1 -- 172.21.15.139:0/4147613580 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f56100200c0 con 0x7f5620069740 2023-10-08T13:25:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.425+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 msgr2=0x7f56080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.425+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 0x7f56080a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5614009be0 tx=0x7f5614009260 comp rx=0 tx=0).stop 2023-10-08T13:25:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.425+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 msgr2=0x7f56200ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.425+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f561000d950 tx=0x7f561000dc60 comp rx=0 tx=0).stop 2023-10-08T13:25:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 shutdown_connections 2023-10-08T13:25:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56080a14d0 0x7f56080a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5620106750 0x7f5620100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5620068d80 0x7f56200ff660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 --2- 172.21.15.139:0/4147613580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5620069740 0x7f56200ffba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 >> 172.21.15.139:0/4147613580 conn(0x7f56200767f0 msgr2=0x7f56200fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 shutdown_connections 2023-10-08T13:25:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.426+0000 7f56261f5700 1 -- 172.21.15.139:0/4147613580 wait complete. 2023-10-08T13:25:34.452 INFO:teuthology.orchestra.run.smithi139.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T13:25:34.461 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-08T13:25:34.462 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-08T13:25:34.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.590+0000 7f2913acd700 1 -- 172.21.15.139:0/121009805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c100000 msgr2=0x7f290c10c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:34.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.590+0000 7f2913acd700 1 --2- 172.21.15.139:0/121009805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c100000 0x7f290c10c4f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f290400b0a0 tx=0x7f290400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 -- 172.21.15.139:0/121009805 shutdown_connections 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 --2- 172.21.15.139:0/121009805 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c100000 0x7f290c10c4f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 --2- 172.21.15.139:0/121009805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c105630 0x7f290c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 --2- 172.21.15.139:0/121009805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c0ff640 0x7f290c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 -- 172.21.15.139:0/121009805 >> 172.21.15.139:0/121009805 conn(0x7f290c076790 msgr2=0x7f290c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 -- 172.21.15.139:0/121009805 shutdown_connections 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 -- 172.21.15.139:0/121009805 wait complete. 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 Processor -- start 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 -- start start 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.591+0000 7f2913acd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:34.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c100000 0x7f290c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 0x7f290c1a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c198790 con 0x7f290c0ff640 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c1a2f20 con 0x7f290c105630 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c1a3090 con 0x7f290c100000 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38090/0 (socket says 172.21.15.139:38090) 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 -- 172.21.15.139:0/1970867150 learned_addr learned my addr 172.21.15.139:0/1970867150 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911068700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c100000 0x7f290c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f291206a700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 0x7f290c1a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 -- 172.21.15.139:0/1970867150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c100000 msgr2=0x7f290c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:34.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c100000 0x7f290c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 -- 172.21.15.139:0/1970867150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 msgr2=0x7f290c1a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 0x7f290c1a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 -- 172.21.15.139:0/1970867150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009d00 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f291206a700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 0x7f290c1a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2911869700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d980 tx=0x7f28fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00bb60 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c1a3370 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28fc007640 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc004e90 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.592+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c1a3880 con 0x7f290c0ff640 2023-10-08T13:25:34.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.593+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c107c40 con 0x7f290c0ff640 2023-10-08T13:25:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.596+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f28fc00bcc0 con 0x7f290c0ff640 2023-10-08T13:25:34.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.596+0000 7f2902ffd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 0x7f28f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:34.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.597+0000 7f2911068700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 0x7f28f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:34.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.597+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f28fc0cd0b0 con 0x7f290c0ff640 2023-10-08T13:25:34.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.597+0000 7f2911068700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 0x7f28f80a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2908005fd0 tx=0x7f2908005f60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:34.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.599+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f28fc096730 con 0x7f290c0ff640 2023-10-08T13:25:34.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:34 smithi187 ceph-mon[104336]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:34.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:25:34.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:34 smithi187 ceph-mon[104336]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:25:34.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:25:34.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:34 smithi187 ceph-mon[104336]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:25:34.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:34.810+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f290c067980 con 0x7f290c0ff640 2023-10-08T13:25:34.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:34 smithi155 ceph-mon[103467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:34.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:25:34.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:34 smithi155 ceph-mon[103467]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:25:34.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:25:34.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:34 smithi155 ceph-mon[103467]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:25:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:34 smithi139 ceph-mon[99506]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3005006456' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2023-10-08T13:25:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:34 smithi139 ceph-mon[99506]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T13:25:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T13:25:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:34 smithi139 ceph-mon[99506]: daemon mds.i assigned to filesystem cephfs as rank 0 2023-10-08T13:25:35.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.423+0000 7f2902ffd700 1 -- 172.21.15.139:0/1970867150 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v83) v1 ==== 157+0+0 (secure 0 0 0) 0x7f28fc0160e0 con 0x7f290c0ff640 2023-10-08T13:25:35.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 msgr2=0x7f28f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:35.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 0x7f28f80a3990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2908005fd0 tx=0x7f2908005f60 comp rx=0 tx=0).stop 2023-10-08T13:25:35.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 msgr2=0x7f290c197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d980 tx=0x7f28fc00dd40 comp rx=0 tx=0).stop 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 shutdown_connections 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28f80a14d0 0x7f28f80a3990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f290c105630 0x7f290c1a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f290c0ff640 0x7f290c197960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 --2- 172.21.15.139:0/1970867150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f290c100000 0x7f290c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 >> 172.21.15.139:0/1970867150 conn(0x7f290c076790 msgr2=0x7f290c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 shutdown_connections 2023-10-08T13:25:35.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.427+0000 7f2913acd700 1 -- 172.21.15.139:0/1970867150 wait complete. 2023-10-08T13:25:35.442 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T13:25:35.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 -- 172.21.15.139:0/2283471682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f057410ac20 msgr2=0x7f057410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:35.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 --2- 172.21.15.139:0/2283471682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f057410ac20 0x7f057410d0e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f056c00b0a0 tx=0x7f056c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 -- 172.21.15.139:0/2283471682 shutdown_connections 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 --2- 172.21.15.139:0/2283471682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f057410ac20 0x7f057410d0e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 --2- 172.21.15.139:0/2283471682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574101800 0x7f0574101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 --2- 172.21.15.139:0/2283471682 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0574102120 0x7f057410a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 -- 172.21.15.139:0/2283471682 >> 172.21.15.139:0/2283471682 conn(0x7f05740fafe0 msgr2=0x7f05740fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 -- 172.21.15.139:0/2283471682 shutdown_connections 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.573+0000 7f057bc3c700 1 -- 172.21.15.139:0/2283471682 wait complete. 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 Processor -- start 2023-10-08T13:25:35.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 -- start start 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 0x7f05740ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f057410ac20 0x7f05740ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05741a4f80 con 0x7f0574101800 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05741a50f0 con 0x7f0574102120 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057bc3c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05741a52b0 con 0x7f057410ac20 2023-10-08T13:25:35.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38104/0 (socket says 172.21.15.139:38104) 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 -- 172.21.15.139:0/3579349776 learned_addr learned my addr 172.21.15.139:0/3579349776 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f057a1d9700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f057410ac20 0x7f05740ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05791d7700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 0x7f05740ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 -- 172.21.15.139:0/3579349776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f057410ac20 msgr2=0x7f05740ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f057410ac20 0x7f05740ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 -- 172.21.15.139:0/3579349776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 msgr2=0x7f05740ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 0x7f05740ff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 -- 172.21.15.139:0/3579349776 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c009d00 con 0x7f0574101800 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05791d7700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 0x7f05740ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.574+0000 7f05799d8700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f056400c920 tx=0x7f056400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.575+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564007b00 con 0x7f0574101800 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.575+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f056400ce70 con 0x7f0574101800 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.575+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05741a5590 con 0x7f0574101800 2023-10-08T13:25:35.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.575+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640054e0 con 0x7f0574101800 2023-10-08T13:25:35.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.575+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05741a5af0 con 0x7f0574101800 2023-10-08T13:25:35.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.576+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0574105d50 con 0x7f0574101800 2023-10-08T13:25:35.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.577+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0564004750 con 0x7f0574101800 2023-10-08T13:25:35.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.577+0000 7f056affd700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 0x7f05600a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:35.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.578+0000 7f05791d7700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 0x7f05600a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:35.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.578+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8420+0+0 (secure 0 0 0) 0x7f05640ccdb0 con 0x7f0574101800 2023-10-08T13:25:35.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.578+0000 7f05791d7700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 0x7f05600a3a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0570005e10 tx=0x7f0570005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:35.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.581+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0564096370 con 0x7f0574101800 2023-10-08T13:25:35.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: pgmap v233: 97 pgs: 15 creating+peering, 5 active+clean, 77 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:active 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:25:35.728 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:35 smithi187 ceph-mon[104336]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:25:35.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:35.772+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0574068110 con 0x7f0574101800 2023-10-08T13:25:35.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: pgmap v233: 97 pgs: 15 creating+peering, 5 active+clean, 77 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:active 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:25:35.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:35 smithi155 ceph-mon[103467]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:25:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4147613580' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T13:25:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T13:25:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: daemon mds.i is now active in filesystem cephfs as rank 0 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: pgmap v233: 97 pgs: 15 creating+peering, 5 active+clean, 77 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:25:35.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:25:35.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:25:35.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] up:active 2023-10-08T13:25:35.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:35.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1970867150' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2023-10-08T13:25:35.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:35 smithi139 ceph-mon[99506]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T13:25:36.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:36 smithi187 ceph-mon[104336]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:36.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:36 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:25:36.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:36 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:25:36.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:36 smithi155 ceph-mon[103467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:36.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:36 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:25:36.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:36 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:25:36.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:36 smithi139 ceph-mon[99506]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:36.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:36 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:25:36.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T13:25:37.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.463+0000 7f056affd700 1 -- 172.21.15.139:0/3579349776 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) v1 ==== 228+0+0 (secure 0 0 0) 0x7f056401d070 con 0x7f0574101800 2023-10-08T13:25:37.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 msgr2=0x7f05600a3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 0x7f05600a3a80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0570005e10 tx=0x7f0570005d60 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 msgr2=0x7f05740ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f056400c920 tx=0x7f056400cc30 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 shutdown_connections 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05600a15c0 0x7f05600a3a80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f057410ac20 0x7f05740ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0574101800 0x7f05740ff450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 --2- 172.21.15.139:0/3579349776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0574102120 0x7f05740ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.465+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 >> 172.21.15.139:0/3579349776 conn(0x7f05740fafe0 msgr2=0x7f05740fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.466+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 shutdown_connections 2023-10-08T13:25:37.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.466+0000 7f057bc3c700 1 -- 172.21.15.139:0/3579349776 wait complete. 2023-10-08T13:25:37.468 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' created 2023-10-08T13:25:37.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 -- 172.21.15.139:0/1402847152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 msgr2=0x7f1eb81001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/1402847152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb81001f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009990 tx=0x7f1eac009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 -- 172.21.15.139:0/1402847152 shutdown_connections 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/1402847152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8100730 0x7f1eb810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/1402847152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8105660 0x7f1eb8105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/1402847152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb81001f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 -- 172.21.15.139:0/1402847152 >> 172.21.15.139:0/1402847152 conn(0x7f1eb8075c20 msgr2=0x7f1eb80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.610+0000 7f1ebcb18700 1 -- 172.21.15.139:0/1402847152 shutdown_connections 2023-10-08T13:25:37.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 -- 172.21.15.139:0/1402847152 wait complete. 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 Processor -- start 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 -- start start 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 0x7f1eb8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8105660 0x7f1eb81a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81987f0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81a3000 con 0x7f1eb8100730 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.611+0000 7f1ebcb18700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81a3140 con 0x7f1eb8105660 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38118/0 (socket says 172.21.15.139:38118) 2023-10-08T13:25:37.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 -- 172.21.15.139:0/2073795345 learned_addr learned my addr 172.21.15.139:0/2073795345 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb5d9b700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 0x7f1eb8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb6d9d700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8105660 0x7f1eb81a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 -- 172.21.15.139:0/2073795345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8105660 msgr2=0x7f1eb81a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8105660 0x7f1eb81a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 -- 172.21.15.139:0/2073795345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 msgr2=0x7f1eb8197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 0x7f1eb8197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 -- 172.21.15.139:0/2073795345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac0095f0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb5d9b700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 0x7f1eb8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1eb659c700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800d950 tx=0x7f1ea800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8009b40 con 0x7f1eb80ffd70 2023-10-08T13:25:37.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ea8009ca0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb81a33d0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800f620 con 0x7f1eb80ffd70 2023-10-08T13:25:37.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.612+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb81a38e0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.613+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8107b90 con 0x7f1eb80ffd70 2023-10-08T13:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.614+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1ea8010460 con 0x7f1eb80ffd70 2023-10-08T13:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.615+0000 7f1ea77fe700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 0x7f1ea00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.615+0000 7f1eb5d9b700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 0x7f1ea00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.615+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8913+0+0 (secure 0 0 0) 0x7f1ea80cd2a0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.615+0000 7f1eb5d9b700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 0x7f1ea00a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1eac006010 tx=0x7f1eac01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:37.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.618+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ea80966f0 con 0x7f1eb80ffd70 2023-10-08T13:25:37.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:37 smithi187 ceph-mon[104336]: pgmap v236: 97 pgs: 15 creating+peering, 58 active+clean, 24 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:25:37.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:37 smithi187 ceph-mon[104336]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:25:37.726 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:25:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: 2023-10-08T13:25:37.376+0000 7f68c0aa5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T13:25:37.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:37.810+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1eb8100d80 con 0x7f1eb80ffd70 2023-10-08T13:25:37.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:37 smithi155 ceph-mon[103467]: pgmap v236: 97 pgs: 15 creating+peering, 58 active+clean, 24 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:25:37.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:37 smithi155 ceph-mon[103467]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:25:37.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:37 smithi139 ceph-mon[99506]: pgmap v236: 97 pgs: 15 creating+peering, 58 active+clean, 24 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2023-10-08T13:25:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:37 smithi139 ceph-mon[99506]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T13:25:38.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.466+0000 7f1ea77fe700 1 -- 172.21.15.139:0/2073795345 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1ea8099d10 con 0x7f1eb80ffd70 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 msgr2=0x7f1ea00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 0x7f1ea00a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1eac006010 tx=0x7f1eac01a040 comp rx=0 tx=0).stop 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 msgr2=0x7f1eb8197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800d950 tx=0x7f1ea800dd10 comp rx=0 tx=0).stop 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 shutdown_connections 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ea00a14d0 0x7f1ea00a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1eb8105660 0x7f1eb81a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1eb80ffd70 0x7f1eb8197a40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 --2- 172.21.15.139:0/2073795345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb8100730 0x7f1eb8197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.471 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 >> 172.21.15.139:0/2073795345 conn(0x7f1eb8075c20 msgr2=0x7f1eb80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:38.471 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 shutdown_connections 2023-10-08T13:25:38.471 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.469+0000 7f1ebcb18700 1 -- 172.21.15.139:0/2073795345 wait complete. 2023-10-08T13:25:38.471 INFO:teuthology.orchestra.run.smithi139.stderr:set pool 4 allow_ec_overwrites to true 2023-10-08T13:25:38.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- 172.21.15.139:0/2287080800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f0105660 msgr2=0x7fe9f0105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/2287080800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f0105660 0x7fe9f0105a40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009990 tx=0x7fe9ec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- 172.21.15.139:0/2287080800 shutdown_connections 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/2287080800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 0x7fe9f010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/2287080800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f0105660 0x7fe9f0105a40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/2287080800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f00ffd70 0x7fe9f01001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- 172.21.15.139:0/2287080800 >> 172.21.15.139:0/2287080800 conn(0x7fe9f0075c20 msgr2=0x7fe9f00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- 172.21.15.139:0/2287080800 shutdown_connections 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- 172.21.15.139:0/2287080800 wait complete. 2023-10-08T13:25:38.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 Processor -- start 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- start start 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 0x7fe9f0101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f0105660 0x7fe9f0101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f01a5030 con 0x7fe9f00ffd70 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f01a51a0 con 0x7fe9f0100730 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.620+0000 7fe9f85e0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f01a5360 con 0x7fe9f0105660 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38142/0 (socket says 172.21.15.139:38142) 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 -- 172.21.15.139:0/3228222809 learned_addr learned my addr 172.21.15.139:0/3228222809 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:38.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f6b7d700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f0105660 0x7fe9f0101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f5b7b700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 0x7fe9f0101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 -- 172.21.15.139:0/3228222809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f0105660 msgr2=0x7fe9f0101cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f0105660 0x7fe9f0101cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 -- 172.21.15.139:0/3228222809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 msgr2=0x7fe9f0101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 0x7fe9f0101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 -- 172.21.15.139:0/3228222809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0095f0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f637c700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec01d070 con 0x7fe9f00ffd70 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f01a55e0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9ec022470 con 0x7fe9f00ffd70 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec017650 con 0x7fe9f00ffd70 2023-10-08T13:25:38.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.621+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f01a5ae0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.622+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f0100d80 con 0x7fe9f00ffd70 2023-10-08T13:25:38.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.623+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fe9ec0225e0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.624+0000 7fe9e77fe700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 0x7fe9dc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:38.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.624+0000 7fe9f5b7b700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 0x7fe9dc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:38.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.624+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8913+0+0 (secure 0 0 0) 0x7fe9ec0ce890 con 0x7fe9f00ffd70 2023-10-08T13:25:38.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.624+0000 7fe9f5b7b700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 0x7fe9dc0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0005950 tx=0x7fe9e00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:38.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.627+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe9ec097df0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:38 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:25:38.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:38 smithi155 ceph-mon[103467]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:25:38.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:38 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:25:38.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:38.867+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fe9f0066ca0 con 0x7fe9f00ffd70 2023-10-08T13:25:38.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:38 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:25:38.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:38 smithi139 ceph-mon[99506]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:25:38.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:38 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:25:38.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:38 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3579349776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T13:25:38.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:38 smithi187 ceph-mon[104336]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T13:25:38.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:38 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2023-10-08T13:25:39.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.489+0000 7fe9e77fe700 1 -- 172.21.15.139:0/3228222809 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe9ec09b410 con 0x7fe9f00ffd70 2023-10-08T13:25:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 msgr2=0x7fe9dc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 0x7fe9dc0a3990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0005950 tx=0x7fe9e00058e0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 msgr2=0x7fe9f0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec004730 comp rx=0 tx=0).stop 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 shutdown_connections 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe9dc0a14d0 0x7fe9dc0a3990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe9f0105660 0x7fe9f0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9f00ffd70 0x7fe9f0101210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 --2- 172.21.15.139:0/3228222809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f0100730 0x7fe9f0101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 >> 172.21.15.139:0/3228222809 conn(0x7fe9f0075c20 msgr2=0x7fe9f00fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:39.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 shutdown_connections 2023-10-08T13:25:39.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.492+0000 7fe9f85e0700 1 -- 172.21.15.139:0/3228222809 wait complete. 2023-10-08T13:25:39.495 INFO:teuthology.orchestra.run.smithi139.stderr:added data pool 4 to fsmap 2023-10-08T13:25:39.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 -- 172.21.15.139:0/3400400096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100630 msgr2=0x7f04ec100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 --2- 172.21.15.139:0/3400400096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100630 0x7f04ec100ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009990 tx=0x7f04dc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 -- 172.21.15.139:0/3400400096 shutdown_connections 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 --2- 172.21.15.139:0/3400400096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec100ff0 0x7f04ec10d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 --2- 172.21.15.139:0/3400400096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec106640 0x7f04ec106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 --2- 172.21.15.139:0/3400400096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100630 0x7f04ec100ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 -- 172.21.15.139:0/3400400096 >> 172.21.15.139:0/3400400096 conn(0x7f04ec0fc1a0 msgr2=0x7f04ec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:39.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 -- 172.21.15.139:0/3400400096 shutdown_connections 2023-10-08T13:25:39.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.633+0000 7f04f34ef700 1 -- 172.21.15.139:0/3400400096 wait complete. 2023-10-08T13:25:39.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.634+0000 7f04f34ef700 1 Processor -- start 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.634+0000 7f04f34ef700 1 -- start start 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec100630 0x7f04ec19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec106640 0x7f04ec1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec196f40 con 0x7f04ec100ff0 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec1970b0 con 0x7f04ec100630 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec197270 con 0x7f04ec106640 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38158/0 (socket says 172.21.15.139:38158) 2023-10-08T13:25:39.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 -- 172.21.15.139:0/2966867630 learned_addr learned my addr 172.21.15.139:0/2966867630 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f1a8c700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec106640 0x7f04ec1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f128b700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec100630 0x7f04ec19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 -- 172.21.15.139:0/2966867630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec106640 msgr2=0x7f04ec1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec106640 0x7f04ec1968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 -- 172.21.15.139:0/2966867630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec100630 msgr2=0x7f04ec19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec100630 0x7f04ec19c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 -- 172.21.15.139:0/2966867630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0095f0 con 0x7f04ec100ff0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f0a8a700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0098e0 tx=0x7f04dc00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc01d070 con 0x7f04ec100ff0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec1974f0 con 0x7f04ec100ff0 2023-10-08T13:25:39.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04dc00fb90 con 0x7f04ec100ff0 2023-10-08T13:25:39.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc017650 con 0x7f04ec100ff0 2023-10-08T13:25:39.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.635+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec1a37a0 con 0x7f04ec100ff0 2023-10-08T13:25:39.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.636+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ec108c50 con 0x7f04ec100ff0 2023-10-08T13:25:39.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.637+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f04dc00fd00 con 0x7f04ec100ff0 2023-10-08T13:25:39.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.638+0000 7f04e27fc700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 0x7f04d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:39.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.638+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f04dc0ce470 con 0x7f04ec100ff0 2023-10-08T13:25:39.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.638+0000 7f04f128b700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 0x7f04d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:39.641 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.638+0000 7f04f128b700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 0x7f04d80a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04e8005fd0 tx=0x7f04e8005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:39.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.641+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04dc097890 con 0x7f04ec100ff0 2023-10-08T13:25:39.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:39 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:25:39.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:39 smithi155 ceph-mon[103467]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:25:39.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:39 smithi155 ceph-mon[103467]: pgmap v239: 129 pgs: 17 creating+peering, 85 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T13:25:39.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:39 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:25:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.881+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04ec101d70 con 0x7f04ec100ff0 2023-10-08T13:25:39.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.882+0000 7f04e27fc700 1 -- 172.21.15.139:0/2966867630 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11282 (secure 0 0 0) 0x7f04dc09aeb0 con 0x7f04ec100ff0 2023-10-08T13:25:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:39.884 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:25:38.868788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T13:25:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 msgr2=0x7f04d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 0x7f04d80a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04e8005fd0 tx=0x7f04e8005ee0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 msgr2=0x7f04ec19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0098e0 tx=0x7f04dc00f720 comp rx=0 tx=0).stop 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 shutdown_connections 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04d80a14d0 0x7f04d80a3990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec106640 0x7f04ec1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ec100630 0x7f04ec19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 --2- 172.21.15.139:0/2966867630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ec100ff0 0x7f04ec19ccf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 >> 172.21.15.139:0/2966867630 conn(0x7f04ec0fc1a0 msgr2=0x7f04ec0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 shutdown_connections 2023-10-08T13:25:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:39.884+0000 7f04f34ef700 1 -- 172.21.15.139:0/2966867630 wait complete. 2023-10-08T13:25:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2023-10-08T13:25:39.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:39 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:25:39.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:39 smithi139 ceph-mon[99506]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:25:39.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:39 smithi139 ceph-mon[99506]: pgmap v239: 129 pgs: 17 creating+peering, 85 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T13:25:39.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:39 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:25:39.897 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:39 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2073795345' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2023-10-08T13:25:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:39 smithi187 ceph-mon[104336]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T13:25:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:39 smithi187 ceph-mon[104336]: pgmap v239: 129 pgs: 17 creating+peering, 85 active+clean, 27 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 10 op/s 2023-10-08T13:25:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:39 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2023-10-08T13:25:40.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- 172.21.15.139:0/1701439828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69280ff540 msgr2=0x7f69280ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 --2- 172.21.15.139:0/1701439828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69280ff540 0x7f69280ff9c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f69240099c0 tx=0x7f6924009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- 172.21.15.139:0/1701439828 shutdown_connections 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 --2- 172.21.15.139:0/1701439828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280fff00 0x7f692810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 --2- 172.21.15.139:0/1701439828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6928105600 0x7f69281059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 --2- 172.21.15.139:0/1701439828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69280ff540 0x7f69280ff9c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- 172.21.15.139:0/1701439828 >> 172.21.15.139:0/1701439828 conn(0x7f69280fb030 msgr2=0x7f69280fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- 172.21.15.139:0/1701439828 shutdown_connections 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- 172.21.15.139:0/1701439828 wait complete. 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 Processor -- start 2023-10-08T13:25:40.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 -- start start 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.019+0000 7f692fffe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 0x7f692819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69280fff00 0x7f692819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928195e40 con 0x7f6928105600 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928195fb0 con 0x7f69280fff00 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6928196170 con 0x7f69280ff540 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38174/0 (socket says 172.21.15.139:38174) 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 -- 172.21.15.139:0/3088153628 learned_addr learned my addr 172.21.15.139:0/3088153628 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:40.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692dd9a700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 0x7f692819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692d599700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69280fff00 0x7f692819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 -- 172.21.15.139:0/3088153628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 msgr2=0x7f692819b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 0x7f692819b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 -- 172.21.15.139:0/3088153628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69280fff00 msgr2=0x7f692819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69280fff00 0x7f692819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 -- 172.21.15.139:0/3088153628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240095f0 con 0x7f6928105600 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692dd9a700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 0x7f692819b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692e59b700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6920007ee0 tx=0x7f692000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920017070 con 0x7f6928105600 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f692000f040 con 0x7f6928105600 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6928196450 con 0x7f6928105600 2023-10-08T13:25:40.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920005740 con 0x7f6928105600 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.020+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69281a2690 con 0x7f6928105600 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.021+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6928107aa0 con 0x7f6928105600 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.022+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f69200058a0 con 0x7f6928105600 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.023+0000 7f691effd700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 0x7f69140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.023+0000 7f692dd9a700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 0x7f69140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.023+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f69200cc900 con 0x7f6928105600 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.023+0000 7f692dd9a700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 0x7f69140a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6918005950 tx=0x7f6918005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.027+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6920095c90 con 0x7f6928105600 2023-10-08T13:25:40.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.221+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6928100c60 con 0x7f6928105600 2023-10-08T13:25:40.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.223+0000 7f691effd700 1 -- 172.21.15.139:0/3088153628 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f69200992b0 con 0x7f6928105600 2023-10-08T13:25:40.224 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:40.224 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 msgr2=0x7f69140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 0x7f69140a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6918005950 tx=0x7f6918005f50 comp rx=0 tx=0).stop 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 msgr2=0x7f69281957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6920007ee0 tx=0x7f692000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 shutdown_connections 2023-10-08T13:25:40.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69140a14d0 0x7f69140a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6928105600 0x7f69281957d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69280ff540 0x7f692819b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 --2- 172.21.15.139:0/3088153628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69280fff00 0x7f692819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 >> 172.21.15.139:0/3088153628 conn(0x7f69280fb030 msgr2=0x7f69280fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 shutdown_connections 2023-10-08T13:25:40.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.225+0000 7f692fffe700 1 -- 172.21.15.139:0/3088153628 wait complete. 2023-10-08T13:25:40.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:40.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 -- 172.21.15.139:0/824759127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff560 msgr2=0x7f133c0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 --2- 172.21.15.139:0/824759127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff560 0x7f133c0ff9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f132c0099c0 tx=0x7f132c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 -- 172.21.15.139:0/824759127 shutdown_connections 2023-10-08T13:25:40.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 --2- 172.21.15.139:0/824759127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff20 0x7f133c10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 --2- 172.21.15.139:0/824759127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c105620 0x7f133c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 --2- 172.21.15.139:0/824759127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff560 0x7f133c0ff9e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 -- 172.21.15.139:0/824759127 >> 172.21.15.139:0/824759127 conn(0x7f133c0fb050 msgr2=0x7f133c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 -- 172.21.15.139:0/824759127 shutdown_connections 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 -- 172.21.15.139:0/824759127 wait complete. 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.360+0000 7f13412ef700 1 Processor -- start 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 -- start start 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff560 0x7f133c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105620 0x7f133c1a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c198650 con 0x7f133c0fff20 2023-10-08T13:25:40.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a2e60 con 0x7f133c0ff560 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f13412ef700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a2fa0 con 0x7f133c105620 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38186/0 (socket says 172.21.15.139:38186) 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 -- 172.21.15.139:0/2780110967 learned_addr learned my addr 172.21.15.139:0/2780110967 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133affd700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff560 0x7f133c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133b7fe700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105620 0x7f133c1a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 -- 172.21.15.139:0/2780110967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105620 msgr2=0x7f133c1a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105620 0x7f133c1a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 -- 172.21.15.139:0/2780110967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff560 msgr2=0x7f133c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff560 0x7f133c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 -- 172.21.15.139:0/2780110967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0095f0 con 0x7f133c0fff20 2023-10-08T13:25:40.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.361+0000 7f133a7fc700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b580 tx=0x7f132c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c01d070 con 0x7f133c0fff20 2023-10-08T13:25:40.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c1a31d0 con 0x7f133c0fff20 2023-10-08T13:25:40.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f132c00fb30 con 0x7f133c0fff20 2023-10-08T13:25:40.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c022c60 con 0x7f133c0fff20 2023-10-08T13:25:40.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1a3650 con 0x7f133c0fff20 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.362+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c107ac0 con 0x7f133c0fff20 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.364+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f132c00fca0 con 0x7f133c0fff20 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.364+0000 7f1333fff700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.364+0000 7f133affd700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.364+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f132c0ce4e0 con 0x7f133c0fff20 2023-10-08T13:25:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.365+0000 7f133affd700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1324005950 tx=0x7f132400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.368+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f132c097900 con 0x7f133c0fff20 2023-10-08T13:25:40.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.562+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f133c100c80 con 0x7f133c0fff20 2023-10-08T13:25:40.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.563+0000 7f1333fff700 1 -- 172.21.15.139:0/2780110967 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f132c09af20 con 0x7f133c0fff20 2023-10-08T13:25:40.565 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:40.565 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.565+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 msgr2=0x7f13280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1324005950 tx=0x7f132400b410 comp rx=0 tx=0).stop 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 msgr2=0x7f133c197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f132c00b580 tx=0x7f132c004730 comp rx=0 tx=0).stop 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 shutdown_connections 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105620 0x7f133c1a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff560 0x7f133c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 --2- 172.21.15.139:0/2780110967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0fff20 0x7f133c197de0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 >> 172.21.15.139:0/2780110967 conn(0x7f133c0fb050 msgr2=0x7f133c0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 shutdown_connections 2023-10-08T13:25:40.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.566+0000 7f13412ef700 1 -- 172.21.15.139:0/2780110967 wait complete. 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2966867630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:40.578 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:40 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3088153628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:40.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:25:40.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 -- 172.21.15.139:0/3725446606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf040feb50 msgr2=0x7fbf040fefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 --2- 172.21.15.139:0/3725446606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf040feb50 0x7fbf040fefd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009990 tx=0x7fbef8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 -- 172.21.15.139:0/3725446606 shutdown_connections 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 --2- 172.21.15.139:0/3725446606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040ff510 0x7fbf0410d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 --2- 172.21.15.139:0/3725446606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf04106630 0x7fbf04106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 --2- 172.21.15.139:0/3725446606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf040feb50 0x7fbf040fefd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 -- 172.21.15.139:0/3725446606 >> 172.21.15.139:0/3725446606 conn(0x7fbf04075a90 msgr2=0x7fbf040fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 -- 172.21.15.139:0/3725446606 shutdown_connections 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.715+0000 7fbf09197700 1 -- 172.21.15.139:0/3725446606 wait complete. 2023-10-08T13:25:40.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 Processor -- start 2023-10-08T13:25:40.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 -- start start 2023-10-08T13:25:40.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040feb50 0x7fbf04196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040ff510 0x7fbf04196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0419b910 con 0x7fbf04106630 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0419ba80 con 0x7fbf040ff510 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf09197700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0419bc40 con 0x7fbf040feb50 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf0359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf0359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38202/0 (socket says 172.21.15.139:38202) 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.716+0000 7fbf0359e700 1 -- 172.21.15.139:0/1579183163 learned_addr learned my addr 172.21.15.139:0/1579183163 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0259c700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040ff510 0x7fbf04196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf02d9d700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040feb50 0x7fbf04196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 -- 172.21.15.139:0/1579183163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040feb50 msgr2=0x7fbf04196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040feb50 0x7fbf04196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 -- 172.21.15.139:0/1579183163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040ff510 msgr2=0x7fbf04196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040ff510 0x7fbf04196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 -- 172.21.15.139:0/1579183163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80095f0 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf0359e700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbefc007ee0 tx=0x7fbefc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004db0 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbefc016070 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0419bf20 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc012d30 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.717+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf040ffe40 con 0x7fbf04106630 2023-10-08T13:25:40.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.718+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf04108c40 con 0x7fbf04106630 2023-10-08T13:25:40.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.719+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fbefc018030 con 0x7fbf04106630 2023-10-08T13:25:40.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.720+0000 7fbeebfff700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 0x7fbeec0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:40.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.720+0000 7fbf02d9d700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 0x7fbeec0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:40.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.720+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fbefc0d0830 con 0x7fbf04106630 2023-10-08T13:25:40.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.720+0000 7fbf02d9d700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 0x7fbeec0a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbef400dad0 tx=0x7fbef400d4b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:40.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.724+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbefc099bc0 con 0x7fbf04106630 2023-10-08T13:25:40.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:40.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:25:40.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:25:40.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:40.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2966867630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:40.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:40 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3088153628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:40.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.959+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf04066bc0 con 0x7fbf04106630 2023-10-08T13:25:40.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.960+0000 7fbeebfff700 1 -- 172.21.15.139:0/1579183163 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11282 (secure 0 0 0) 0x7fbefc086e60 con 0x7fbf04106630 2023-10-08T13:25:40.961 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:40.961 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24566,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:25:38.868788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":24628},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-08T13:25:40.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 msgr2=0x7fbeec0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 0x7fbeec0a3990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbef400dad0 tx=0x7fbef400d4b0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 msgr2=0x7fbf0419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbefc007ee0 tx=0x7fbefc00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 shutdown_connections 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbeec0a14d0 0x7fbeec0a3990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf04106630 0x7fbf0419b340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbf040feb50 0x7fbf04196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 --2- 172.21.15.139:0/1579183163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf040ff510 0x7fbf04196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 >> 172.21.15.139:0/1579183163 conn(0x7fbf04075a90 msgr2=0x7fbf040fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:40.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 shutdown_connections 2023-10-08T13:25:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:40.962+0000 7fbf09197700 1 -- 172.21.15.139:0/1579183163 wait complete. 2023-10-08T13:25:40.965 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 16 2023-10-08T13:25:40.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:40.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T13:25:40.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T13:25:40.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3228222809' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2023-10-08T13:25:40.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:25:40.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2966867630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:40.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:40 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3088153628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/2721352445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 msgr2=0x7f0bb010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/2721352445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb010c3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800b0d0 tx=0x7f0ba800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/2721352445 shutdown_connections 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/2721352445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb010c3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/2721352445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb0105600 0x7f0bb01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/2721352445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb00ff540 0x7f0bb00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.097+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/2721352445 >> 172.21.15.139:0/2721352445 conn(0x7f0bb00fb030 msgr2=0x7f0bb00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.098+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/2721352445 shutdown_connections 2023-10-08T13:25:41.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.098+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/2721352445 wait complete. 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.098+0000 7f0bb4a9e700 1 Processor -- start 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 -- start start 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb00ff540 0x7f0bb019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb0105600 0x7f0bb0195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0195f80 con 0x7f0bb00fff00 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01960f0 con 0x7f0bb0105600 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bb4a9e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01962b0 con 0x7f0bb00ff540 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38214/0 (socket says 172.21.15.139:38214) 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 -- 172.21.15.139:0/3123328608 learned_addr learned my addr 172.21.15.139:0/3123328608 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0baed9d700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb0105600 0x7f0bb0195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0bae59c700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb00ff540 0x7f0bb019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 -- 172.21.15.139:0/3123328608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb00ff540 msgr2=0x7f0bb019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb00ff540 0x7f0bb019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 -- 172.21.15.139:0/3123328608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb0105600 msgr2=0x7f0bb0195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb0105600 0x7f0bb0195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 -- 172.21.15.139:0/3123328608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8009d00 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.099+0000 7f0badd9b700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009970 tx=0x7f0ba4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4012070 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ba400d260 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb0196590 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4017860 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb0067a10 con 0x7f0bb00fff00 2023-10-08T13:25:41.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.100+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb0100c60 con 0x7f0bb00fff00 2023-10-08T13:25:41.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.102+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0ba4007af0 con 0x7f0bb00fff00 2023-10-08T13:25:41.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.102+0000 7f0b9f7fe700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 0x7f0b980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.102+0000 7f0bae59c700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 0x7f0b980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.102+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f0ba40ce1e0 con 0x7f0bb00fff00 2023-10-08T13:25:41.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.103+0000 7f0bae59c700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 0x7f0b980a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0005950 tx=0x7f0ba000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.106+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0ba4097570 con 0x7f0bb00fff00 2023-10-08T13:25:41.298 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.297+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb0067450 con 0x7f0bb00fff00 2023-10-08T13:25:41.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.298+0000 7f0b9f7fe700 1 -- 172.21.15.139:0/3123328608 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f0ba401c090 con 0x7f0bb00fff00 2023-10-08T13:25:41.300 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:41.300 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 msgr2=0x7f0b980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 0x7f0b980a3a10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0005950 tx=0x7f0ba000a300 comp rx=0 tx=0).stop 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 msgr2=0x7f0bb019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009970 tx=0x7f0ba4009c80 comp rx=0 tx=0).stop 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 shutdown_connections 2023-10-08T13:25:41.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0b980a1550 0x7f0b980a3a10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb0105600 0x7f0bb0195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bb00ff540 0x7f0bb019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 --2- 172.21.15.139:0/3123328608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bb00fff00 0x7f0bb019bd30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 >> 172.21.15.139:0/3123328608 conn(0x7f0bb00fb030 msgr2=0x7f0bb00fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 shutdown_connections 2023-10-08T13:25:41.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.301+0000 7f0bb4a9e700 1 -- 172.21.15.139:0/3123328608 wait complete. 2023-10-08T13:25:41.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T13:25:33.853946+0000', 'modified': '2023-10-08T13:25:38.868788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24628}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.187:6839/3909111900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 3909111900}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 3909111900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-08T13:25:41.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T13:25:41.315 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:25:41.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 -- 172.21.15.139:0/2555030345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 msgr2=0x7f8d9c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 --2- 172.21.15.139:0/2555030345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c105a90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009990 tx=0x7f8d8c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 -- 172.21.15.139:0/2555030345 shutdown_connections 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 --2- 172.21.15.139:0/2555030345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 0x7f8d9c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 --2- 172.21.15.139:0/2555030345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c105a90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 --2- 172.21.15.139:0/2555030345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 -- 172.21.15.139:0/2555030345 >> 172.21.15.139:0/2555030345 conn(0x7f8d9c076780 msgr2=0x7f8d9c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 -- 172.21.15.139:0/2555030345 shutdown_connections 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 -- 172.21.15.139:0/2555030345 wait complete. 2023-10-08T13:25:41.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.436+0000 7f8da10d1700 1 Processor -- start 2023-10-08T13:25:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 -- start start 2023-10-08T13:25:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 0x7f8d9c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19cb50 con 0x7f8d9c1056b0 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19ccc0 con 0x7f8d9c0ff620 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8da10d1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19ce80 con 0x7f8d9c0fffe0 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:56746/0 (socket says 172.21.15.139:56746) 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38230/0 (socket says 172.21.15.139:38230) 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9ad9d700 1 -- 172.21.15.139:0/3260266664 learned_addr learned my addr 172.21.15.139:0/3260266664 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 0x7f8d9c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 -- 172.21.15.139:0/3260266664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 msgr2=0x7f8d9c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 0x7f8d9c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 -- 172.21.15.139:0/3260266664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 msgr2=0x7f8d9c198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 -- 172.21.15.139:0/3260266664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0095f0 con 0x7f8d9c1056b0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.437+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400efc0 tx=0x7f8d9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.438+0000 7f8d83fff700 1 -- 172.21.15.139:0/3260266664 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94018070 con 0x7f8d9c1056b0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.438+0000 7f8d83fff700 1 -- 172.21.15.139:0/3260266664 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9400f040 con 0x7f8d9c1056b0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.438+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c19d100 con 0x7f8d9c1056b0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.438+0000 7f8d83fff700 1 -- 172.21.15.139:0/3260266664 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400cd40 con 0x7f8d9c1056b0 2023-10-08T13:25:41.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.438+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c1a5ac0 con 0x7f8d9c1056b0 2023-10-08T13:25:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.440+0000 7f8d83fff700 1 -- 172.21.15.139:0/3260266664 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f8d94003a00 con 0x7f8d9c1056b0 2023-10-08T13:25:41.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.441+0000 7f8d83fff700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 0x7f8d840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.441+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 0x7f8d840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.441+0000 7f8d83fff700 1 -- 172.21.15.139:0/3260266664 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8d940ccc10 con 0x7f8d9c1056b0 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.441+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 0x7f8d840a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00b2e0 tx=0x7f8d8c005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 Processor -- start 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 -- start start 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3481fe30 0x55cc34820210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc3482b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34789410 con 0x55cc3482b600 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3477abd0 con 0x55cc3481fe30 2023-10-08T13:25:41.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc347784f0 con 0x55cc34820750 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8d9a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc3482b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38238/0 (socket says 172.21.15.139:38238) 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.442+0000 7f8d9b59e700 1 -- 172.21.15.139:0/1204182856 learned_addr learned my addr 172.21.15.139:0/1204182856 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3481fe30 0x55cc34820210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 -- 172.21.15.139:0/1204182856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 msgr2=0x55cc3482b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc3482b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 -- 172.21.15.139:0/1204182856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3481fe30 msgr2=0x55cc34820210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3481fe30 0x55cc34820210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 -- 172.21.15.139:0/1204182856 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc3459ed90 con 0x55cc3482b600 2023-10-08T13:25:41.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8d940090a0 tx=0x7f8d94099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60e67c9ff4a2ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d817fa700 1 -- 172.21.15.139:0/1204182856 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94004ad0 con 0x55cc3482b600 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d817fa700 1 -- 172.21.15.139:0/1204182856 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9409a3f0 con 0x55cc3482b600 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.443+0000 7f8d817fa700 1 -- 172.21.15.139:0/1204182856 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940981b0 con 0x55cc3482b600 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- 172.21.15.139:0/1204182856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 msgr2=0x55cc3482d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8d940090a0 tx=0x7f8d94099b40 comp rx=0 tx=0).stop 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- 172.21.15.139:0/1204182856 shutdown_connections 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc3482d9f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3481fe30 0x55cc34820210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/1204182856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc3482b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- 172.21.15.139:0/1204182856 >> 172.21.15.139:0/1204182856 conn(0x55cc34795210 msgr2=0x55cc3481c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- 172.21.15.139:0/1204182856 shutdown_connections 2023-10-08T13:25:41.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- 172.21.15.139:0/1204182856 wait complete. 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 -- start start 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 Processor -- start 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.444+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc3482b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc34828a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34773de0 con 0x55cc34820750 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc347106c0 con 0x55cc3482b600 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34710360 con 0x55cc3481fe30 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 10 client.0 _ll_register_callbacks cb 0x55cc3456d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc3482b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38242/0 (socket says 172.21.15.139:38242) 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 -- 172.21.15.139:0/191485536 learned_addr learned my addr 172.21.15.139:0/191485536 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc34828a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 -- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 msgr2=0x55cc3482b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc3482b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 -- 172.21.15.139:0/191485536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 msgr2=0x55cc34828a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc34828a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 -- 172.21.15.139:0/191485536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d940b9040 con 0x55cc34820750 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc3482b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8d90012840 tx=0x7f8d90012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff12efd5ec37ada3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:25:41.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90017070 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc3473be60 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8d90004830 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d90004a30 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 10 client.14955 fetch_fsmap learned FSMap version 16 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.445+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x55cc34587c10 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d90025020 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 16) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8d9001c590 con 0x55cc34820750 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 10 client.14955 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 10 client.14955 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 20 client.14955 populate_metadata read hostname 'smithi139' 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc34839d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 4 client.14955 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc3476cdc0 con 0x55cc3483b260 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.446+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc34839d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8d7eff5700 10 client.14955 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc34839d40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4683294a000c1c51 server_cookie=a590a118de429d3 in_seq=0 out_seq=0 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8d7eff5700 1 -- 172.21.15.139:0/191485536 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc3476cdc0 con 0x55cc3483b260 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8d7eff5700 10 client.14955 handle_command_reply: tid=0 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 client.14955 shutdown 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 msgr2=0x55cc34828340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8d90012840 tx=0x7f8d90012b50 comp rx=0 tx=0).stop 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 shutdown_connections 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc34839d40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc34828a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8d7eff5700 0 client.14955 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc3482b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/191485536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc34820750 0x55cc34828340 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 >> 172.21.15.139:0/191485536 conn(0x55cc34795210 msgr2=0x55cc3481be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 shutdown_connections 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.447+0000 7f8dad2bab80 1 -- 172.21.15.139:0/191485536 wait complete. 2023-10-08T13:25:41.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.448+0000 7f8dad2bab80 20 client.14955 trim_cache size 0 max 16384 2023-10-08T13:25:41.472 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 Processor -- start 2023-10-08T13:25:41.472 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 -- start start 2023-10-08T13:25:41.472 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc348282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc34820750 0x55cc3482abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc345f48d0 con 0x55cc3482b600 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34732590 con 0x55cc34820750 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc348299b0 con 0x55cc3481fe30 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.465+0000 7f8d9b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38252/0 (socket says 172.21.15.139:38252) 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 -- 172.21.15.139:0/2940685330 learned_addr learned my addr 172.21.15.139:0/2940685330 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.473 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc348282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc34820750 0x55cc3482abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 -- 172.21.15.139:0/2940685330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 msgr2=0x55cc348282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc348282e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 -- 172.21.15.139:0/2940685330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc34820750 msgr2=0x55cc3482abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc34820750 0x55cc3482abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 -- 172.21.15.139:0/2940685330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc345c5200 con 0x55cc3482b600 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c6f0 tx=0x7f8d940a0060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e2cabe154f87ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d81ffb700 1 -- 172.21.15.139:0/2940685330 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940a1ff0 con 0x55cc3482b600 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d81ffb700 1 -- 172.21.15.139:0/2940685330 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d94004ad0 con 0x55cc3482b600 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.466+0000 7f8d81ffb700 1 -- 172.21.15.139:0/2940685330 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94099f50 con 0x55cc3482b600 2023-10-08T13:25:41.474 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- 172.21.15.139:0/2940685330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 msgr2=0x55cc348255c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400c6f0 tx=0x7f8d940a0060 comp rx=0 tx=0).stop 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- 172.21.15.139:0/2940685330 shutdown_connections 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3482b600 0x55cc348255c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc3481fe30 0x55cc348282e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/2940685330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc34820750 0x55cc3482abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- 172.21.15.139:0/2940685330 >> 172.21.15.139:0/2940685330 conn(0x55cc34795210 msgr2=0x55cc34827bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- 172.21.15.139:0/2940685330 shutdown_connections 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- 172.21.15.139:0/2940685330 wait complete. 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- start start 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 Processor -- start 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.475 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc34825e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc348245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34824af0 con 0x55cc3481fe30 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34824c60 con 0x55cc3482b600 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc34824e20 con 0x55cc34820750 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8dad2bab80 10 client.0 _ll_register_callbacks cb 0x7f8d90009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8d9ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38254/0 (socket says 172.21.15.139:38254) 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.467+0000 7f8d9ad9d700 1 -- 172.21.15.139:0/4160103330 learned_addr learned my addr 172.21.15.139:0/4160103330 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc34825e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc348245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.476 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 -- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 msgr2=0x55cc34825e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc34825e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 -- 172.21.15.139:0/4160103330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 msgr2=0x55cc348245b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc348245b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 -- 172.21.15.139:0/4160103330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc3459ed90 con 0x55cc3481fe30 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9b59e700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc348245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d9ad9d700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0098e0 tx=0x7f8d8c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f84d888173f983 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d7eff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c02d040 con 0x55cc3481fe30 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f8d8c035250 con 0x55cc3481fe30 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d9409a3f0 con 0x55cc3481fe30 2023-10-08T13:25:41.477 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d8c035410 con 0x55cc3481fe30 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8dad2bab80 10 client.14961 fetch_fsmap learned FSMap version 16 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) v3 -- 0x55cc3459d260 con 0x55cc3481fe30 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.468+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9409a3f0 con 0x55cc3481fe30 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 16) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8d8c034720 con 0x55cc3481fe30 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 10 client.14961 fetch_fsmap finished waiting for FSMap version 16 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 10 client.14961 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 20 client.14961 populate_metadata read hostname 'smithi139' 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc3488fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 4 client.14961 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc3476cae0 con 0x55cc3483b260 2023-10-08T13:25:41.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc3488fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d7eff5700 10 client.14961 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d9a59c700 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc3488fb40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=400b1bd03272c26a server_cookie=625f4d6634293ea2 in_seq=0 out_seq=0 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d7eff5700 1 -- 172.21.15.139:0/4160103330 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cc3476cae0 con 0x55cc3483b260 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8d7eff5700 10 client.14961 handle_command_reply: tid=0 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 1 client.14961 shutdown 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 msgr2=0x55cc34825900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.469+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0098e0 tx=0x7f8d8c01a050 comp rx=0 tx=0).stop 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 shutdown_connections 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc3483b260 0x55cc3488fb40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc3482b600 0x55cc348245b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8d7eff5700 0 client.14961 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc3481fe30 0x55cc34825900 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 --2- 172.21.15.139:0/4160103330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc34820750 0x55cc34825e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 >> 172.21.15.139:0/4160103330 conn(0x55cc34795210 msgr2=0x55cc34826c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 shutdown_connections 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 1 -- 172.21.15.139:0/4160103330 wait complete. 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8dad2bab80 20 client.14961 trim_cache size 0 max 16384 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:25:41.480 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24628, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 7.0460722760000003, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 16, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 87, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 19.986813951999999 2023-10-08T13:25:41.481 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 msgr2=0x7f8d840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 0x7f8d840a3990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00b2e0 tx=0x7f8d8c005bc0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 msgr2=0x7f8d9c19c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400efc0 tx=0x7f8d9400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 shutdown_connections 2023-10-08T13:25:41.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8d840a14d0 0x7f8d840a3990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d9c1056b0 0x7f8d9c19c550 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d9c0ff620 0x7f8d9c198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 --2- 172.21.15.139:0/3260266664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d9c0fffe0 0x7f8d9c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 >> 172.21.15.139:0/3260266664 conn(0x7f8d9c076780 msgr2=0x7f8d9c0678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 shutdown_connections 2023-10-08T13:25:41.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:41.470+0000 7f8da10d1700 1 -- 172.21.15.139:0/3260266664 wait complete. 2023-10-08T13:25:41.484 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T13:25:41.484 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:41.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T13:25:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:41 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2780110967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:41 smithi139 ceph-mon[99506]: pgmap v241: 129 pgs: 5 creating+peering, 108 active+clean, 16 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s wr, 3 op/s 2023-10-08T13:25:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:41 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1579183163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:41 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3123328608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:41 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2780110967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:41 smithi155 ceph-mon[103467]: pgmap v241: 129 pgs: 5 creating+peering, 108 active+clean, 16 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s wr, 3 op/s 2023-10-08T13:25:41.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:41 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1579183163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:41 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3123328608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:41 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2780110967' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:41 smithi187 ceph-mon[104336]: pgmap v241: 129 pgs: 5 creating+peering, 108 active+clean, 16 unknown; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 990 B/s wr, 3 op/s 2023-10-08T13:25:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:41 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1579183163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:25:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:41 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3123328608' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:42.035 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:25:42.779 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:42 smithi139 ceph-mon[99506]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:42.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:42 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:25:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:42 smithi155 ceph-mon[103467]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:42 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:25:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:42 smithi187 ceph-mon[104336]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T13:25:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:42 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:25:43.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 -- 172.21.15.139:0/2777733585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8848100110 msgr2=0x7f884810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:43.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 --2- 172.21.15.139:0/2777733585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8848100110 0x7f884810c580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f884000b0a0 tx=0x7f884000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 -- 172.21.15.139:0/2777733585 shutdown_connections 2023-10-08T13:25:43.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 --2- 172.21.15.139:0/2777733585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8848100110 0x7f884810c580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 --2- 172.21.15.139:0/2777733585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88481056b0 0x7f8848105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 --2- 172.21.15.139:0/2777733585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88480ff750 0x7f88480ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 -- 172.21.15.139:0/2777733585 >> 172.21.15.139:0/2777733585 conn(0x7f8848075790 msgr2=0x7f8848075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 -- 172.21.15.139:0/2777733585 shutdown_connections 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.279+0000 7f884f233700 1 -- 172.21.15.139:0/2777733585 wait complete. 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 Processor -- start 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 -- start start 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88480ff750 0x7f884819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8848100110 0x7f884819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481960c0 con 0x7f88481056b0 2023-10-08T13:25:43.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848196230 con 0x7f8848100110 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884f233700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88481963f0 con 0x7f88480ff750 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884d7d0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f8847fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8848100110 0x7f884819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884d7d0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38268/0 (socket says 172.21.15.139:38268) 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884d7d0700 1 -- 172.21.15.139:0/2526841923 learned_addr learned my addr 172.21.15.139:0/2526841923 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.280+0000 7f884cfcf700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88480ff750 0x7f884819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 -- 172.21.15.139:0/2526841923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88480ff750 msgr2=0x7f884819b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88480ff750 0x7f884819b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 -- 172.21.15.139:0/2526841923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8848100110 msgr2=0x7f884819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8848100110 0x7f884819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 -- 172.21.15.139:0/2526841923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840009d00 con 0x7f88481056b0 2023-10-08T13:25:43.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884d7d0700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f884000b070 tx=0x7f8840007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:43.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000e040 con 0x7f88481056b0 2023-10-08T13:25:43.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8840009440 con 0x7f88481056b0 2023-10-08T13:25:43.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8848196670 con 0x7f88481056b0 2023-10-08T13:25:43.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884001b450 con 0x7f88481056b0 2023-10-08T13:25:43.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.281+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481a2910 con 0x7f88481056b0 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.282+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8848107cb0 con 0x7f88481056b0 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.283+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f884001d480 con 0x7f88481056b0 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.284+0000 7f8845ffb700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 0x7f88380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.284+0000 7f884cfcf700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 0x7f88380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.284+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f88400cebf0 con 0x7f88481056b0 2023-10-08T13:25:43.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.284+0000 7f884cfcf700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 0x7f88380a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f883c005950 tx=0x7f883c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:43.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.288+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8840097fb0 con 0x7f88481056b0 2023-10-08T13:25:43.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.522+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8848196f20 con 0x7f88481056b0 2023-10-08T13:25:43.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.522+0000 7f8845ffb700 1 -- 172.21.15.139:0/2526841923 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8840025e90 con 0x7f88481056b0 2023-10-08T13:25:43.523 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T13:25:43.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 msgr2=0x7f88380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 0x7f88380a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f883c005950 tx=0x7f883c00b410 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 msgr2=0x7f8848195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f884000b070 tx=0x7f8840007870 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 shutdown_connections 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88380a14d0 0x7f88380a3990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88481056b0 0x7f8848195a60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88480ff750 0x7f884819b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 --2- 172.21.15.139:0/2526841923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8848100110 0x7f884819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:43.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 >> 172.21.15.139:0/2526841923 conn(0x7f8848075790 msgr2=0x7f88480fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:43.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 shutdown_connections 2023-10-08T13:25:43.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:43.524+0000 7f884f233700 1 -- 172.21.15.139:0/2526841923 wait complete. 2023-10-08T13:25:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:43 smithi155 ceph-mon[103467]: pgmap v242: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2023-10-08T13:25:43.897 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:43 smithi139 ceph-mon[99506]: pgmap v242: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2023-10-08T13:25:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:43 smithi187 ceph-mon[104336]: pgmap v242: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T13:25:43.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T13:25:43.992 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T13:25:43.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:43.992 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2023-10-08T13:25:44.010 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:25:44.011 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 41913sec preferred_lft 41913sec 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::96c3:5485:c6ea:316f/64 scope link noprefixroute 2023-10-08T13:25:44.012 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:25:44.012 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T13:25:44.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T13:25:44.013 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:25:44.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.184 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T13:25:44.211 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-10-08T13:25:44.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.213 DEBUG:teuthology.orchestra.run.smithi139:> route 2023-10-08T13:25:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2023-10-08T13:25:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T13:25:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T13:25:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T13:25:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T13:25:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T13:25:44.292 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:25:44.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.540 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-10-08T13:25:44.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.558 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2023-10-08T13:25:44.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.615 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:25:44.615 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:25:44.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:44.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-08T13:25:44.615 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:25:44.710 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-08T13:25:44.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-08T13:25:44.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-08T13:25:44.711 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-08T13:25:44.711 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:25:44.749 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:44 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2526841923' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:25:44.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:44 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2526841923' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:25:44.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:44.917 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:25:44.917 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:25:44.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2023-10-08T13:25:44.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T13:25:44.917 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:25:44.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:44 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2526841923' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:25:45.055 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-08T13:25:45.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:25:45.055 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:45.071 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-08T13:25:45.072 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:25:45.072 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:45.128 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-10-08T13:25:45.194 DEBUG:teuthology.orchestra.run.smithi139:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T13:25:45.252 INFO:teuthology.orchestra.run.smithi139.stdout:/sys 2023-10-08T13:25:45.252 INFO:teuthology.orchestra.run.smithi139.stdout:/proc 2023-10-08T13:25:45.252 INFO:teuthology.orchestra.run.smithi139.stdout:/dev 2023-10-08T13:25:45.252 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/security 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/shm 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/pts 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/run 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/systemd 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/pstore 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/bpf 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/memory 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpuset 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T13:25:45.253 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/pids 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/rdma 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/perf_event 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/freezer 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/devices 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/blkio 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/tracing 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/config 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/ 2023-10-08T13:25:45.254 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/selinux 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/mqueue 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/hugepages 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/debug 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/fuse/connections 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/1000 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/merged 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/merged 2023-10-08T13:25:45.255 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/0 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/merged 2023-10-08T13:25:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/merged 2023-10-08T13:25:45.257 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns 2023-10-08T13:25:45.257 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:45.257 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:45.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:45.257 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-10-08T13:25:45.309 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T13:25:45.309 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-08T13:25:45.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-10-08T13:25:45.378 DEBUG:teuthology.orchestra.run.smithi139:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T13:25:45.434 INFO:teuthology.orchestra.run.smithi139.stdout:/sys 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/proc 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/dev 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/security 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/shm 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/pts 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/run 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/systemd 2023-10-08T13:25:45.435 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/pstore 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/bpf 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/memory 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpuset 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/pids 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/rdma 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/perf_event 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/freezer 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/devices 2023-10-08T13:25:45.436 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/blkio 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/tracing 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/config 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/ 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/selinux 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/mqueue 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/hugepages 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/debug 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/fuse/connections 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/1000 2023-10-08T13:25:45.437 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/merged 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/merged 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/0 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/merged 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/merged 2023-10-08T13:25:45.438 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/merged 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:45.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:45.440 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-10-08T13:25:45.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:2023-10-08T13:25:45.508+0000 7f1bc76255c0 -1 init, newargv = 0x5622f4ef3bc0 newargc=15 2023-10-08T13:25:45.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[161177]: starting ceph client 2023-10-08T13:25:45.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[161177]: starting fuse 2023-10-08T13:25:45.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:45 smithi139 ceph-mon[99506]: pgmap v243: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 431 B/s wr, 1 op/s 2023-10-08T13:25:45.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:45 smithi155 ceph-mon[103467]: pgmap v243: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 431 B/s wr, 1 op/s 2023-10-08T13:25:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:45 smithi187 ceph-mon[104336]: pgmap v243: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 431 B/s wr, 1 op/s 2023-10-08T13:25:46.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2023-10-08T13:25:46.626 DEBUG:teuthology.orchestra.run.smithi139:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T13:25:46.687 INFO:teuthology.orchestra.run.smithi139.stdout:/sys 2023-10-08T13:25:46.687 INFO:teuthology.orchestra.run.smithi139.stdout:/proc 2023-10-08T13:25:46.687 INFO:teuthology.orchestra.run.smithi139.stdout:/dev 2023-10-08T13:25:46.687 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/security 2023-10-08T13:25:46.687 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/shm 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/pts 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/run 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/systemd 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/pstore 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/bpf 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/memory 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpuset 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/pids 2023-10-08T13:25:46.688 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/rdma 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/perf_event 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/freezer 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/devices 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/cgroup/blkio 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/tracing 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/config 2023-10-08T13:25:46.689 INFO:teuthology.orchestra.run.smithi139.stdout:/ 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/selinux 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/mqueue 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/dev/hugepages 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/kernel/debug 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/sys/fs/fuse/connections 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/1000 2023-10-08T13:25:46.690 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/ceph 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/run/user/0 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/merged 2023-10-08T13:25:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/merged 2023-10-08T13:25:46.692 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/merged 2023-10-08T13:25:46.692 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/merged 2023-10-08T13:25:46.692 INFO:teuthology.orchestra.run.smithi139.stdout:/var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/merged 2023-10-08T13:25:46.692 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns 2023-10-08T13:25:46.692 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:46.693 INFO:teuthology.orchestra.run.smithi139.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:25:46.693 INFO:teuthology.orchestra.run.smithi139.stdout:/home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:46.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:46.693 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2023-10-08T13:25:46.747 INFO:teuthology.orchestra.run.smithi139.stdout:124 2023-10-08T13:25:46.747 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-10-08T13:25:46.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo stdin-killer -- python3 -c ' 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> import re 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> import os 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> def _find_admin_socket(client_name): 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-08T13:25:46.748 DEBUG:teuthology.orchestra.run.smithi139:> 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> contents = proc_f.read() 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> if mountpoint in contents: 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> return f 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T13:25:46.749 DEBUG:teuthology.orchestra.run.smithi139:> 2023-10-08T13:25:46.750 DEBUG:teuthology.orchestra.run.smithi139:> print(_find_admin_socket("client.admin")) 2023-10-08T13:25:46.750 DEBUG:teuthology.orchestra.run.smithi139:> ' 2023-10-08T13:25:46.878 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.admin.161177.asok 2023-10-08T13:25:46.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T13:25:46.888 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.161177.asok 2023-10-08T13:25:46.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:46.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.161177.asok status 2023-10-08T13:25:47.046 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:25:47.046 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "7b3143bae3b6870a749bfb9810ed6e7d0e89d7de", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "admin", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "161177", 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 14973, 2023-10-08T13:25:47.047 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 14973 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2456089790 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2023-10-08T13:25:47.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "192.168.0.1:0", 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2456089790 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.14973 192.168.0.1:0/2456089790", 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "192.168.0.1:0/2456089790", 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 16, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 87, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "blocklisted": false, 2023-10-08T13:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2023-10-08T13:25:47.050 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:25:47.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:47.057 DEBUG:teuthology.orchestra.run.smithi139:> stat --file-system '--printf=%T 2023-10-08T13:25:47.057 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:47.074 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2023-10-08T13:25:47.074 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:47.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:47.074 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:47.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:47.141 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-08T13:25:47.245 INFO:teuthology.orchestra.run.smithi139.stdout:# file: . 2023-10-08T13:25:47.246 INFO:teuthology.orchestra.run.smithi139.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-08T13:25:47.246 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:47.246 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:25:47.246 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:25:47.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 -- 172.21.15.139:0/1418964834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd74105600 msgr2=0x7fbd741059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 --2- 172.21.15.139:0/1418964834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd74105600 0x7fbd741059e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbd640099c0 tx=0x7fbd64009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 -- 172.21.15.139:0/1418964834 shutdown_connections 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 --2- 172.21.15.139:0/1418964834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740fff00 0x7fbd7410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 --2- 172.21.15.139:0/1418964834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd74105600 0x7fbd741059e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 --2- 172.21.15.139:0/1418964834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd740ff540 0x7fbd740ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 -- 172.21.15.139:0/1418964834 >> 172.21.15.139:0/1418964834 conn(0x7fbd740fb030 msgr2=0x7fbd740fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:47.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.424+0000 7fbd7a791700 1 -- 172.21.15.139:0/1418964834 shutdown_connections 2023-10-08T13:25:47.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 -- 172.21.15.139:0/1418964834 wait complete. 2023-10-08T13:25:47.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 Processor -- start 2023-10-08T13:25:47.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 -- start start 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740ff540 0x7fbd74197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd74105600 0x7fbd741a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74198630 con 0x7fbd740fff00 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd741a2e40 con 0x7fbd740ff540 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.425+0000 7fbd7a791700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd741a2f80 con 0x7fbd74105600 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38298/0 (socket says 172.21.15.139:38298) 2023-10-08T13:25:47.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 -- 172.21.15.139:0/2815728759 learned_addr learned my addr 172.21.15.139:0/2815728759 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd73fff700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740ff540 0x7fbd74197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd78d2e700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd74105600 0x7fbd741a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 -- 172.21.15.139:0/2815728759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd74105600 msgr2=0x7fbd741a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd74105600 0x7fbd741a2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 -- 172.21.15.139:0/2815728759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740ff540 msgr2=0x7fbd74197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740ff540 0x7fbd74197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 -- 172.21.15.139:0/2815728759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640095f0 con 0x7fbd740fff00 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd737fe700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800d950 tx=0x7fbd6800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68009940 con 0x7fbd740fff00 2023-10-08T13:25:47.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd68010460 con 0x7fbd740fff00 2023-10-08T13:25:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd741a3210 con 0x7fbd740fff00 2023-10-08T13:25:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6800f620 con 0x7fbd740fff00 2023-10-08T13:25:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.426+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd741a3770 con 0x7fbd740fff00 2023-10-08T13:25:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.427+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74107a80 con 0x7fbd740fff00 2023-10-08T13:25:47.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.428+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fbd680108d0 con 0x7fbd740fff00 2023-10-08T13:25:47.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.429+0000 7fbd717fa700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 0x7fbd5c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.429+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fbd680cce00 con 0x7fbd740fff00 2023-10-08T13:25:47.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.429+0000 7fbd73fff700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 0x7fbd5c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.429+0000 7fbd73fff700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 0x7fbd5c0a3a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009990 tx=0x7fbd64003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:47.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.432+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbd68096190 con 0x7fbd740fff00 2023-10-08T13:25:47.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.624+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd74100c60 con 0x7fbd740fff00 2023-10-08T13:25:47.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.626+0000 7fbd717fa700 1 -- 172.21.15.139:0/2815728759 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7fbd68020090 con 0x7fbd740fff00 2023-10-08T13:25:47.626 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:47.627 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:47.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 msgr2=0x7fbd5c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 0x7fbd5c0a3a10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009990 tx=0x7fbd64003680 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 msgr2=0x7fbd74197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800d950 tx=0x7fbd6800dc60 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 shutdown_connections 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbd5c0a1550 0x7fbd5c0a3a10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd74105600 0x7fbd741a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd740ff540 0x7fbd74197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 --2- 172.21.15.139:0/2815728759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd740fff00 0x7fbd74197dc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 >> 172.21.15.139:0/2815728759 conn(0x7fbd740fb030 msgr2=0x7fbd740fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:47.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 shutdown_connections 2023-10-08T13:25:47.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.628+0000 7fbd7a791700 1 -- 172.21.15.139:0/2815728759 wait complete. 2023-10-08T13:25:47.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:25:47.641 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 -- 172.21.15.139:0/3340412207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b01056b0 msgr2=0x7f17b0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 --2- 172.21.15.139:0/3340412207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b01056b0 0x7f17b0105a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009990 tx=0x7f17a0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 -- 172.21.15.139:0/3340412207 shutdown_connections 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 --2- 172.21.15.139:0/3340412207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b00fffe0 0x7f17b010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 --2- 172.21.15.139:0/3340412207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b01056b0 0x7f17b0105a90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 --2- 172.21.15.139:0/3340412207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00ff620 0x7f17b00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.766+0000 7f17b5d41700 1 -- 172.21.15.139:0/3340412207 >> 172.21.15.139:0/3340412207 conn(0x7f17b0076780 msgr2=0x7f17b0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- 172.21.15.139:0/3340412207 shutdown_connections 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- 172.21.15.139:0/3340412207 wait complete. 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 Processor -- start 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- start start 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 0x7f17b0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b01056b0 0x7f17b01a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0198710 con 0x7f17b00ff620 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b01a2f20 con 0x7f17b00fffe0 2023-10-08T13:25:47.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17b5d41700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b01a3060 con 0x7f17b01056b0 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17af7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17af7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38310/0 (socket says 172.21.15.139:38310) 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.767+0000 7f17af7fe700 1 -- 172.21.15.139:0/1314059189 learned_addr learned my addr 172.21.15.139:0/1314059189 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17affff700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b01056b0 0x7f17b01a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17a7fff700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 0x7f17b0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 -- 172.21.15.139:0/1314059189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b01056b0 msgr2=0x7f17b01a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b01056b0 0x7f17b01a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 -- 172.21.15.139:0/1314059189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 msgr2=0x7f17b0197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 0x7f17b0197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 -- 172.21.15.139:0/1314059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00095f0 con 0x7f17b00ff620 2023-10-08T13:25:47.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17a7fff700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 0x7f17b0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17af7fe700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17a00098e0 tx=0x7f17a000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a001d070 con 0x7f17b00ff620 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17a0022470 con 0x7f17b00ff620 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b01a3290 con 0x7f17b00ff620 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0017650 con 0x7f17b00ff620 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.768+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b01a37c0 con 0x7f17b00ff620 2023-10-08T13:25:47.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.769+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b0107c10 con 0x7f17b00ff620 2023-10-08T13:25:47.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.770+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f17a00225e0 con 0x7f17b00ff620 2023-10-08T13:25:47.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.771+0000 7f17ad7fa700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 0x7f179c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:47.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.771+0000 7f17a7fff700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 0x7f179c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:47.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.771+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f17a00ce030 con 0x7f17b00ff620 2023-10-08T13:25:47.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.771+0000 7f17a7fff700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 0x7f179c0a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1798005d90 tx=0x7f1798005d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:47.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.775+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f17a00973f0 con 0x7f17b00ff620 2023-10-08T13:25:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:47 smithi139 ceph-mon[99506]: pgmap v244: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T13:25:47.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:47 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2815728759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.965+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17b0067df0 con 0x7f17b00ff620 2023-10-08T13:25:47.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.965+0000 7f17ad7fa700 1 -- 172.21.15.139:0/1314059189 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17a009aa10 con 0x7f17b00ff620 2023-10-08T13:25:47.966 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:25:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 msgr2=0x7f179c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 0x7f179c0a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1798005d90 tx=0x7f1798005d20 comp rx=0 tx=0).stop 2023-10-08T13:25:47.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 msgr2=0x7f17b0197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17a00098e0 tx=0x7f17a000f670 comp rx=0 tx=0).stop 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 shutdown_connections 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f179c0a1550 0x7f179c0a3a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b01056b0 0x7f17b01a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17b00ff620 0x7f17b0197960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 --2- 172.21.15.139:0/1314059189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b00fffe0 0x7f17b0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 >> 172.21.15.139:0/1314059189 conn(0x7f17b0076780 msgr2=0x7f17b00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 shutdown_connections 2023-10-08T13:25:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:47.968+0000 7f17b5d41700 1 -- 172.21.15.139:0/1314059189 wait complete. 2023-10-08T13:25:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:47 smithi187 ceph-mon[104336]: pgmap v244: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T13:25:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:47 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2815728759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:47.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:25:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:47 smithi155 ceph-mon[103467]: pgmap v244: 129 pgs: 129 active+clean; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2023-10-08T13:25:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:47 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2815728759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 -- 172.21.15.139:0/1651422443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f501056b0 msgr2=0x7f1f50105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 --2- 172.21.15.139:0/1651422443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f501056b0 0x7f1f50105a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009990 tx=0x7f1f4c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 -- 172.21.15.139:0/1651422443 shutdown_connections 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 --2- 172.21.15.139:0/1651422443 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f500fffe0 0x7f1f5010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 --2- 172.21.15.139:0/1651422443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f501056b0 0x7f1f50105a90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 --2- 172.21.15.139:0/1651422443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500ff620 0x7f1f500ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 -- 172.21.15.139:0/1651422443 >> 172.21.15.139:0/1651422443 conn(0x7f1f50076780 msgr2=0x7f1f50076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 -- 172.21.15.139:0/1651422443 shutdown_connections 2023-10-08T13:25:48.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.104+0000 7f1f5827e700 1 -- 172.21.15.139:0/1651422443 wait complete. 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 Processor -- start 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 -- start start 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500fffe0 0x7f1f50195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f501056b0 0x7f1f5019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019a900 con 0x7f1f500ff620 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019aa70 con 0x7f1f500fffe0 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5827e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019ac30 con 0x7f1f501056b0 2023-10-08T13:25:48.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38324/0 (socket says 172.21.15.139:38324) 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 -- 172.21.15.139:0/342016369 learned_addr learned my addr 172.21.15.139:0/342016369 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f55819700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500fffe0 0x7f1f50195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 -- 172.21.15.139:0/342016369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f501056b0 msgr2=0x7f1f5019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f501056b0 0x7f1f5019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 -- 172.21.15.139:0/342016369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500fffe0 msgr2=0x7f1f50195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500fffe0 0x7f1f50195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 -- 172.21.15.139:0/342016369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c0095f0 con 0x7f1f500ff620 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.105+0000 7f1f5601a700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0098e0 tx=0x7f1f4c00f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c01d070 con 0x7f1f500ff620 2023-10-08T13:25:48.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f4c00fb90 con 0x7f1f500ff620 2023-10-08T13:25:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c017650 con 0x7f1f500ff620 2023-10-08T13:25:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5019aeb0 con 0x7f1f500ff620 2023-10-08T13:25:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f501a25e0 con 0x7f1f500ff620 2023-10-08T13:25:48.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.106+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f50107c30 con 0x7f1f500ff620 2023-10-08T13:25:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.108+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1f4c00fd00 con 0x7f1f500ff620 2023-10-08T13:25:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.108+0000 7f1f477fe700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 0x7f1f3c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.108+0000 7f1f55819700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 0x7f1f3c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.108+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f1f4c0ce4b0 con 0x7f1f500ff620 2023-10-08T13:25:48.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.109+0000 7f1f55819700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 0x7f1f3c0a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005950 tx=0x7f1f400058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.111+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1f4c0978d0 con 0x7f1f500ff620 2023-10-08T13:25:48.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.302+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f50196d20 con 0x7f1f500ff620 2023-10-08T13:25:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.303+0000 7f1f477fe700 1 -- 172.21.15.139:0/342016369 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f4c09aef0 con 0x7f1f500ff620 2023-10-08T13:25:48.304 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:25:48.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 msgr2=0x7f1f3c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 0x7f1f3c0a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005950 tx=0x7f1f400058e0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 msgr2=0x7f1f50195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0098e0 tx=0x7f1f4c00f720 comp rx=0 tx=0).stop 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 shutdown_connections 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f3c0a14d0 0x7f1f3c0a3990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f501056b0 0x7f1f5019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f500ff620 0x7f1f50195a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 --2- 172.21.15.139:0/342016369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f500fffe0 0x7f1f50195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 >> 172.21.15.139:0/342016369 conn(0x7f1f50076780 msgr2=0x7f1f500fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 shutdown_connections 2023-10-08T13:25:48.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.305+0000 7f1f5827e700 1 -- 172.21.15.139:0/342016369 wait complete. 2023-10-08T13:25:48.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:25:48.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 -- 172.21.15.139:0/2137663629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 msgr2=0x7f65c80680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 --2- 172.21.15.139:0/2137663629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c80680c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65c40099c0 tx=0x7f65c4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 -- 172.21.15.139:0/2137663629 shutdown_connections 2023-10-08T13:25:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 --2- 172.21.15.139:0/2137663629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 --2- 172.21.15.139:0/2137663629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c80680c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 --2- 172.21.15.139:0/2137663629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c8105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 -- 172.21.15.139:0/2137663629 >> 172.21.15.139:0/2137663629 conn(0x7f65c8076780 msgr2=0x7f65c8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 -- 172.21.15.139:0/2137663629 shutdown_connections 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.441+0000 7f65d03ea700 1 -- 172.21.15.139:0/2137663629 wait complete. 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 Processor -- start 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 -- start start 2023-10-08T13:25:48.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c81969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8197050 con 0x7f65c8067ce0 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81971c0 con 0x7f65c81051c0 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65d03ea700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8197380 con 0x7f65c8105b80 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65ce186700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65ce186700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38338/0 (socket says 172.21.15.139:38338) 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65ce186700 1 -- 172.21.15.139:0/3964065234 learned_addr learned my addr 172.21.15.139:0/3964065234 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65cd985700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.442+0000 7f65ce987700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c81969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 -- 172.21.15.139:0/3964065234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 msgr2=0x7f65c81969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c81969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 -- 172.21.15.139:0/3964065234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 msgr2=0x7f65c819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 -- 172.21.15.139:0/3964065234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c40095f0 con 0x7f65c8067ce0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce987700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c81969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65cd985700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65ce186700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c010 tx=0x7f65c400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c401c070 con 0x7f65c8067ce0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65c4022420 con 0x7f65c8067ce0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c8197600 con 0x7f65c8067ce0 2023-10-08T13:25:48.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4017650 con 0x7f65c8067ce0 2023-10-08T13:25:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.443+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c81a38b0 con 0x7f65c8067ce0 2023-10-08T13:25:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.444+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8108c70 con 0x7f65c8067ce0 2023-10-08T13:25:48.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.445+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f65c4020070 con 0x7f65c8067ce0 2023-10-08T13:25:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.445+0000 7f65bf7fe700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 0x7f65b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.445+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f65c40cdcb0 con 0x7f65c8067ce0 2023-10-08T13:25:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.445+0000 7f65cd985700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 0x7f65b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.446+0000 7f65cd985700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 0x7f65b40a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65b8005950 tx=0x7f65b80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.450+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f65c40970d0 con 0x7f65c8067ce0 2023-10-08T13:25:48.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.640+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65c8197eb0 con 0x7f65c8067ce0 2023-10-08T13:25:48.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.641+0000 7f65bf7fe700 1 -- 172.21.15.139:0/3964065234 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65c4022590 con 0x7f65c8067ce0 2023-10-08T13:25:48.642 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:25:48.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 msgr2=0x7f65b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 0x7f65b40a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65b8005950 tx=0x7f65b80058e0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 msgr2=0x7f65c819c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c010 tx=0x7f65c400f740 comp rx=0 tx=0).stop 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 shutdown_connections 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f65b40a14d0 0x7f65b40a3990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65c8105b80 0x7f65c81969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65c8067ce0 0x7f65c819c8c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 --2- 172.21.15.139:0/3964065234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c81051c0 0x7f65c819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 >> 172.21.15.139:0/3964065234 conn(0x7f65c8076780 msgr2=0x7f65c80fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 shutdown_connections 2023-10-08T13:25:48.645 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.643+0000 7f65d03ea700 1 -- 172.21.15.139:0/3964065234 wait complete. 2023-10-08T13:25:48.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:25:48.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 -- 172.21.15.139:0/3970811948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c100730 msgr2=0x7fa46c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 --2- 172.21.15.139:0/3970811948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c100730 0x7fa46c10c4b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b0a0 tx=0x7fa46400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 -- 172.21.15.139:0/3970811948 shutdown_connections 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 --2- 172.21.15.139:0/3970811948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c100730 0x7fa46c10c4b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 --2- 172.21.15.139:0/3970811948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 0x7fa46c105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 --2- 172.21.15.139:0/3970811948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c0ffd70 0x7fa46c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 -- 172.21.15.139:0/3970811948 >> 172.21.15.139:0/3970811948 conn(0x7fa46c075c20 msgr2=0x7fa46c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 -- 172.21.15.139:0/3970811948 shutdown_connections 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.780+0000 7fa472406700 1 -- 172.21.15.139:0/3970811948 wait complete. 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 Processor -- start 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 -- start start 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 0x7fa46c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 0x7fa46c1a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1988d0 con 0x7fa46c0ffd70 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1a30e0 con 0x7fa46c100730 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa472406700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1a3220 con 0x7fa46c105660 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38352/0 (socket says 172.21.15.139:38352) 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 -- 172.21.15.139:0/2314153209 learned_addr learned my addr 172.21.15.139:0/2314153209 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa4709a3700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 0x7fa46c1a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46b7fe700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 0x7fa46c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 -- 172.21.15.139:0/2314153209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 msgr2=0x7fa46c1a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 0x7fa46c1a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 -- 172.21.15.139:0/2314153209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 msgr2=0x7fa46c198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 0x7fa46c198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46bfff700 1 -- 172.21.15.139:0/2314153209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464009d00 con 0x7fa46c0ffd70 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.781+0000 7fa46b7fe700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 0x7fa46c198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa46bfff700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d950 tx=0x7fa45c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c009b40 con 0x7fa46c0ffd70 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa45c009ca0 con 0x7fa46c0ffd70 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c1a34b0 con 0x7fa46c0ffd70 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00f620 con 0x7fa46c0ffd70 2023-10-08T13:25:48.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.782+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c1a3a10 con 0x7fa46c0ffd70 2023-10-08T13:25:48.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.783+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c107b90 con 0x7fa46c0ffd70 2023-10-08T13:25:48.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.784+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa45c010460 con 0x7fa46c0ffd70 2023-10-08T13:25:48.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.784+0000 7fa4697fa700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 0x7fa4540a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:48.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.785+0000 7fa46b7fe700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 0x7fa4540a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:48.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.785+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fa45c0cd350 con 0x7fa46c0ffd70 2023-10-08T13:25:48.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.785+0000 7fa46b7fe700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 0x7fa4540a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa460005fd0 tx=0x7fa460005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:48.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.788+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa45c096680 con 0x7fa46c0ffd70 2023-10-08T13:25:48.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:48 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1314059189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:48 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/342016369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:48 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3964065234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:48 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1314059189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:48 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/342016369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:48 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3964065234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:48.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.981+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa46c0ff220 con 0x7fa46c0ffd70 2023-10-08T13:25:48.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.982+0000 7fa4697fa700 1 -- 172.21.15.139:0/2314153209 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa45c0160a0 con 0x7fa46c0ffd70 2023-10-08T13:25:48.983 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 msgr2=0x7fa4540a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 0x7fa4540a3a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa460005fd0 tx=0x7fa460005ee0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 msgr2=0x7fa46c197b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00d950 tx=0x7fa45c00dd10 comp rx=0 tx=0).stop 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 shutdown_connections 2023-10-08T13:25:48.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4540a1550 0x7fa4540a3a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa46c105660 0x7fa46c1a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa46c0ffd70 0x7fa46c197b20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 --2- 172.21.15.139:0/2314153209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa46c100730 0x7fa46c198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 >> 172.21.15.139:0/2314153209 conn(0x7fa46c075c20 msgr2=0x7fa46c0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 shutdown_connections 2023-10-08T13:25:48.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:48.984+0000 7fa472406700 1 -- 172.21.15.139:0/2314153209 wait complete. 2023-10-08T13:25:48.997 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:25:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:48 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1314059189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:48 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/342016369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:49.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:48 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3964065234' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:49.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 -- 172.21.15.139:0/1766332036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 msgr2=0x7f3b3010d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1766332036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b3010d6d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b2800b0a0 tx=0x7f3b2800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 -- 172.21.15.139:0/1766332036 shutdown_connections 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1766332036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b3010d6d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1766332036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b300ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1766332036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b300ffcd0 0x7f3b30105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 -- 172.21.15.139:0/1766332036 >> 172.21.15.139:0/1766332036 conn(0x7f3b30074940 msgr2=0x7f3b30074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 -- 172.21.15.139:0/1766332036 shutdown_connections 2023-10-08T13:25:49.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.118+0000 7f3b357bc700 1 -- 172.21.15.139:0/1766332036 wait complete. 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.119+0000 7f3b357bc700 1 Processor -- start 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.119+0000 7f3b357bc700 1 -- start start 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b30196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b3019b6b0 0x7f3b3019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3019c130 con 0x7f3b30105b30 2023-10-08T13:25:49.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3019c2a0 con 0x7f3b300ff320 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3019c460 con 0x7f3b3019b6b0 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38368/0 (socket says 172.21.15.139:38368) 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 -- 172.21.15.139:0/1832942770 learned_addr learned my addr 172.21.15.139:0/1832942770 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2f7fe700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b3019b6b0 0x7f3b3019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2effd700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b30196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 -- 172.21.15.139:0/1832942770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b3019b6b0 msgr2=0x7f3b3019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b3019b6b0 0x7f3b3019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 -- 172.21.15.139:0/1832942770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 msgr2=0x7f3b30196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b30196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 -- 172.21.15.139:0/1832942770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009d00 con 0x7f3b30105b30 2023-10-08T13:25:49.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2effd700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b30196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b2e7fc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d980 tx=0x7f3b2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24009930 con 0x7f3b30105b30 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b24010460 con 0x7f3b30105b30 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400f620 con 0x7f3b30105b30 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.120+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b301a39c0 con 0x7f3b30105b30 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.121+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b301a3e50 con 0x7f3b30105b30 2023-10-08T13:25:49.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.121+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30108d20 con 0x7f3b30105b30 2023-10-08T13:25:49.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.122+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3b240108d0 con 0x7f3b30105b30 2023-10-08T13:25:49.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.123+0000 7f3b17fff700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 0x7f3b180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.123+0000 7f3b2effd700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 0x7f3b180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.123+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f3b240cca20 con 0x7f3b30105b30 2023-10-08T13:25:49.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.123+0000 7f3b2effd700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 0x7f3b180a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009be0 tx=0x7f3b20009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.127+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b24095db0 con 0x7f3b30105b30 2023-10-08T13:25:49.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.334+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b301980d0 con 0x7f3b30105b30 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.335+0000 7f3b17fff700 1 -- 172.21.15.139:0/1832942770 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) v1 ==== 81+0+900 (secure 0 0 0) 0x7f3b240203a0 con 0x7f3b30105b30 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/542053995 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4107466857 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1347436644 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:49.336 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1490471359 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3474112198 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1278886955 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3196233301 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4197784005 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:49.337 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3589198312 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 msgr2=0x7f3b180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 0x7f3b180a3990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009be0 tx=0x7f3b20009260 comp rx=0 tx=0).stop 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 msgr2=0x7f3b30197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400d980 tx=0x7f3b2400dc90 comp rx=0 tx=0).stop 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 shutdown_connections 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b180a14d0 0x7f3b180a3990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b3019b6b0 0x7f3b3019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b300ff320 0x7f3b30196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 --2- 172.21.15.139:0/1832942770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b30105b30 0x7f3b30197360 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 >> 172.21.15.139:0/1832942770 conn(0x7f3b30074940 msgr2=0x7f3b300fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 shutdown_connections 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.337+0000 7f3b357bc700 1 -- 172.21.15.139:0/1832942770 wait complete. 2023-10-08T13:25:49.339 INFO:teuthology.orchestra.run.smithi139.stderr:listed 15 entries 2023-10-08T13:25:49.350 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:25:49.350 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:25:49.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:49.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1086855537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64100ff0 msgr2=0x7f5c6410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1086855537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64100ff0 0x7f5c6410d500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00b0a0 tx=0x7f5c5c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1086855537 shutdown_connections 2023-10-08T13:25:49.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1086855537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64100ff0 0x7f5c6410d500 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1086855537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64106640 0x7f5c64106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1086855537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100630 0x7f5c64100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1086855537 >> 172.21.15.139:0/1086855537 conn(0x7f5c640fc1a0 msgr2=0x7f5c640fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:49.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1086855537 shutdown_connections 2023-10-08T13:25:49.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.530+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1086855537 wait complete. 2023-10-08T13:25:49.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 Processor -- start 2023-10-08T13:25:49.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 -- start start 2023-10-08T13:25:49.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64100630 0x7f5c6419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100ff0 0x7f5c6419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64196f10 con 0x7f5c64106640 2023-10-08T13:25:49.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64197080 con 0x7f5c64100630 2023-10-08T13:25:49.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c6a2eb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64197240 con 0x7f5c64100ff0 2023-10-08T13:25:49.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64100630 0x7f5c6419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38386/0 (socket says 172.21.15.139:38386) 2023-10-08T13:25:49.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 -- 172.21.15.139:0/1890346157 learned_addr learned my addr 172.21.15.139:0/1890346157 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:49.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c5bfff700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100ff0 0x7f5c6419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 -- 172.21.15.139:0/1890346157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100ff0 msgr2=0x7f5c6419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100ff0 0x7f5c6419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 -- 172.21.15.139:0/1890346157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64100630 msgr2=0x7f5c6419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64100630 0x7f5c6419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 -- 172.21.15.139:0/1890346157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009d00 con 0x7f5c64106640 2023-10-08T13:25:49.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c68888700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00b070 tx=0x7f5c5c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.531+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00e040 con 0x7f5c64106640 2023-10-08T13:25:49.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.532+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c5c004e60 con 0x7f5c64106640 2023-10-08T13:25:49.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.532+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c641974c0 con 0x7f5c64106640 2023-10-08T13:25:49.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.532+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0052a0 con 0x7f5c64106640 2023-10-08T13:25:49.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.532+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c641a3710 con 0x7f5c64106640 2023-10-08T13:25:49.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.533+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c64108c50 con 0x7f5c64106640 2023-10-08T13:25:49.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.534+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5c5c01d470 con 0x7f5c64106640 2023-10-08T13:25:49.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.535+0000 7f5c61ffb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 0x7f5c500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.545 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.535+0000 7f5c63fff700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 0x7f5c500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.545 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.535+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5c5c0cef80 con 0x7f5c64106640 2023-10-08T13:25:49.545 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.535+0000 7f5c63fff700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 0x7f5c500a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009be0 tx=0x7f5c54009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.546 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.538+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5c5c0983a0 con 0x7f5c64106640 2023-10-08T13:25:49.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.733+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c64101d70 con 0x7f5c64106640 2023-10-08T13:25:49.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.734+0000 7f5c61ffb700 1 -- 172.21.15.139:0/1890346157 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f5c5c09b9c0 con 0x7f5c64106640 2023-10-08T13:25:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:49.736 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.736+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 msgr2=0x7f5c500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 0x7f5c500a3990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009be0 tx=0x7f5c54009260 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 msgr2=0x7f5c641968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00b070 tx=0x7f5c5c007870 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 shutdown_connections 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5c500a14d0 0x7f5c500a3990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c64106640 0x7f5c641968a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c64100630 0x7f5c6419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 --2- 172.21.15.139:0/1890346157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c64100ff0 0x7f5c6419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 >> 172.21.15.139:0/1890346157 conn(0x7f5c640fc1a0 msgr2=0x7f5c640fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:49.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 shutdown_connections 2023-10-08T13:25:49.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.737+0000 7f5c6a2eb700 1 -- 172.21.15.139:0/1890346157 wait complete. 2023-10-08T13:25:49.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:25:49.750 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 -- 172.21.15.139:0/3868604812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98106750 msgr2=0x7f7a98106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/3868604812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98106750 0x7f7a98106b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009990 tx=0x7f7a8c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 -- 172.21.15.139:0/3868604812 shutdown_connections 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/3868604812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98069740 0x7f7a9810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/3868604812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98106750 0x7f7a98106b30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/3868604812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98068d80 0x7f7a98069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 -- 172.21.15.139:0/3868604812 >> 172.21.15.139:0/3868604812 conn(0x7f7a980767f0 msgr2=0x7f7a98076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:49.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 -- 172.21.15.139:0/3868604812 shutdown_connections 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.874+0000 7f7a9ff63700 1 -- 172.21.15.139:0/3868604812 wait complete. 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 Processor -- start 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 -- start start 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98068d80 0x7f7a9819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 0x7f7a981969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98197020 con 0x7f7a98069740 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98197190 con 0x7f7a98068d80 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.875+0000 7f7a9ff63700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a98197350 con 0x7f7a98106750 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38398/0 (socket says 172.21.15.139:38398) 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 -- 172.21.15.139:0/2468961917 learned_addr learned my addr 172.21.15.139:0/2468961917 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9dcff700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98068d80 0x7f7a9819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9e500700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 0x7f7a981969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 -- 172.21.15.139:0/2468961917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 msgr2=0x7f7a981969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 0x7f7a981969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 -- 172.21.15.139:0/2468961917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98068d80 msgr2=0x7f7a9819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98068d80 0x7f7a9819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 -- 172.21.15.139:0/2468961917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0095f0 con 0x7f7a98069740 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9e500700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 0x7f7a981969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9d4fe700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c970 tx=0x7f7a9400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94007aa0 con 0x7f7a98069740 2023-10-08T13:25:49.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a94004cf0 con 0x7f7a98069740 2023-10-08T13:25:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a98197630 con 0x7f7a98069740 2023-10-08T13:25:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94005600 con 0x7f7a98069740 2023-10-08T13:25:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.876+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a981a3880 con 0x7f7a98069740 2023-10-08T13:25:49.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.877+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a98108cd0 con 0x7f7a98069740 2023-10-08T13:25:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.878+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f7a94004750 con 0x7f7a98069740 2023-10-08T13:25:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.879+0000 7f7a8affd700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 0x7f7a840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.879+0000 7f7a9dcff700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 0x7f7a840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.879+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f7a94013070 con 0x7f7a98069740 2023-10-08T13:25:49.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.879+0000 7f7a9dcff700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 0x7f7a840a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005850 tx=0x7f7a8c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:49.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:49.882+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7a94096870 con 0x7f7a98069740 2023-10-08T13:25:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:49 smithi139 ceph-mon[99506]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-08T13:25:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2314153209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1832942770' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:49 smithi187 ceph-mon[104336]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-08T13:25:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2314153209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1832942770' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:50.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.074+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a98197e80 con 0x7f7a98069740 2023-10-08T13:25:50.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.075+0000 7f7a8affd700 1 -- 172.21.15.139:0/2468961917 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a94099e90 con 0x7f7a98069740 2023-10-08T13:25:50.076 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.076+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 msgr2=0x7f7a840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 0x7f7a840a3990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c005850 tx=0x7f7a8c01a040 comp rx=0 tx=0).stop 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 msgr2=0x7f7a9819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400c970 tx=0x7f7a9400cd30 comp rx=0 tx=0).stop 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 shutdown_connections 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7a840a14d0 0x7f7a840a3990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a98106750 0x7f7a981969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a98068d80 0x7f7a9819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 --2- 172.21.15.139:0/2468961917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7a98069740 0x7f7a9819cdd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 >> 172.21.15.139:0/2468961917 conn(0x7f7a980767f0 msgr2=0x7f7a980fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 shutdown_connections 2023-10-08T13:25:50.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.077+0000 7f7a9ff63700 1 -- 172.21.15.139:0/2468961917 wait complete. 2023-10-08T13:25:50.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:25:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:49 smithi155 ceph-mon[103467]: pgmap v245: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 307 B/s wr, 0 op/s 2023-10-08T13:25:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:49 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2314153209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:49 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1832942770' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- 172.21.15.139:0/4067465792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc0ff620 msgr2=0x7f82dc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 --2- 172.21.15.139:0/4067465792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc0ff620 0x7f82dc0ffaa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009990 tx=0x7f82c8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- 172.21.15.139:0/4067465792 shutdown_connections 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 --2- 172.21.15.139:0/4067465792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 0x7f82dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 --2- 172.21.15.139:0/4067465792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc1056b0 0x7f82dc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 --2- 172.21.15.139:0/4067465792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc0ff620 0x7f82dc0ffaa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- 172.21.15.139:0/4067465792 >> 172.21.15.139:0/4067465792 conn(0x7f82dc076780 msgr2=0x7f82dc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- 172.21.15.139:0/4067465792 shutdown_connections 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- 172.21.15.139:0/4067465792 wait complete. 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 Processor -- start 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.214+0000 7f82e2fee700 1 -- start start 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc0ff620 0x7f82dc19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 0x7f82dc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc196fa0 con 0x7f82dc1056b0 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc197110 con 0x7f82dc0ff620 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1972d0 con 0x7f82dc0fffe0 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38414/0 (socket says 172.21.15.139:38414) 2023-10-08T13:25:50.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 -- 172.21.15.139:0/2607414812 learned_addr learned my addr 172.21.15.139:0/2607414812 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e0d8a700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc0ff620 0x7f82dc19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82dbfff700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 0x7f82dc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 -- 172.21.15.139:0/2607414812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 msgr2=0x7f82dc19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 0x7f82dc19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 -- 172.21.15.139:0/2607414812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc0ff620 msgr2=0x7f82dc19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc0ff620 0x7f82dc19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 -- 172.21.15.139:0/2607414812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80095f0 con 0x7f82dc1056b0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e158b700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82d400ef30 tx=0x7f82d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4018070 con 0x7f82dc1056b0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc197550 con 0x7f82dc1056b0 2023-10-08T13:25:50.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82d400f040 con 0x7f82dc1056b0 2023-10-08T13:25:50.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.215+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d400cd00 con 0x7f82dc1056b0 2023-10-08T13:25:50.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.216+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc1a3800 con 0x7f82dc1056b0 2023-10-08T13:25:50.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.216+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc100d50 con 0x7f82dc1056b0 2023-10-08T13:25:50.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.217+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f82d4003a00 con 0x7f82dc1056b0 2023-10-08T13:25:50.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.218+0000 7f82d9ffb700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 0x7f82cc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.218+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f82d40ccc00 con 0x7f82dc1056b0 2023-10-08T13:25:50.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.218+0000 7f82e0d8a700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 0x7f82cc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.218+0000 7f82e0d8a700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 0x7f82cc0a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82dc077ab0 tx=0x7f82d0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.222+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f82d4095fc0 con 0x7f82dc1056b0 2023-10-08T13:25:50.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.420+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82dc10f4f0 con 0x7f82dc1056b0 2023-10-08T13:25:50.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.420+0000 7f82d9ffb700 1 -- 172.21.15.139:0/2607414812 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82d40995e0 con 0x7f82dc1056b0 2023-10-08T13:25:50.422 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:25:50.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 msgr2=0x7f82cc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 0x7f82cc0a3990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f82dc077ab0 tx=0x7f82d0009260 comp rx=0 tx=0).stop 2023-10-08T13:25:50.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 msgr2=0x7f82dc196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82d400ef30 tx=0x7f82d400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 shutdown_connections 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f82cc0a14d0 0x7f82cc0a3990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82dc1056b0 0x7f82dc196940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82dc0ff620 0x7f82dc19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 --2- 172.21.15.139:0/2607414812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc0fffe0 0x7f82dc19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 >> 172.21.15.139:0/2607414812 conn(0x7f82dc076780 msgr2=0x7f82dc103830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 shutdown_connections 2023-10-08T13:25:50.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.423+0000 7f82e2fee700 1 -- 172.21.15.139:0/2607414812 wait complete. 2023-10-08T13:25:50.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:25:50.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/1424876209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff320 msgr2=0x7fe4ec0ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/1424876209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec0ff700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009990 tx=0x7fe4dc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/1424876209 shutdown_connections 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/1424876209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 0x7fe4ec10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/1424876209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec0ff700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/1424876209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ffcd0 0x7fe4ec105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/1424876209 >> 172.21.15.139:0/1424876209 conn(0x7fe4ec0749a0 msgr2=0x7fe4ec074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/1424876209 shutdown_connections 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/1424876209 wait complete. 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 Processor -- start 2023-10-08T13:25:50.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.561+0000 7fe4f0d3d700 1 -- start start 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 0x7fe4ec19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec197530 con 0x7fe4ec196ab0 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1976a0 con 0x7fe4ec105b30 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec197860 con 0x7fe4ec0ff320 2023-10-08T13:25:50.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38432/0 (socket says 172.21.15.139:38432) 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 -- 172.21.15.139:0/3603099521 learned_addr learned my addr 172.21.15.139:0/3603099521 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ea59c700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4e9d9b700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 0x7fe4ec19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 -- 172.21.15.139:0/3603099521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 msgr2=0x7fe4ec19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 -- 172.21.15.139:0/3603099521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 msgr2=0x7fe4ec19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 0x7fe4ec19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 -- 172.21.15.139:0/3603099521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc0095f0 con 0x7fe4ec196ab0 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ea59c700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4ead9d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007ee0 tx=0x7fe4e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4017070 con 0x7fe4ec196ab0 2023-10-08T13:25:50.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4e400f040 con 0x7fe4ec196ab0 2023-10-08T13:25:50.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec1a3850 con 0x7fe4ec196ab0 2023-10-08T13:25:50.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.562+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4005740 con 0x7fe4ec196ab0 2023-10-08T13:25:50.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.563+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec1a3ce0 con 0x7fe4ec196ab0 2023-10-08T13:25:50.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.564+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec108d20 con 0x7fe4ec196ab0 2023-10-08T13:25:50.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.565+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fe4e400dc60 con 0x7fe4ec196ab0 2023-10-08T13:25:50.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.565+0000 7fe4db7fe700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 0x7fe4d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.566+0000 7fe4ea59c700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 0x7fe4d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.566+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fe4e40cce30 con 0x7fe4ec196ab0 2023-10-08T13:25:50.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.566+0000 7fe4ea59c700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 0x7fe4d40a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b2e0 tx=0x7fe4dc005940 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.569+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe4e40961c0 con 0x7fe4ec196ab0 2023-10-08T13:25:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1890346157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2468961917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:50.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2607414812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:50.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.762+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4ec197f70 con 0x7fe4ec196ab0 2023-10-08T13:25:50.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.763+0000 7fe4db7fe700 1 -- 172.21.15.139:0/3603099521 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4e40997e0 con 0x7fe4ec196ab0 2023-10-08T13:25:50.764 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 msgr2=0x7fe4d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 0x7fe4d40a3990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b2e0 tx=0x7fe4dc005940 comp rx=0 tx=0).stop 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 msgr2=0x7fe4ec196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4007ee0 tx=0x7fe4e400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 shutdown_connections 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe4d40a14d0 0x7fe4d40a3990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec196ab0 0x7fe4ec196f60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4ec0ff320 0x7fe4ec19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 --2- 172.21.15.139:0/3603099521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4ec105b30 0x7fe4ec19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 >> 172.21.15.139:0/3603099521 conn(0x7fe4ec0749a0 msgr2=0x7fe4ec0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 shutdown_connections 2023-10-08T13:25:50.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.765+0000 7fe4f0d3d700 1 -- 172.21.15.139:0/3603099521 wait complete. 2023-10-08T13:25:50.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:25:50.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.900+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1995685011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba00ff060 msgr2=0x7f9ba00ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.900+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1995685011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba00ff060 0x7f9ba00ff440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009990 tx=0x7f9b90009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1995685011 shutdown_connections 2023-10-08T13:25:50.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1995685011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 0x7f9ba010bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1995685011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba00ff060 0x7f9ba00ff440 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1995685011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ffa10 0x7f9ba0103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1995685011 >> 172.21.15.139:0/1995685011 conn(0x7f9ba0075c20 msgr2=0x7f9ba00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1995685011 shutdown_connections 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1995685011 wait complete. 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 Processor -- start 2023-10-08T13:25:50.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.901+0000 7f9ba66b7700 1 -- start start 2023-10-08T13:25:50.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ff060 0x7f9ba019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 0x7f9ba019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0197500 con 0x7f9ba0196a80 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0197640 con 0x7f9ba0104130 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba0197800 con 0x7f9ba00ff060 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38446/0 (socket says 172.21.15.139:38446) 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 -- 172.21.15.139:0/1281195670 learned_addr learned my addr 172.21.15.139:0/1281195670 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:50.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9b9ffff700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ff060 0x7f9ba019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9b9f7fe700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 0x7f9ba019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 -- 172.21.15.139:0/1281195670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ff060 msgr2=0x7f9ba019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ff060 0x7f9ba019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 -- 172.21.15.139:0/1281195670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 msgr2=0x7f9ba019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 0x7f9ba019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 -- 172.21.15.139:0/1281195670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900095f0 con 0x7f9ba0196a80 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba4c54700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b98007d70 tx=0x7f9b9800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800ad40 con 0x7f9ba0196a80 2023-10-08T13:25:50.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b980128e0 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba01a3770 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b980116b0 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.902+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba01a3c80 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.903+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba01004e0 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.904+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9b98012420 con 0x7f9ba0196a80 2023-10-08T13:25:50.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.905+0000 7f9b9d7fa700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 0x7f9b880a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:50.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.905+0000 7f9b9ffff700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 0x7f9b880a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:50.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.905+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f9b980cd260 con 0x7f9ba0196a80 2023-10-08T13:25:50.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.905+0000 7f9b9ffff700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 0x7f9b880a3a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000b5c0 tx=0x7f9b90005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:50.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:50.909+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b98096590 con 0x7f9ba0196a80 2023-10-08T13:25:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1890346157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2468961917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2607414812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1890346157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2468961917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2607414812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.101+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ba0197ef0 con 0x7f9ba0196a80 2023-10-08T13:25:51.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.101+0000 7f9b9d7fa700 1 -- 172.21.15.139:0/1281195670 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b98094e60 con 0x7f9ba0196a80 2023-10-08T13:25:51.102 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.103+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 msgr2=0x7f9b880a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.103+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 0x7f9b880a3a10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000b5c0 tx=0x7f9b90005960 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.103+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 msgr2=0x7f9ba0196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.103+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9b98007d70 tx=0x7f9b9800a340 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 shutdown_connections 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b880a1550 0x7f9b880a3a10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ba0196a80 0x7f9ba0196f30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba00ff060 0x7f9ba019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 --2- 172.21.15.139:0/1281195670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ba0104130 0x7f9ba019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 >> 172.21.15.139:0/1281195670 conn(0x7f9ba0075c20 msgr2=0x7f9ba010c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:51.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 shutdown_connections 2023-10-08T13:25:51.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.104+0000 7f9ba66b7700 1 -- 172.21.15.139:0/1281195670 wait complete. 2023-10-08T13:25:51.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 -- 172.21.15.139:0/2019945454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 msgr2=0x7ff44810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 --2- 172.21.15.139:0/2019945454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44810c4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b0a0 tx=0x7ff44000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 -- 172.21.15.139:0/2019945454 shutdown_connections 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 --2- 172.21.15.139:0/2019945454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44810c4e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 --2- 172.21.15.139:0/2019945454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 0x7ff448105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 --2- 172.21.15.139:0/2019945454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 0x7ff4480ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 -- 172.21.15.139:0/2019945454 >> 172.21.15.139:0/2019945454 conn(0x7ff448076780 msgr2=0x7ff448076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 -- 172.21.15.139:0/2019945454 shutdown_connections 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.238+0000 7ff44deaf700 1 -- 172.21.15.139:0/2019945454 wait complete. 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 Processor -- start 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 -- start start 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 0x7ff44819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 0x7ff448196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448197100 con 0x7ff4480fffe0 2023-10-08T13:25:51.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448197270 con 0x7ff4480ff620 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff44deaf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448197430 con 0x7ff4481056b0 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff446ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff446ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38456/0 (socket says 172.21.15.139:38456) 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff446ffd700 1 -- 172.21.15.139:0/160743503 learned_addr learned my addr 172.21.15.139:0/160743503 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff4477fe700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 0x7ff44819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.239+0000 7ff447fff700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 0x7ff448196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 -- 172.21.15.139:0/160743503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 msgr2=0x7ff448196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 0x7ff448196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 -- 172.21.15.139:0/160743503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 msgr2=0x7ff44819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 0x7ff44819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 -- 172.21.15.139:0/160743503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009d00 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff446ffd700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e9a0 tx=0x7ff43000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430009790 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff430010430 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff448197710 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430018680 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.240+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4481a3960 con 0x7ff4480fffe0 2023-10-08T13:25:51.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.241+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff448100d50 con 0x7ff4480fffe0 2023-10-08T13:25:51.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.242+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7ff4300105a0 con 0x7ff4480fffe0 2023-10-08T13:25:51.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.242+0000 7ff444ff9700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 0x7ff4340a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:51.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.242+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7ff430014070 con 0x7ff4480fffe0 2023-10-08T13:25:51.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.242+0000 7ff4477fe700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 0x7ff4340a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:51.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.243+0000 7ff4477fe700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 0x7ff4340a3a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff448077ab0 tx=0x7ff438009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:51.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.246+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff4300967b0 con 0x7ff4480fffe0 2023-10-08T13:25:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.458+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff448067530 con 0x7ff4480fffe0 2023-10-08T13:25:51.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.458+0000 7ff444ff9700 1 -- 172.21.15.139:0/160743503 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v87) v1 ==== 81+0+900 (secure 0 0 0) 0x7ff430026020 con 0x7ff4480fffe0 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/542053995 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4107466857 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1347436644 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1490471359 2023-10-09T13:20:08.525995+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3474112198 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:51.460 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1278886955 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:51.461 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3196233301 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:51.461 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:25:51.461 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4197784005 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:51.461 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3589198312 2023-10-09T13:18:43.030956+0000 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.460+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 msgr2=0x7ff4340a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.460+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 0x7ff4340a3a10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff448077ab0 tx=0x7ff438009260 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.460+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 msgr2=0x7ff44819ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.460+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e9a0 tx=0x7ff43000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 shutdown_connections 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff4340a1550 0x7ff4340a3a10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4481056b0 0x7ff448196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4480ff620 0x7ff44819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 --2- 172.21.15.139:0/160743503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4480fffe0 0x7ff44819ceb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 >> 172.21.15.139:0/160743503 conn(0x7ff448076780 msgr2=0x7ff4480fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:51.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 shutdown_connections 2023-10-08T13:25:51.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:51.461+0000 7ff44deaf700 1 -- 172.21.15.139:0/160743503 wait complete. 2023-10-08T13:25:51.463 INFO:teuthology.orchestra.run.smithi139.stderr:listed 15 entries 2023-10-08T13:25:51.473 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2023-10-08T13:25:51.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:51.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-08T13:25:51.510 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi139.stderr:ceph-fuse[161177]: fuse finished with error 0 and tester_r 0 2023-10-08T13:25:51.512 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:25:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:51 smithi139 ceph-mon[99506]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 276 B/s wr, 0 op/s 2023-10-08T13:25:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3603099521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1281195670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/160743503' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:51 smithi187 ceph-mon[104336]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 276 B/s wr, 0 op/s 2023-10-08T13:25:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3603099521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1281195670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/160743503' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:51 smithi155 ceph-mon[103467]: pgmap v246: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 276 B/s wr, 0 op/s 2023-10-08T13:25:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3603099521' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:25:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1281195670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:25:52.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/160743503' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:25:53.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:53 smithi139 ceph-mon[99506]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T13:25:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:53 smithi187 ceph-mon[104336]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T13:25:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:53 smithi155 ceph-mon[103467]: pgmap v247: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2023-10-08T13:25:55.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:55 smithi139 ceph-mon[99506]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:55 smithi187 ceph-mon[104336]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:55 smithi155 ceph-mon[103467]: pgmap v248: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:57.613 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:25:57.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:25:57.614 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-08T13:25:57.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 -- 172.21.15.139:0/4247889844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 msgr2=0x7fa290106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4247889844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290106a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa278009990 tx=0x7fa278009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 -- 172.21.15.139:0/4247889844 shutdown_connections 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4247889844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa29010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4247889844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290106a20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4247889844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 0x7fa290100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 -- 172.21.15.139:0/4247889844 >> 172.21.15.139:0/4247889844 conn(0x7fa2900fc160 msgr2=0x7fa2900fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 -- 172.21.15.139:0/4247889844 shutdown_connections 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.827+0000 7fa2948cd700 1 -- 172.21.15.139:0/4247889844 wait complete. 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 Processor -- start 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 -- start start 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 0x7fa290072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa290073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901a4dd0 con 0x7fa290106640 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901a4f40 con 0x7fa290100630 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa2948cd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2901a5100 con 0x7fa290100ff0 2023-10-08T13:25:57.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa28ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa28ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38472/0 (socket says 172.21.15.139:38472) 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.828+0000 7fa28ed9d700 1 -- 172.21.15.139:0/4108073713 learned_addr learned my addr 172.21.15.139:0/4108073713 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28dd9b700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa290073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28e59c700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 0x7fa290072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 -- 172.21.15.139:0/4108073713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 msgr2=0x7fa290073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa290073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 -- 172.21.15.139:0/4108073713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 msgr2=0x7fa290072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 0x7fa290072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 -- 172.21.15.139:0/4108073713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780095f0 con 0x7fa290106640 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28dd9b700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa290073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa28ed9d700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa288007d70 tx=0x7fa28800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:57.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800ad40 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2880128e0 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2901a53e0 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288011780 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.829+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2901a58a0 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.830+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa290108c30 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.831+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa288012a50 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.832+0000 7fa2877fe700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 0x7fa27c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.832+0000 7fa28e59c700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 0x7fa27c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.832+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fa2880cd760 con 0x7fa290106640 2023-10-08T13:25:57.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.832+0000 7fa28e59c700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 0x7fa27c0a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa278005850 tx=0x7fa27801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:57.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:57.835+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa288096af0 con 0x7fa290106640 2023-10-08T13:25:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:57 smithi139 ceph-mon[99506]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:57 smithi187 ceph-mon[104336]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:58.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.027+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa290101d70 con 0x7fa290106640 2023-10-08T13:25:58.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.029+0000 7fa2877fe700 1 -- 172.21.15.139:0/4108073713 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7fa28809a110 con 0x7fa290106640 2023-10-08T13:25:58.030 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:58.030 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 msgr2=0x7fa27c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 0x7fa27c0a3990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa278005850 tx=0x7fa27801a040 comp rx=0 tx=0).stop 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 msgr2=0x7fa290073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa288007d70 tx=0x7fa28800a340 comp rx=0 tx=0).stop 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 shutdown_connections 2023-10-08T13:25:58.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa27c0a14d0 0x7fa27c0a3990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa290106640 0x7fa290073570 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa290100630 0x7fa290072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 --2- 172.21.15.139:0/4108073713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa290100ff0 0x7fa290073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 >> 172.21.15.139:0/4108073713 conn(0x7fa2900fc160 msgr2=0x7fa2900fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 shutdown_connections 2023-10-08T13:25:58.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.031+0000 7fa2948cd700 1 -- 172.21.15.139:0/4108073713 wait complete. 2023-10-08T13:25:58.044 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:25:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:57 smithi155 ceph-mon[103467]: pgmap v249: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:58.167 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 -- 172.21.15.139:0/2407793895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c010ac60 msgr2=0x7f38c010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 --2- 172.21.15.139:0/2407793895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c010ac60 0x7f38c010d0d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009990 tx=0x7f38b8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 -- 172.21.15.139:0/2407793895 shutdown_connections 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 --2- 172.21.15.139:0/2407793895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c010ac60 0x7f38c010d0d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 --2- 172.21.15.139:0/2407793895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 0x7f38c0101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 --2- 172.21.15.139:0/2407793895 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c01021b0 0x7f38c010a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 -- 172.21.15.139:0/2407793895 >> 172.21.15.139:0/2407793895 conn(0x7f38c00fb030 msgr2=0x7f38c00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 -- 172.21.15.139:0/2407793895 shutdown_connections 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.164+0000 7f38c769e700 1 -- 172.21.15.139:0/2407793895 wait complete. 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 Processor -- start 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 -- start start 2023-10-08T13:25:58.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 0x7f38c00ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c010ac60 0x7f38c00fff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01a4e40 con 0x7f38c01021b0 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01a4fb0 con 0x7f38c0101890 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c769e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01a5170 con 0x7f38c010ac60 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c4c39700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c4c39700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38484/0 (socket says 172.21.15.139:38484) 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c4c39700 1 -- 172.21.15.139:0/1071702711 learned_addr learned my addr 172.21.15.139:0/1071702711 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c5c3b700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c010ac60 0x7f38c00fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.165+0000 7f38c543a700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 0x7f38c00ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 -- 172.21.15.139:0/1071702711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c010ac60 msgr2=0x7f38c00fff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c010ac60 0x7f38c00fff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 -- 172.21.15.139:0/1071702711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 msgr2=0x7f38c00ff4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 0x7f38c00ff4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 -- 172.21.15.139:0/1071702711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80095f0 con 0x7f38c01021b0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c4c39700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38b400d950 tx=0x7f38b400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4009b40 con 0x7f38c01021b0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38b4009ca0 con 0x7f38c01021b0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c01a5450 con 0x7f38c01021b0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400f620 con 0x7f38c01021b0 2023-10-08T13:25:58.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.166+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c01a5960 con 0x7f38c01021b0 2023-10-08T13:25:58.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.167+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0105de0 con 0x7f38c01021b0 2023-10-08T13:25:58.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.168+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f38b4010460 con 0x7f38c01021b0 2023-10-08T13:25:58.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.168+0000 7f38be7fc700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.169+0000 7f38c543a700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.169+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f38b40cd2c0 con 0x7f38c01021b0 2023-10-08T13:25:58.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.169+0000 7f38c543a700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 0x7f38a80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009380 tx=0x7f38b000b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:58.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.172+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38b40966f0 con 0x7f38c01021b0 2023-10-08T13:25:58.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.364+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38c0068070 con 0x7f38c01021b0 2023-10-08T13:25:58.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.366+0000 7f38be7fc700 1 -- 172.21.15.139:0/1071702711 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f38b4099d10 con 0x7f38c01021b0 2023-10-08T13:25:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:25:58.367 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:25:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 msgr2=0x7f38a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 0x7f38a80a3990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009380 tx=0x7f38b000b040 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 msgr2=0x7f38c00ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38b400d950 tx=0x7f38b400dd10 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 shutdown_connections 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38a80a14d0 0x7f38a80a3990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38c010ac60 0x7f38c00fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38c0101890 0x7f38c00ff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 --2- 172.21.15.139:0/1071702711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38c01021b0 0x7f38c00ffa20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 >> 172.21.15.139:0/1071702711 conn(0x7f38c00fb030 msgr2=0x7f38c00fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 shutdown_connections 2023-10-08T13:25:58.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.368+0000 7f38c769e700 1 -- 172.21.15.139:0/1071702711 wait complete. 2023-10-08T13:25:58.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T13:25:58.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 -- 172.21.15.139:0/3257771488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 msgr2=0x7fd9040ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3257771488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd9040ffaa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009990 tx=0x7fd8f0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 -- 172.21.15.139:0/3257771488 shutdown_connections 2023-10-08T13:25:58.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3257771488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd90410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3257771488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 0x7fd904105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3257771488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd9040ffaa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 -- 172.21.15.139:0/3257771488 >> 172.21.15.139:0/3257771488 conn(0x7fd904076780 msgr2=0x7fd904076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 -- 172.21.15.139:0/3257771488 shutdown_connections 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.509+0000 7fd90ac77700 1 -- 172.21.15.139:0/3257771488 wait complete. 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 Processor -- start 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 -- start start 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd904195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 0x7fd90419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419a910 con 0x7fd9040ff620 2023-10-08T13:25:58.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419aa80 con 0x7fd9040fffe0 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd90ac77700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90419ac40 con 0x7fd9041056b0 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38496/0 (socket says 172.21.15.139:38496) 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 -- 172.21.15.139:0/3877521245 learned_addr learned my addr 172.21.15.139:0/3877521245 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd909214700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 0x7fd90419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd903fff700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd904195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 -- 172.21.15.139:0/3877521245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 msgr2=0x7fd90419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 0x7fd90419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 -- 172.21.15.139:0/3877521245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 msgr2=0x7fd904195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd904195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 -- 172.21.15.139:0/3877521245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00095f0 con 0x7fd9040ff620 2023-10-08T13:25:58.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd903fff700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd904195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.510+0000 7fd908a13700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c970 tx=0x7fd8f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.511+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8004220 con 0x7fd9040ff620 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.511+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8f8007d60 con 0x7fd9040ff620 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.511+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90419af20 con 0x7fd9040ff620 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.511+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003c90 con 0x7fd9040ff620 2023-10-08T13:25:58.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.511+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9041a27d0 con 0x7fd9040ff620 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.512+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904107c30 con 0x7fd9040ff620 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.513+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd8f8004380 con 0x7fd9040ff620 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.513+0000 7fd901ffb700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 0x7fd8f40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.513+0000 7fd903fff700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 0x7fd8f40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.513+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd8f80ccbf0 con 0x7fd9040ff620 2023-10-08T13:25:58.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.514+0000 7fd903fff700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 0x7fd8f40a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0006010 tx=0x7fd8f001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:58.518 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.517+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd8f8095f80 con 0x7fd9040ff620 2023-10-08T13:25:58.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:58.757+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd904196d30 con 0x7fd9040ff620 2023-10-08T13:25:58.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:58 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4108073713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:58.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:58 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1071702711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:58.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:58 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4108073713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:58.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:58 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1071702711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:59.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:58 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4108073713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:59.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:58 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1071702711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:25:59.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.682+0000 7fd901ffb700 1 -- 172.21.15.139:0/3877521245 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd8f80995a0 con 0x7fd9040ff620 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 msgr2=0x7fd8f40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 0x7fd8f40a3990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0006010 tx=0x7fd8f001a040 comp rx=0 tx=0).stop 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 msgr2=0x7fd904195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c970 tx=0x7fd8f800cc80 comp rx=0 tx=0).stop 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 shutdown_connections 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8f40a14d0 0x7fd8f40a3990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9041056b0 0x7fd90419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9040ff620 0x7fd904195a30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 --2- 172.21.15.139:0/3877521245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9040fffe0 0x7fd904195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 >> 172.21.15.139:0/3877521245 conn(0x7fd904076780 msgr2=0x7fd9040fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:59.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 shutdown_connections 2023-10-08T13:25:59.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.685+0000 7fd90ac77700 1 -- 172.21.15.139:0/3877521245 wait complete. 2023-10-08T13:25:59.701 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-10-08T13:25:59.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-08T13:25:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 -- 172.21.15.139:0/2385597918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 msgr2=0x7fac6c100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 --2- 172.21.15.139:0/2385597918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c100210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fac68009990 tx=0x7fac68009ca0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 -- 172.21.15.139:0/2385597918 shutdown_connections 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 --2- 172.21.15.139:0/2385597918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 --2- 172.21.15.139:0/2385597918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 --2- 172.21.15.139:0/2385597918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c100210 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 -- 172.21.15.139:0/2385597918 >> 172.21.15.139:0/2385597918 conn(0x7fac6c075c20 msgr2=0x7fac6c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 -- 172.21.15.139:0/2385597918 shutdown_connections 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.830+0000 7fac73c17700 1 -- 172.21.15.139:0/2385597918 wait complete. 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 Processor -- start 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 -- start start 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c1a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1986b0 con 0x7fac6c0ffd90 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1a2e70 con 0x7fac6c105630 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac73c17700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1a2fb0 con 0x7fac6c100750 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac719b3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac719b3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38508/0 (socket says 172.21.15.139:38508) 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac719b3700 1 -- 172.21.15.139:0/362824251 learned_addr learned my addr 172.21.15.139:0/362824251 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac721b4700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c1a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.831+0000 7fac711b2700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 -- 172.21.15.139:0/362824251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 msgr2=0x7fac6c197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 -- 172.21.15.139:0/362824251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 msgr2=0x7fac6c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c1a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 -- 172.21.15.139:0/362824251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac680095f0 con 0x7fac6c0ffd90 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac711b2700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac721b4700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c1a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac719b3700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c9b0 tx=0x7fac5c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c007b00 con 0x7fac6c0ffd90 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac5c007c60 con 0x7fac6c0ffd90 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c1a3290 con 0x7fac6c0ffd90 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c018660 con 0x7fac6c0ffd90 2023-10-08T13:25:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.832+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c1a37a0 con 0x7fac6c0ffd90 2023-10-08T13:25:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.833+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c107c40 con 0x7fac6c0ffd90 2023-10-08T13:25:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.834+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fac5c018880 con 0x7fac6c0ffd90 2023-10-08T13:25:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.835+0000 7fac62ffd700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 0x7fac580a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:25:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.835+0000 7fac711b2700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 0x7fac580a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:25:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.835+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fac5c0cd040 con 0x7fac6c0ffd90 2023-10-08T13:25:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.835+0000 7fac711b2700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 0x7fac580a3990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac6800b5c0 tx=0x7fac68005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:25:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:25:59.839+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fac5c0963d0 con 0x7fac6c0ffd90 2023-10-08T13:25:59.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:59 smithi139 ceph-mon[99506]: pgmap v250: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:59.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:25:59 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:25:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:59 smithi187 ceph-mon[104336]: pgmap v250: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:25:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:25:59 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:26:00.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.078+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fac6c0ff280 con 0x7fac6c0ffd90 2023-10-08T13:26:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:59 smithi155 ceph-mon[103467]: pgmap v250: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2023-10-08T13:26:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:25:59 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T13:26:00.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.374+0000 7fac62ffd700 1 -- 172.21.15.139:0/362824251 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fac5c0999f0 con 0x7fac6c0ffd90 2023-10-08T13:26:00.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 msgr2=0x7fac580a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 0x7fac580a3990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fac6800b5c0 tx=0x7fac68005fb0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 msgr2=0x7fac6c1978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c9b0 tx=0x7fac5c00cd70 comp rx=0 tx=0).stop 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 shutdown_connections 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fac580a14d0 0x7fac580a3990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6c105630 0x7fac6c1a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac6c0ffd90 0x7fac6c1978b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 --2- 172.21.15.139:0/362824251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac6c100750 0x7fac6c197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.376+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 >> 172.21.15.139:0/362824251 conn(0x7fac6c075c20 msgr2=0x7fac6c0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:00.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.377+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 shutdown_connections 2023-10-08T13:26:00.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.377+0000 7fac73c17700 1 -- 172.21.15.139:0/362824251 wait complete. 2023-10-08T13:26:00.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 -- 172.21.15.139:0/1887234221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 msgr2=0x7f1f2c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 --2- 172.21.15.139:0/1887234221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0680c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0099c0 tx=0x7f1f1c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 -- 172.21.15.139:0/1887234221 shutdown_connections 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 --2- 172.21.15.139:0/1887234221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c105b80 0x7f1f2c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 --2- 172.21.15.139:0/1887234221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0680c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 --2- 172.21.15.139:0/1887234221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c1051c0 0x7f1f2c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.520 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 -- 172.21.15.139:0/1887234221 >> 172.21.15.139:0/1887234221 conn(0x7f1f2c076780 msgr2=0x7f1f2c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:00.520 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.517+0000 7f1f31091700 1 -- 172.21.15.139:0/1887234221 shutdown_connections 2023-10-08T13:26:00.520 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.518+0000 7f1f31091700 1 -- 172.21.15.139:0/1887234221 wait complete. 2023-10-08T13:26:00.520 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.518+0000 7f1f31091700 1 Processor -- start 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.518+0000 7f1f31091700 1 -- start start 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c1051c0 0x7f1f2c0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c105b80 0x7f1f2c100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1a4f80 con 0x7f1f2c067ce0 2023-10-08T13:26:00.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1a50f0 con 0x7f1f2c1051c0 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c1a52b0 con 0x7f1f2c105b80 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38522/0 (socket says 172.21.15.139:38522) 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 -- 172.21.15.139:0/225457660 learned_addr learned my addr 172.21.15.139:0/225457660 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2a59c700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c1051c0 0x7f1f2c0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:00.530 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2b59e700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c105b80 0x7f1f2c100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 -- 172.21.15.139:0/225457660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c105b80 msgr2=0x7f1f2c100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c105b80 0x7f1f2c100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 -- 172.21.15.139:0/225457660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c1051c0 msgr2=0x7f1f2c0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c1051c0 0x7f1f2c0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 -- 172.21.15.139:0/225457660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0095f0 con 0x7f1f2c067ce0 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f2ad9d700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00b580 tx=0x7f1f1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c01d070 con 0x7f1f2c067ce0 2023-10-08T13:26:00.531 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c1a5530 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f1c00fb30 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.519+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c022c60 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.520+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c1a5950 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.520+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c108c70 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.522+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1f1c00fca0 con 0x7f1f2c067ce0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.522+0000 7f1f13fff700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 0x7f1f140a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.522+0000 7f1f2a59c700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 0x7f1f140a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:00.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.522+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f1f1c0ce4d0 con 0x7f1f2c067ce0 2023-10-08T13:26:00.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.523+0000 7f1f2a59c700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 0x7f1f140a3990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c100de0 tx=0x7f1f2000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:00.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.526+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1f1c0978f0 con 0x7f1f2c067ce0 2023-10-08T13:26:00.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:00.766+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f1f2c101e70 con 0x7f1f2c067ce0 2023-10-08T13:26:00.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:26:00.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-08T13:26:00.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:00 smithi139 ceph-mon[99506]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-08T13:26:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:26:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-08T13:26:00.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:00 smithi187 ceph-mon[104336]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-08T13:26:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3877521245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T13:26:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2023-10-08T13:26:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T13:26:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T13:26:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T13:26:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/362824251' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T13:26:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2023-10-08T13:26:01.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:00 smithi155 ceph-mon[103467]: daemon mds.c is now active in filesystem cephfs as rank 1 2023-10-08T13:26:01.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.388+0000 7f1f13fff700 1 -- 172.21.15.139:0/225457660 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f1f1c09af10 con 0x7f1f2c067ce0 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 msgr2=0x7f1f140a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 0x7f1f140a3990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c100de0 tx=0x7f1f2000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 msgr2=0x7f1f2c0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00b580 tx=0x7f1f1c004730 comp rx=0 tx=0).stop 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 shutdown_connections 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1f140a14d0 0x7f1f140a3990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f2c105b80 0x7f1f2c100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f2c067ce0 0x7f1f2c0ff6b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 --2- 172.21.15.139:0/225457660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f2c1051c0 0x7f1f2c0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 >> 172.21.15.139:0/225457660 conn(0x7f1f2c076780 msgr2=0x7f1f2c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:01.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 shutdown_connections 2023-10-08T13:26:01.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.391+0000 7f1f31091700 1 -- 172.21.15.139:0/225457660 wait complete. 2023-10-08T13:26:01.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-08T13:26:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- 172.21.15.139:0/4001960387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67501056b0 msgr2=0x7f6750105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 --2- 172.21.15.139:0/4001960387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67501056b0 0x7f6750105a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6744009990 tx=0x7f6744009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- 172.21.15.139:0/4001960387 shutdown_connections 2023-10-08T13:26:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 --2- 172.21.15.139:0/4001960387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 0x7f675010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 --2- 172.21.15.139:0/4001960387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67501056b0 0x7f6750105a90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 --2- 172.21.15.139:0/4001960387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500ff620 0x7f67500ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- 172.21.15.139:0/4001960387 >> 172.21.15.139:0/4001960387 conn(0x7f6750076780 msgr2=0x7f6750076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- 172.21.15.139:0/4001960387 shutdown_connections 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- 172.21.15.139:0/4001960387 wait complete. 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 Processor -- start 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.537+0000 7f6756892700 1 -- start start 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 0x7f6750197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67501056b0 0x7f67501a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501986b0 con 0x7f67500ff620 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501a2e70 con 0x7f67500fffe0 2023-10-08T13:26:01.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6756892700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67501a2fb0 con 0x7f67501056b0 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38536/0 (socket says 172.21.15.139:38536) 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 -- 172.21.15.139:0/3486261577 learned_addr learned my addr 172.21.15.139:0/3486261577 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674f7fe700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 0x7f6750197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 -- 172.21.15.139:0/3486261577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67501056b0 msgr2=0x7f67501a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f6754e2f700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67501056b0 0x7f67501a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67501056b0 0x7f67501a2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 -- 172.21.15.139:0/3486261577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 msgr2=0x7f6750197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 0x7f6750197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 -- 172.21.15.139:0/3486261577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67440095f0 con 0x7f67500ff620 2023-10-08T13:26:01.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.538+0000 7f674ffff700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67440095c0 tx=0x7f674400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:01.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674401d070 con 0x7f67500ff620 2023-10-08T13:26:01.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6744005050 con 0x7f67500ff620 2023-10-08T13:26:01.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67501a3230 con 0x7f67500ff620 2023-10-08T13:26:01.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744004b10 con 0x7f67500ff620 2023-10-08T13:26:01.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67501a3710 con 0x7f67500ff620 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.539+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6750107c10 con 0x7f67500ff620 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.541+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f67440051c0 con 0x7f67500ff620 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.541+0000 7f674d7fa700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 0x7f67380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.541+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f67440ce230 con 0x7f67500ff620 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.541+0000 7f674f7fe700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 0x7f67380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:01.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.542+0000 7f674f7fe700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 0x7f67380a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6750068080 tx=0x7f674000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:01.545 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.545+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6744097650 con 0x7f67500ff620 2023-10-08T13:26:01.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:01.784+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f6750067530 con 0x7f67500ff620 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:26:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-08T13:26:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2023-10-08T13:26:01.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:01 smithi139 ceph-mon[99506]: daemon mds.b is now active in filesystem cephfs as rank 2 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:26:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-08T13:26:01.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2023-10-08T13:26:01.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:01 smithi187 ceph-mon[104336]: daemon mds.b is now active in filesystem cephfs as rank 2 2023-10-08T13:26:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: pgmap v251: 129 pgs: 129 active+clean; 581 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2023-10-08T13:26:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T13:26:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/225457660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T13:26:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:26:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T13:26:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2023-10-08T13:26:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:creating} 9 up:standby 2023-10-08T13:26:02.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:01 smithi155 ceph-mon[103467]: daemon mds.b is now active in filesystem cephfs as rank 2 2023-10-08T13:26:02.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.394+0000 7f674d7fa700 1 -- 172.21.15.139:0/3486261577 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f674409ac70 con 0x7f67500ff620 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 msgr2=0x7f67380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 0x7f67380a3990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6750068080 tx=0x7f674000a380 comp rx=0 tx=0).stop 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 msgr2=0x7f67501978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f67440095c0 tx=0x7f674400f690 comp rx=0 tx=0).stop 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 shutdown_connections 2023-10-08T13:26:02.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f67380a14d0 0x7f67380a3990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67501056b0 0x7f67501a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67500ff620 0x7f67501978b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 --2- 172.21.15.139:0/3486261577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67500fffe0 0x7f6750197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 >> 172.21.15.139:0/3486261577 conn(0x7f6750076780 msgr2=0x7f67500fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 shutdown_connections 2023-10-08T13:26:02.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.397+0000 7f6756892700 1 -- 172.21.15.139:0/3486261577 wait complete. 2023-10-08T13:26:02.416 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-10-08T13:26:02.416 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-08T13:26:02.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 -- 172.21.15.139:0/3615249196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 msgr2=0x7f2990105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 --2- 172.21.15.139:0/3615249196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f2990105a10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f298c009990 tx=0x7f298c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 -- 172.21.15.139:0/3615249196 shutdown_connections 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 --2- 172.21.15.139:0/3615249196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2990100000 0x7f299010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 --2- 172.21.15.139:0/3615249196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f2990105a10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 --2- 172.21.15.139:0/3615249196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29900ff640 0x7f29900ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 -- 172.21.15.139:0/3615249196 >> 172.21.15.139:0/3615249196 conn(0x7f2990076790 msgr2=0x7f2990076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 -- 172.21.15.139:0/3615249196 shutdown_connections 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.548+0000 7f2997eb3700 1 -- 172.21.15.139:0/3615249196 wait complete. 2023-10-08T13:26:02.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 Processor -- start 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 -- start start 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29900ff640 0x7f2990197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 0x7f2990197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990198740 con 0x7f2990105630 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901a2f50 con 0x7f29900ff640 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2997eb3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29901a3090 con 0x7f2990100000 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2996450700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2996450700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38554/0 (socket says 172.21.15.139:38554) 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2996450700 1 -- 172.21.15.139:0/482829492 learned_addr learned my addr 172.21.15.139:0/482829492 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.549+0000 7f2995c4f700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29900ff640 0x7f2990197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f299544e700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 0x7f2990197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 -- 172.21.15.139:0/482829492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 msgr2=0x7f2990197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 0x7f2990197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 -- 172.21.15.139:0/482829492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29900ff640 msgr2=0x7f2990197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29900ff640 0x7f2990197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 -- 172.21.15.139:0/482829492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0095f0 con 0x7f2990105630 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f299544e700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 0x7f2990197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2996450700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2988007ee0 tx=0x7f298800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988017070 con 0x7f2990105630 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f298800f040 con 0x7f2990105630 2023-10-08T13:26:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2988005740 con 0x7f2990105630 2023-10-08T13:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29901a3320 con 0x7f2990105630 2023-10-08T13:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.550+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29901a37e0 con 0x7f2990105630 2023-10-08T13:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.551+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2990107bb0 con 0x7f2990105630 2023-10-08T13:26:02.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.553+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f298800dc60 con 0x7f2990105630 2023-10-08T13:26:02.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.553+0000 7f2986ffd700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 0x7f297c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.553+0000 7f2995c4f700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 0x7f297c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.553+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f29880cce30 con 0x7f2990105630 2023-10-08T13:26:02.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.554+0000 7f2995c4f700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 0x7f297c0a3990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f298c00b5c0 tx=0x7f298c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:02.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.557+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29880961c0 con 0x7f2990105630 2023-10-08T13:26:02.687 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: 2023-10-08T13:26:02.379+0000 7f68c0aa5700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-08T13:26:02.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.782+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f2990069250 con 0x7f297c0a14d0 2023-10-08T13:26:02.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.825+0000 7f2986ffd700 1 -- 172.21.15.139:0/482829492 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2990069250 con 0x7f297c0a14d0 2023-10-08T13:26:02.828 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 msgr2=0x7f297c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.828 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 0x7f297c0a3990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f298c00b5c0 tx=0x7f298c005960 comp rx=0 tx=0).stop 2023-10-08T13:26:02.828 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 msgr2=0x7f29901a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.828 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2988007ee0 tx=0x7f298800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 shutdown_connections 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f297c0a14d0 0x7f297c0a3990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2990105630 0x7f29901a2a10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29900ff640 0x7f2990197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 --2- 172.21.15.139:0/482829492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2990100000 0x7f2990197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 >> 172.21.15.139:0/482829492 conn(0x7f2990076790 msgr2=0x7f29900fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 shutdown_connections 2023-10-08T13:26:02.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.827+0000 7f2997eb3700 1 -- 172.21.15.139:0/482829492 wait complete. 2023-10-08T13:26:02.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-08T13:26:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:26:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:26:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:26:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-mon[99506]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:26:02.787+0000 7f81bf2c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:26:02.787+0000 7f81bf2c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:26:02.787+0000 7f81bf2c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:26:02.787+0000 7f81bf2c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:26:02.938 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:26:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:26:02.787+0000 7f81bf2c7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- 172.21.15.139:0/914961778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500106750 msgr2=0x7fd500106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 --2- 172.21.15.139:0/914961778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500106750 0x7fd500106b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009990 tx=0x7fd4f4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- 172.21.15.139:0/914961778 shutdown_connections 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 --2- 172.21.15.139:0/914961778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 --2- 172.21.15.139:0/914961778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500106750 0x7fd500106b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 --2- 172.21.15.139:0/914961778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500100740 0x7fd500100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- 172.21.15.139:0/914961778 >> 172.21.15.139:0/914961778 conn(0x7fd5000fc230 msgr2=0x7fd5000fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- 172.21.15.139:0/914961778 shutdown_connections 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- 172.21.15.139:0/914961778 wait complete. 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 Processor -- start 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.965+0000 7fd506b9a700 1 -- start start 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500106750 0x7fd5001969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500197000 con 0x7fd500100740 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500197170 con 0x7fd500101100 2023-10-08T13:26:02.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd500197330 con 0x7fd500106750 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38582/0 (socket says 172.21.15.139:38582) 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 -- 172.21.15.139:0/2805097142 learned_addr learned my addr 172.21.15.139:0/2805097142 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd505137700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500106750 0x7fd5001969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd4fffff700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 -- 172.21.15.139:0/2805097142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500106750 msgr2=0x7fd5001969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500106750 0x7fd5001969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 -- 172.21.15.139:0/2805097142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 msgr2=0x7fd50019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 -- 172.21.15.139:0/2805097142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40095f0 con 0x7fd500100740 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd4fffff700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:02.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd504936700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4000c00 tx=0x7fd4f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401d070 con 0x7fd500100740 2023-10-08T13:26:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4f4022470 con 0x7fd500100740 2023-10-08T13:26:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5001975b0 con 0x7fd500100740 2023-10-08T13:26:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.966+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4017650 con 0x7fd500100740 2023-10-08T13:26:02.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.967+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5001a3860 con 0x7fd500100740 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.968+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500108cd0 con 0x7fd500100740 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.969+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd4f40225e0 con 0x7fd500100740 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.969+0000 7fd4fdffb700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 0x7fd4f00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.970+0000 7fd4fffff700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 0x7fd4f00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.970+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd4f40ce290 con 0x7fd500100740 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.970+0000 7fd4fffff700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 0x7fd4f00a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd500197b60 tx=0x7fd4ec009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:02.974+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd4f40976b0 con 0x7fd500100740 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:26:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:02 smithi187 ceph-mon[104336]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:26:03.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3486261577' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=b=up:active} 9 up:standby 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:creating} 8 up:standby 2023-10-08T13:26:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:02 smithi155 ceph-mon[103467]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T13:26:03.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.201+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd500197e60 con 0x7fd4f00a14d0 2023-10-08T13:26:03.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.206+0000 7fd4fdffb700 1 -- 172.21.15.139:0/2805097142 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fd500197e60 con 0x7fd4f00a14d0 2023-10-08T13:26:03.207 INFO:teuthology.orchestra.run.smithi139.stdout:/volumes/_nogroup/sv_0/5db2d1c3-f3b7-4059-90d9-52c2b8209ac0 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 msgr2=0x7fd4f00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 0x7fd4f00a3990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd500197b60 tx=0x7fd4ec009260 comp rx=0 tx=0).stop 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 msgr2=0x7fd50019c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4000c00 tx=0x7fd4f4004730 comp rx=0 tx=0).stop 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 shutdown_connections 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd4f00a14d0 0x7fd4f00a3990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd500106750 0x7fd5001969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd500100740 0x7fd50019c870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 --2- 172.21.15.139:0/2805097142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd500101100 0x7fd50019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 >> 172.21.15.139:0/2805097142 conn(0x7fd5000fc230 msgr2=0x7fd5000fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:03.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 shutdown_connections 2023-10-08T13:26:03.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.208+0000 7fd506b9a700 1 -- 172.21.15.139:0/2805097142 wait complete. 2023-10-08T13:26:03.221 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 -- 172.21.15.139:0/3961067074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 msgr2=0x7f474c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 --2- 172.21.15.139:0/3961067074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c100bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4748009990 tx=0x7f4748009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 -- 172.21.15.139:0/3961067074 shutdown_connections 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 --2- 172.21.15.139:0/3961067074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c101100 0x7f474c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 --2- 172.21.15.139:0/3961067074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c106750 0x7f474c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 --2- 172.21.15.139:0/3961067074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c100bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 -- 172.21.15.139:0/3961067074 >> 172.21.15.139:0/3961067074 conn(0x7f474c0fc230 msgr2=0x7f474c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 -- 172.21.15.139:0/3961067074 shutdown_connections 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.346+0000 7f47532f1700 1 -- 172.21.15.139:0/3961067074 wait complete. 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 Processor -- start 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 -- start start 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c101100 0x7f474c19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c106750 0x7f474c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c197020 con 0x7f474c100740 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c197190 con 0x7f474c106750 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f47532f1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c197350 con 0x7f474c101100 2023-10-08T13:26:03.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38596/0 (socket says 172.21.15.139:38596) 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 -- 172.21.15.139:0/2951177215 learned_addr learned my addr 172.21.15.139:0/2951177215 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475188e700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c106750 0x7f474c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475088c700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c101100 0x7f474c19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 -- 172.21.15.139:0/2951177215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c101100 msgr2=0x7f474c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c101100 0x7f474c19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 -- 172.21.15.139:0/2951177215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c106750 msgr2=0x7f474c1969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c106750 0x7f474c1969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 -- 172.21.15.139:0/2951177215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47480095f0 con 0x7f474c100740 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.347+0000 7f475108d700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f474000c920 tx=0x7f474000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.348+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4740007b00 con 0x7f474c100740 2023-10-08T13:26:03.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.348+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f474000ce70 con 0x7f474c100740 2023-10-08T13:26:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.348+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c197630 con 0x7f474c100740 2023-10-08T13:26:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.348+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47400054e0 con 0x7f474c100740 2023-10-08T13:26:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.348+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c1a3880 con 0x7f474c100740 2023-10-08T13:26:03.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.349+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c108cd0 con 0x7f474c100740 2023-10-08T13:26:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.350+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f4740004750 con 0x7f474c100740 2023-10-08T13:26:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.350+0000 7f473e7fc700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 0x7f47380a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.350+0000 7f475088c700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 0x7f47380a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.350+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f47400ccaf0 con 0x7f474c100740 2023-10-08T13:26:03.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.351+0000 7f475088c700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 0x7f47380a3a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4748005850 tx=0x7f474801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:03.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.354+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4740095e80 con 0x7f474c100740 2023-10-08T13:26:03.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.584+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f474c197e80 con 0x7f47380a1550 2023-10-08T13:26:03.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.608+0000 7f473e7fc700 1 -- 172.21.15.139:0/2951177215 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f474c197e80 con 0x7f47380a1550 2023-10-08T13:26:03.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 msgr2=0x7f47380a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 0x7f47380a3a10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4748005850 tx=0x7f474801a040 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 msgr2=0x7f474c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f474000c920 tx=0x7f474000cc30 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 shutdown_connections 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f47380a1550 0x7f47380a3a10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f474c106750 0x7f474c1969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f474c100740 0x7f474c19c890 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 --2- 172.21.15.139:0/2951177215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f474c101100 0x7f474c19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 >> 172.21.15.139:0/2951177215 conn(0x7f474c0fc230 msgr2=0x7f474c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 shutdown_connections 2023-10-08T13:26:03.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.611+0000 7f47532f1700 1 -- 172.21.15.139:0/2951177215 wait complete. 2023-10-08T13:26:03.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.748+0000 7f0d14e2e700 1 -- 172.21.15.139:0/3478785433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100ff620 msgr2=0x7f0d100ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.748+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/3478785433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100ff620 0x7f0d100ffaa0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009990 tx=0x7f0cf8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 -- 172.21.15.139:0/3478785433 shutdown_connections 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/3478785433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d100fffe0 0x7f0d1010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/3478785433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d101056b0 0x7f0d10105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/3478785433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100ff620 0x7f0d100ffaa0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 -- 172.21.15.139:0/3478785433 >> 172.21.15.139:0/3478785433 conn(0x7f0d10076780 msgr2=0x7f0d10076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 -- 172.21.15.139:0/3478785433 shutdown_connections 2023-10-08T13:26:03.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 -- 172.21.15.139:0/3478785433 wait complete. 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 Processor -- start 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.749+0000 7f0d14e2e700 1 -- start start 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 0x7f0d10197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 0x7f0d101a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10198700 con 0x7f0d100fffe0 2023-10-08T13:26:03.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d101a2f10 con 0x7f0d101056b0 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d101a3050 con 0x7f0d100ff620 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38614/0 (socket says 172.21.15.139:38614) 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 -- 172.21.15.139:0/1417588159 learned_addr learned my addr 172.21.15.139:0/1417588159 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0e59c700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 0x7f0d10197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0ed9d700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 0x7f0d101a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 -- 172.21.15.139:0/1417588159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 msgr2=0x7f0d10197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 0x7f0d10197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 -- 172.21.15.139:0/1417588159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 msgr2=0x7f0d101a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 0x7f0d101a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 -- 172.21.15.139:0/1417588159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80095f0 con 0x7f0d100fffe0 2023-10-08T13:26:03.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0e59c700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 0x7f0d10197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0ed9d700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 0x7f0d101a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d0dd9b700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf801d070 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d101a3280 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0cf8022470 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8017650 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.750+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d101a37b0 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.751+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10107c30 con 0x7f0d100fffe0 2023-10-08T13:26:03.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.752+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0cf80225e0 con 0x7f0d100fffe0 2023-10-08T13:26:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.753+0000 7f0d077fe700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 0x7f0cfc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.753+0000 7f0d0e59c700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 0x7f0cfc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.753+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f0cf80ce730 con 0x7f0d100fffe0 2023-10-08T13:26:03.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.754+0000 7f0d0e59c700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 0x7f0cfc0a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005d90 tx=0x7f0d00005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:03.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.757+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0cf8097c70 con 0x7f0d100fffe0 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: pgmap v252: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:26:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:26:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:26:03.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:03 smithi139 ceph-mon[99506]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:26:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: pgmap v252: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2023-10-08T13:26:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:26:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:26:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:26:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:26:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:26:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:26:03.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:03 smithi187 ceph-mon[104336]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:26:03.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.986+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d10067df0 con 0x7f0cfc0a14d0 2023-10-08T13:26:03.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.990+0000 7f0d077fe700 1 -- 172.21.15.139:0/1417588159 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f0d10067df0 con 0x7f0cfc0a14d0 2023-10-08T13:26:03.993 INFO:teuthology.orchestra.run.smithi139.stdout:/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587 2023-10-08T13:26:03.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 msgr2=0x7f0cfc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 0x7f0cfc0a3990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005d90 tx=0x7f0d00005d00 comp rx=0 tx=0).stop 2023-10-08T13:26:03.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 msgr2=0x7f0d10197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005ef0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 shutdown_connections 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0cfc0a14d0 0x7f0cfc0a3990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d101056b0 0x7f0d101a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d100ff620 0x7f0d10197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 --2- 172.21.15.139:0/1417588159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d100fffe0 0x7f0d10197e90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 >> 172.21.15.139:0/1417588159 conn(0x7f0d10076780 msgr2=0x7f0d100fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 shutdown_connections 2023-10-08T13:26:03.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:03.992+0000 7f0d14e2e700 1 -- 172.21.15.139:0/1417588159 wait complete. 2023-10-08T13:26:04.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:26:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: pgmap v252: 129 pgs: 129 active+clean; 583 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 2 op/s 2023-10-08T13:26:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:26:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T13:26:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T13:26:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:26:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=b=up:active,3=f=up:active} 8 up:standby 2023-10-08T13:26:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-10-08T13:26:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:03 smithi155 ceph-mon[103467]: daemon mds.h is now active in filesystem cephfs as rank 4 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.125+0000 7fd638afe700 1 -- 172.21.15.139:0/4283400590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6340ff540 msgr2=0x7fd6340ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.125+0000 7fd638afe700 1 --2- 172.21.15.139:0/4283400590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6340ff540 0x7fd6340ff9c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0099c0 tx=0x7fd61c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 -- 172.21.15.139:0/4283400590 shutdown_connections 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 --2- 172.21.15.139:0/4283400590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 0x7fd63410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 --2- 172.21.15.139:0/4283400590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd634105600 0x7fd6341059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 --2- 172.21.15.139:0/4283400590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6340ff540 0x7fd6340ff9c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 -- 172.21.15.139:0/4283400590 >> 172.21.15.139:0/4283400590 conn(0x7fd6340fb030 msgr2=0x7fd6340fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 -- 172.21.15.139:0/4283400590 shutdown_connections 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 -- 172.21.15.139:0/4283400590 wait complete. 2023-10-08T13:26:04.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 Processor -- start 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.126+0000 7fd638afe700 1 -- start start 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6340ff540 0x7fd63419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 0x7fd63419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634196f60 con 0x7fd634105600 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6341970d0 con 0x7fd6340ff540 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd634197290 con 0x7fd6340fff00 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38630/0 (socket says 172.21.15.139:38630) 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 -- 172.21.15.139:0/1209603653 learned_addr learned my addr 172.21.15.139:0/1209603653 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:04.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd63259c700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6340ff540 0x7fd63419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd631d9b700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 0x7fd63419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 -- 172.21.15.139:0/1209603653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 msgr2=0x7fd63419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 0x7fd63419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 -- 172.21.15.139:0/1209603653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6340ff540 msgr2=0x7fd63419c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6340ff540 0x7fd63419c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 -- 172.21.15.139:0/1209603653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c0095f0 con 0x7fd634105600 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd632d9d700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ada0 tx=0x7fd62c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c00f070 con 0x7fd634105600 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd62c007b30 con 0x7fd634105600 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd634197570 con 0x7fd634105600 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0053e0 con 0x7fd634105600 2023-10-08T13:26:04.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.127+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6341a37c0 con 0x7fd634105600 2023-10-08T13:26:04.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.128+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd634100c60 con 0x7fd634105600 2023-10-08T13:26:04.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.129+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd62c00c980 con 0x7fd634105600 2023-10-08T13:26:04.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.130+0000 7fd62b7fe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 0x7fd6200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.130+0000 7fd63259c700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 0x7fd6200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.130+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7fd62c0ccc50 con 0x7fd634105600 2023-10-08T13:26:04.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.130+0000 7fd63259c700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 0x7fd6200a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd624009c60 tx=0x7fd624009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.133+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd62c096070 con 0x7fd634105600 2023-10-08T13:26:04.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.369+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd634067450 con 0x7fd634105600 2023-10-08T13:26:04.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.370+0000 7fd62b7fe700 1 -- 172.21.15.139:0/1209603653 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11356 (secure 0 0 0) 0x7fd62c099690 con 0x7fd634105600 2023-10-08T13:26:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:04.371 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24542,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:03.404487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:creating","state_seq":1,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 msgr2=0x7fd6200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 0x7fd6200a3990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd624009c60 tx=0x7fd624009260 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 msgr2=0x7fd634196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00ada0 tx=0x7fd62c00c330 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 shutdown_connections 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6200a14d0 0x7fd6200a3990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd634105600 0x7fd634196900 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6340ff540 0x7fd63419c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 --2- 172.21.15.139:0/1209603653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6340fff00 0x7fd63419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 >> 172.21.15.139:0/1209603653 conn(0x7fd6340fb030 msgr2=0x7fd6340fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:04.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 shutdown_connections 2023-10-08T13:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.372+0000 7fd638afe700 1 -- 172.21.15.139:0/1209603653 wait complete. 2023-10-08T13:26:04.375 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 24 2023-10-08T13:26:04.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 -- 172.21.15.139:0/2622351596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c100640 msgr2=0x7f5b5c100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 --2- 172.21.15.139:0/2622351596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c100640 0x7f5b5c100ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009990 tx=0x7f5b4c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 -- 172.21.15.139:0/2622351596 shutdown_connections 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 --2- 172.21.15.139:0/2622351596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 --2- 172.21.15.139:0/2622351596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c106650 0x7f5b5c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 --2- 172.21.15.139:0/2622351596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c100640 0x7f5b5c100ac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.509+0000 7f5b643f2700 1 -- 172.21.15.139:0/2622351596 >> 172.21.15.139:0/2622351596 conn(0x7f5b5c0fc1b0 msgr2=0x7f5b5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- 172.21.15.139:0/2622351596 shutdown_connections 2023-10-08T13:26:04.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- 172.21.15.139:0/2622351596 wait complete. 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 Processor -- start 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- start start 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 0x7f5b5c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1a4e60 con 0x7f5b5c106650 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1a4fd0 con 0x7f5b5c101000 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b643f2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1a5190 con 0x7f5b5c100640 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b6298f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b6298f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38674/0 (socket says 172.21.15.139:38674) 2023-10-08T13:26:04.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.510+0000 7f5b6298f700 1 -- 172.21.15.139:0/151628837 learned_addr learned my addr 172.21.15.139:0/151628837 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6198d700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6218e700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 0x7f5b5c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 -- 172.21.15.139:0/151628837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 msgr2=0x7f5b5c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 0x7f5b5c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 -- 172.21.15.139:0/151628837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 msgr2=0x7f5b5c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 -- 172.21.15.139:0/151628837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0095f0 con 0x7f5b5c106650 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6218e700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 0x7f5b5c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6198d700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b6298f700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007ee0 tx=0x7f5b5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400ddd0 con 0x7f5b5c106650 2023-10-08T13:26:04.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c1a5470 con 0x7f5b5c106650 2023-10-08T13:26:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b5400f040 con 0x7f5b5c106650 2023-10-08T13:26:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54015400 con 0x7f5b5c106650 2023-10-08T13:26:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.511+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c1a5980 con 0x7f5b5c106650 2023-10-08T13:26:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.512+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c108bd0 con 0x7f5b5c106650 2023-10-08T13:26:04.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.513+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5b54004000 con 0x7f5b5c106650 2023-10-08T13:26:04.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.513+0000 7f5b537fe700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 0x7f5b480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.514+0000 7f5b6218e700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 0x7f5b480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.514+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f5b540cd200 con 0x7f5b5c106650 2023-10-08T13:26:04.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.514+0000 7f5b6218e700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 0x7f5b480a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b58005fd0 tx=0x7f5b58005d40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.518 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.517+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b54096590 con 0x7f5b5c106650 2023-10-08T13:26:04.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.710+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b5c073fd0 con 0x7f5b5c106650 2023-10-08T13:26:04.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.711+0000 7f5b537fe700 1 -- 172.21.15.139:0/151628837 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+24302 (secure 0 0 0) 0x7f5b54023090 con 0x7f5b5c106650 2023-10-08T13:26:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:04.713 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":87,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:25:38.868612+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:04.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 msgr2=0x7f5b480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 0x7f5b480a3990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b58005fd0 tx=0x7f5b58005d40 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 msgr2=0x7f5b5c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007ee0 tx=0x7f5b5400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 shutdown_connections 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5b480a14d0 0x7f5b480a3990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b5c106650 0x7f5b5c073570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b5c100640 0x7f5b5c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 --2- 172.21.15.139:0/151628837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b5c101000 0x7f5b5c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 >> 172.21.15.139:0/151628837 conn(0x7f5b5c0fc1b0 msgr2=0x7f5b5c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 shutdown_connections 2023-10-08T13:26:04.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.713+0000 7f5b643f2700 1 -- 172.21.15.139:0/151628837 wait complete. 2023-10-08T13:26:04.727 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T13:26:04.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:26:04.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/3779840584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c106660 msgr2=0x7f6f9c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/3779840584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c106660 0x7f6f9c106a40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009990 tx=0x7f6f8c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/3779840584 shutdown_connections 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/3779840584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c101010 0x7f6f9c10d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/3779840584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c106660 0x7f6f9c106a40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/3779840584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c100650 0x7f6f9c100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/3779840584 >> 172.21.15.139:0/3779840584 conn(0x7f6f9c0fc160 msgr2=0x7f6f9c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/3779840584 shutdown_connections 2023-10-08T13:26:04.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.848+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/3779840584 wait complete. 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 Processor -- start 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 -- start start 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c101010 0x7f6f9c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c106660 0x7f6f9c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a4e70 con 0x7f6f9c100650 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a4fe0 con 0x7f6f9c101010 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa3ef7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c1a51a0 con 0x7f6f9c106660 2023-10-08T13:26:04.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38684/0 (socket says 172.21.15.139:38684) 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 -- 172.21.15.139:0/2259940055 learned_addr learned my addr 172.21.15.139:0/2259940055 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1492700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c101010 0x7f6f9c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa2494700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c106660 0x7f6f9c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 -- 172.21.15.139:0/2259940055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c106660 msgr2=0x7f6f9c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c106660 0x7f6f9c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 -- 172.21.15.139:0/2259940055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c101010 msgr2=0x7f6f9c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:04.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c101010 0x7f6f9c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.849+0000 7f6fa1c93700 1 -- 172.21.15.139:0/2259940055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0095f0 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6fa1c93700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c01d070 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f8c022470 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c1a5420 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c017650 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.850+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c1a5900 con 0x7f6f9c100650 2023-10-08T13:26:04.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.851+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c108c50 con 0x7f6f9c100650 2023-10-08T13:26:04.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.852+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f6f8c0225e0 con 0x7f6f9c100650 2023-10-08T13:26:04.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.852+0000 7f6f92ffd700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 0x7f6f880a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:04.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.852+0000 7f6fa1492700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 0x7f6f880a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:04.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.852+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f6f8c0ce730 con 0x7f6f9c100650 2023-10-08T13:26:04.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.853+0000 7f6fa1492700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 0x7f6f880a3990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c074220 tx=0x7f6f98009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:04.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:04.856+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6f8c097b50 con 0x7f6f9c100650 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1209603653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:26:04.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:04 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:26:05.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.044+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f9c073fd0 con 0x7f6f880a14d0 2023-10-08T13:26:05.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.056+0000 7f6f92ffd700 1 -- 172.21.15.139:0/2259940055 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422930 (secure 0 0 0) 0x7f6f9c073fd0 con 0x7f6f880a14d0 2023-10-08T13:26:05.062 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 msgr2=0x7f6f880a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 0x7f6f880a3990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c074220 tx=0x7f6f98009260 comp rx=0 tx=0).stop 2023-10-08T13:26:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 msgr2=0x7f6f9c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c004730 comp rx=0 tx=0).stop 2023-10-08T13:26:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 shutdown_connections 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6f880a14d0 0x7f6f880a3990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f9c106660 0x7f6f9c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f9c100650 0x7f6f9c072af0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 --2- 172.21.15.139:0/2259940055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f9c101010 0x7f6f9c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 >> 172.21.15.139:0/2259940055 conn(0x7f6f9c0fc160 msgr2=0x7f6f9c0fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 shutdown_connections 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.060+0000 7f6fa3ef7700 1 -- 172.21.15.139:0/2259940055 wait complete. 2023-10-08T13:26:05.067 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1209603653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:26:05.073 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:04 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:26:05.074 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2023-10-08T13:26:04.600201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614529,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":300,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335684,"kb_used_data":11476,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606140,"statfs":{"total":1151940427776,"available":1151596687360,"internally_reserved":0,"allocated":11751424,"data_stored":7586418,"data_compressed":282816,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19662,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470938+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:25:38.470938+0000","last_peered":"2023-10-08T13:25:38.470938+0000","last_clean":"2023-10-08T13:25:38.470938+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:25:38.470938+0000","last_undegraded":"2023-10-08T13:25:38.470938+0000","last_fullsized":"2023-10-08T13:25:38.470938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479555+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:25:38.479555+0000","last_peered":"2023-10-08T13:25:38.479555+0000","last_clean":"2023-10-08T13:25:38.479555+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:25:38.479555+0000","last_undegraded":"2023-10-08T13:25:38.479555+0000","last_fullsized":"2023-10-08T13:25:38.479555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476520+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:25:38.476520+0000","last_peered":"2023-10-08T13:25:38.476520+0000","last_clean":"2023-10-08T13:25:38.476520+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:25:38.476520+0000","last_undegraded":"2023-10-08T13:25:38.476520+0000","last_fullsized":"2023-10-08T13:25:38.476520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479276+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:25:38.479276+0000","last_peered":"2023-10-08T13:25:38.479276+0000","last_clean":"2023-10-08T13:25:38.479276+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:25:38.479276+0000","last_undegraded":"2023-10-08T13:25:38.479276+0000","last_fullsized":"2023-10-08T13:25:38.479276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476566+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:25:38.476566+0000","last_peered":"2023-10-08T13:25:38.476566+0000","last_clean":"2023-10-08T13:25:38.476566+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:25:38.476566+0000","last_undegraded":"2023-10-08T13:25:38.476566+0000","last_fullsized":"2023-10-08T13:25:38.476566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566454+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:25:38.566454+0000","last_peered":"2023-10-08T13:25:38.566454+0000","last_clean":"2023-10-08T13:25:38.566454+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:25:38.566454+0000","last_undegraded":"2023-10-08T13:25:38.566454+0000","last_fullsized":"2023-10-08T13:25:38.566454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479248+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:25:38.479248+0000","last_peered":"2023-10-08T13:25:38.479248+0000","last_clean":"2023-10-08T13:25:38.479248+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:25:38.479248+0000","last_undegraded":"2023-10-08T13:25:38.479248+0000","last_fullsized":"2023-10-08T13:25:38.479248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479558+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:25:38.479558+0000","last_peered":"2023-10-08T13:25:38.479558+0000","last_clean":"2023-10-08T13:25:38.479558+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:25:38.479558+0000","last_undegraded":"2023-10-08T13:25:38.479558+0000","last_fullsized":"2023-10-08T13:25:38.479558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473711+0000","last_change":"2023-10-08T13:25:34.450050+0000","last_active":"2023-10-08T13:25:38.473711+0000","last_peered":"2023-10-08T13:25:38.473711+0000","last_clean":"2023-10-08T13:25:38.473711+0000","last_became_active":"2023-10-08T13:25:34.449689+0000","last_became_peered":"2023-10-08T13:25:34.449689+0000","last_unstale":"2023-10-08T13:25:38.473711+0000","last_undegraded":"2023-10-08T13:25:38.473711+0000","last_fullsized":"2023-10-08T13:25:38.473711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:14.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566793+0000","last_change":"2023-10-08T13:25:34.444970+0000","last_active":"2023-10-08T13:25:38.566793+0000","last_peered":"2023-10-08T13:25:38.566793+0000","last_clean":"2023-10-08T13:25:38.566793+0000","last_became_active":"2023-10-08T13:25:34.444058+0000","last_became_peered":"2023-10-08T13:25:34.444058+0000","last_unstale":"2023-10-08T13:25:38.566793+0000","last_undegraded":"2023-10-08T13:25:38.566793+0000","last_fullsized":"2023-10-08T13:25:38.566793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:16.743327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481563+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:25:38.481563+0000","last_peered":"2023-10-08T13:25:38.481563+0000","last_clean":"2023-10-08T13:25:38.481563+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:25:38.481563+0000","last_undegraded":"2023-10-08T13:25:38.481563+0000","last_fullsized":"2023-10-08T13:25:38.481563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479180+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:25:38.479180+0000","last_peered":"2023-10-08T13:25:38.479180+0000","last_clean":"2023-10-08T13:25:38.479180+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:25:38.479180+0000","last_undegraded":"2023-10-08T13:25:38.479180+0000","last_fullsized":"2023-10-08T13:25:38.479180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472397+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:25:38.472397+0000","last_peered":"2023-10-08T13:25:38.472397+0000","last_clean":"2023-10-08T13:25:38.472397+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:25:38.472397+0000","last_undegraded":"2023-10-08T13:25:38.472397+0000","last_fullsized":"2023-10-08T13:25:38.472397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477320+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:25:38.477320+0000","last_peered":"2023-10-08T13:25:38.477320+0000","last_clean":"2023-10-08T13:25:38.477320+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:25:38.477320+0000","last_undegraded":"2023-10-08T13:25:38.477320+0000","last_fullsized":"2023-10-08T13:25:38.477320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477222+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:25:38.477222+0000","last_peered":"2023-10-08T13:25:38.477222+0000","last_clean":"2023-10-08T13:25:38.477222+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:25:38.477222+0000","last_undegraded":"2023-10-08T13:25:38.477222+0000","last_fullsized":"2023-10-08T13:25:38.477222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472813+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:25:38.472813+0000","last_peered":"2023-10-08T13:25:38.472813+0000","last_clean":"2023-10-08T13:25:38.472813+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:25:38.472813+0000","last_undegraded":"2023-10-08T13:25:38.472813+0000","last_fullsized":"2023-10-08T13:25:38.472813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470663+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:25:38.470663+0000","last_peered":"2023-10-08T13:25:38.470663+0000","last_clean":"2023-10-08T13:25:38.470663+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:25:38.470663+0000","last_undegraded":"2023-10-08T13:25:38.470663+0000","last_fullsized":"2023-10-08T13:25:38.470663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476611+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:25:38.476611+0000","last_peered":"2023-10-08T13:25:38.476611+0000","last_clean":"2023-10-08T13:25:38.476611+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:25:38.476611+0000","last_undegraded":"2023-10-08T13:25:38.476611+0000","last_fullsized":"2023-10-08T13:25:38.476611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477373+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:25:38.477373+0000","last_peered":"2023-10-08T13:25:38.477373+0000","last_clean":"2023-10-08T13:25:38.477373+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:25:38.477373+0000","last_undegraded":"2023-10-08T13:25:38.477373+0000","last_fullsized":"2023-10-08T13:25:38.477373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722874+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:25:39.722874+0000","last_peered":"2023-10-08T13:25:39.722874+0000","last_clean":"2023-10-08T13:25:39.722874+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:25:39.722874+0000","last_undegraded":"2023-10-08T13:25:39.722874+0000","last_fullsized":"2023-10-08T13:25:39.722874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.408179+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:26:01.408179+0000","last_peered":"2023-10-08T13:26:01.408179+0000","last_clean":"2023-10-08T13:26:01.408179+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:26:01.408179+0000","last_undegraded":"2023-10-08T13:26:01.408179+0000","last_fullsized":"2023-10-08T13:26:01.408179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.482674+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:25:38.482674+0000","last_peered":"2023-10-08T13:25:38.482674+0000","last_clean":"2023-10-08T13:25:38.482674+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:25:38.482674+0000","last_undegraded":"2023-10-08T13:25:38.482674+0000","last_fullsized":"2023-10-08T13:25:38.482674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487311+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:25:39.487311+0000","last_peered":"2023-10-08T13:25:39.487311+0000","last_clean":"2023-10-08T13:25:39.487311+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:25:39.487311+0000","last_undegraded":"2023-10-08T13:25:39.487311+0000","last_fullsized":"2023-10-08T13:25:39.487311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480810+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:25:38.480810+0000","last_peered":"2023-10-08T13:25:38.480810+0000","last_clean":"2023-10-08T13:25:38.480810+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:25:38.480810+0000","last_undegraded":"2023-10-08T13:25:38.480810+0000","last_fullsized":"2023-10-08T13:25:38.480810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477021+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:25:38.477021+0000","last_peered":"2023-10-08T13:25:38.477021+0000","last_clean":"2023-10-08T13:25:38.477021+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:25:38.477021+0000","last_undegraded":"2023-10-08T13:25:38.477021+0000","last_fullsized":"2023-10-08T13:25:38.477021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487653+0000","last_change":"2023-10-08T13:25:38.488774+0000","last_active":"2023-10-08T13:25:39.487653+0000","last_peered":"2023-10-08T13:25:39.487653+0000","last_clean":"2023-10-08T13:25:39.487653+0000","last_became_active":"2023-10-08T13:25:38.488365+0000","last_became_peered":"2023-10-08T13:25:38.488365+0000","last_unstale":"2023-10-08T13:25:39.487653+0000","last_undegraded":"2023-10-08T13:25:39.487653+0000","last_fullsized":"2023-10-08T13:25:39.487653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:20.298232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480235+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:25:38.480235+0000","last_peered":"2023-10-08T13:25:38.480235+0000","last_clean":"2023-10-08T13:25:38.480235+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:25:38.480235+0000","last_undegraded":"2023-10-08T13:25:38.480235+0000","last_fullsized":"2023-10-08T13:25:38.480235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473360+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:25:38.473360+0000","last_peered":"2023-10-08T13:25:38.473360+0000","last_clean":"2023-10-08T13:25:38.473360+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:25:38.473360+0000","last_undegraded":"2023-10-08T13:25:38.473360+0000","last_fullsized":"2023-10-08T13:25:38.473360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487881+0000","last_change":"2023-10-08T13:25:38.487086+0000","last_active":"2023-10-08T13:25:39.487881+0000","last_peered":"2023-10-08T13:25:39.487881+0000","last_clean":"2023-10-08T13:25:39.487881+0000","last_became_active":"2023-10-08T13:25:38.486661+0000","last_became_peered":"2023-10-08T13:25:38.486661+0000","last_unstale":"2023-10-08T13:25:39.487881+0000","last_undegraded":"2023-10-08T13:25:39.487881+0000","last_fullsized":"2023-10-08T13:25:39.487881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:04.031142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480155+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:25:38.480155+0000","last_peered":"2023-10-08T13:25:38.480155+0000","last_clean":"2023-10-08T13:25:38.480155+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:25:38.480155+0000","last_undegraded":"2023-10-08T13:25:38.480155+0000","last_fullsized":"2023-10-08T13:25:38.480155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477880+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:25:38.477880+0000","last_peered":"2023-10-08T13:25:38.477880+0000","last_clean":"2023-10-08T13:25:38.477880+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:25:38.477880+0000","last_undegraded":"2023-10-08T13:25:38.477880+0000","last_fullsized":"2023-10-08T13:25:38.477880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722601+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:25:39.722601+0000","last_peered":"2023-10-08T13:25:39.722601+0000","last_clean":"2023-10-08T13:25:39.722601+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:25:39.722601+0000","last_undegraded":"2023-10-08T13:25:39.722601+0000","last_fullsized":"2023-10-08T13:25:39.722601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387664+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:26:00.387664+0000","last_peered":"2023-10-08T13:26:00.387664+0000","last_clean":"2023-10-08T13:26:00.387664+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:26:00.387664+0000","last_undegraded":"2023-10-08T13:26:00.387664+0000","last_fullsized":"2023-10-08T13:26:00.387664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476454+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:25:38.476454+0000","last_peered":"2023-10-08T13:25:38.476454+0000","last_clean":"2023-10-08T13:25:38.476454+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:25:38.476454+0000","last_undegraded":"2023-10-08T13:25:38.476454+0000","last_fullsized":"2023-10-08T13:25:38.476454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722334+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:25:39.722334+0000","last_peered":"2023-10-08T13:25:39.722334+0000","last_clean":"2023-10-08T13:25:39.722334+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:25:39.722334+0000","last_undegraded":"2023-10-08T13:25:39.722334+0000","last_fullsized":"2023-10-08T13:25:39.722334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:02.411806+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:26:02.411806+0000","last_peered":"2023-10-08T13:26:02.411806+0000","last_clean":"2023-10-08T13:26:02.411806+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:26:02.411806+0000","last_undegraded":"2023-10-08T13:26:02.411806+0000","last_fullsized":"2023-10-08T13:26:02.411806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477615+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:25:38.477615+0000","last_peered":"2023-10-08T13:25:38.477615+0000","last_clean":"2023-10-08T13:25:38.477615+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:25:38.477615+0000","last_undegraded":"2023-10-08T13:25:38.477615+0000","last_fullsized":"2023-10-08T13:25:38.477615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487180+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:25:39.487180+0000","last_peered":"2023-10-08T13:25:39.487180+0000","last_clean":"2023-10-08T13:25:39.487180+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:25:39.487180+0000","last_undegraded":"2023-10-08T13:25:39.487180+0000","last_fullsized":"2023-10-08T13:25:39.487180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.407380+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:26:01.407380+0000","last_peered":"2023-10-08T13:26:01.407380+0000","last_clean":"2023-10-08T13:26:01.407380+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:26:01.407380+0000","last_undegraded":"2023-10-08T13:26:01.407380+0000","last_fullsized":"2023-10-08T13:26:01.407380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479484+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:25:38.479484+0000","last_peered":"2023-10-08T13:25:38.479484+0000","last_clean":"2023-10-08T13:25:38.479484+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:25:38.479484+0000","last_undegraded":"2023-10-08T13:25:38.479484+0000","last_fullsized":"2023-10-08T13:25:38.479484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.790793+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:25:39.790793+0000","last_peered":"2023-10-08T13:25:39.790793+0000","last_clean":"2023-10-08T13:25:39.790793+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:25:39.790793+0000","last_undegraded":"2023-10-08T13:25:39.790793+0000","last_fullsized":"2023-10-08T13:25:39.790793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722114+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:25:39.722114+0000","last_peered":"2023-10-08T13:25:39.722114+0000","last_clean":"2023-10-08T13:25:39.722114+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:25:39.722114+0000","last_undegraded":"2023-10-08T13:25:39.722114+0000","last_fullsized":"2023-10-08T13:25:39.722114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476027+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:25:38.476027+0000","last_peered":"2023-10-08T13:25:38.476027+0000","last_clean":"2023-10-08T13:25:38.476027+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:25:38.476027+0000","last_undegraded":"2023-10-08T13:25:38.476027+0000","last_fullsized":"2023-10-08T13:25:38.476027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487081+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:25:39.487081+0000","last_peered":"2023-10-08T13:25:39.487081+0000","last_clean":"2023-10-08T13:25:39.487081+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:25:39.487081+0000","last_undegraded":"2023-10-08T13:25:39.487081+0000","last_fullsized":"2023-10-08T13:25:39.487081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387664+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:26:00.387664+0000","last_peered":"2023-10-08T13:26:00.387664+0000","last_clean":"2023-10-08T13:26:00.387664+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:26:00.387664+0000","last_undegraded":"2023-10-08T13:26:00.387664+0000","last_fullsized":"2023-10-08T13:26:00.387664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473757+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:25:38.473757+0000","last_peered":"2023-10-08T13:25:38.473757+0000","last_clean":"2023-10-08T13:25:38.473757+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:25:38.473757+0000","last_undegraded":"2023-10-08T13:25:38.473757+0000","last_fullsized":"2023-10-08T13:25:38.473757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721380+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:25:39.721380+0000","last_peered":"2023-10-08T13:25:39.721380+0000","last_clean":"2023-10-08T13:25:39.721380+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:25:39.721380+0000","last_undegraded":"2023-10-08T13:25:39.721380+0000","last_fullsized":"2023-10-08T13:25:39.721380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481002+0000","last_change":"2023-10-08T13:25:33.439513+0000","last_active":"2023-10-08T13:25:38.481002+0000","last_peered":"2023-10-08T13:25:38.481002+0000","last_clean":"2023-10-08T13:25:38.481002+0000","last_became_active":"2023-10-08T13:25:33.439118+0000","last_became_peered":"2023-10-08T13:25:33.439118+0000","last_unstale":"2023-10-08T13:25:38.481002+0000","last_undegraded":"2023-10-08T13:25:38.481002+0000","last_fullsized":"2023-10-08T13:25:38.481002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:05.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477070+0000","last_change":"2023-10-08T13:25:34.455215+0000","last_active":"2023-10-08T13:25:38.477070+0000","last_peered":"2023-10-08T13:25:38.477070+0000","last_clean":"2023-10-08T13:25:38.477070+0000","last_became_active":"2023-10-08T13:25:34.454659+0000","last_became_peered":"2023-10-08T13:25:34.454659+0000","last_unstale":"2023-10-08T13:25:38.477070+0000","last_undegraded":"2023-10-08T13:25:38.477070+0000","last_fullsized":"2023-10-08T13:25:38.477070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:13.504220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487908+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:25:39.487908+0000","last_peered":"2023-10-08T13:25:39.487908+0000","last_clean":"2023-10-08T13:25:39.487908+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:25:39.487908+0000","last_undegraded":"2023-10-08T13:25:39.487908+0000","last_fullsized":"2023-10-08T13:25:39.487908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722801+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:25:39.722801+0000","last_peered":"2023-10-08T13:25:39.722801+0000","last_clean":"2023-10-08T13:25:39.722801+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:25:39.722801+0000","last_undegraded":"2023-10-08T13:25:39.722801+0000","last_fullsized":"2023-10-08T13:25:39.722801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473709+0000","last_change":"2023-10-08T13:25:34.452739+0000","last_active":"2023-10-08T13:25:38.473709+0000","last_peered":"2023-10-08T13:25:38.473709+0000","last_clean":"2023-10-08T13:25:38.473709+0000","last_became_active":"2023-10-08T13:25:34.452398+0000","last_became_peered":"2023-10-08T13:25:34.452398+0000","last_unstale":"2023-10-08T13:25:38.473709+0000","last_undegraded":"2023-10-08T13:25:38.473709+0000","last_fullsized":"2023-10-08T13:25:38.473709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:38.169304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721395+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:25:39.721395+0000","last_peered":"2023-10-08T13:25:39.721395+0000","last_clean":"2023-10-08T13:25:39.721395+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:25:39.721395+0000","last_undegraded":"2023-10-08T13:25:39.721395+0000","last_fullsized":"2023-10-08T13:25:39.721395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'18","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:02.817933+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:26:02.817933+0000","last_peered":"2023-10-08T13:26:02.817933+0000","last_clean":"2023-10-08T13:26:02.817933+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:26:02.817933+0000","last_undegraded":"2023-10-08T13:26:02.817933+0000","last_fullsized":"2023-10-08T13:26:02.817933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21223,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479993+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:25:38.479993+0000","last_peered":"2023-10-08T13:25:38.479993+0000","last_clean":"2023-10-08T13:25:38.479993+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:25:38.479993+0000","last_undegraded":"2023-10-08T13:25:38.479993+0000","last_fullsized":"2023-10-08T13:25:38.479993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.723086+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:25:39.723086+0000","last_peered":"2023-10-08T13:25:39.723086+0000","last_clean":"2023-10-08T13:25:39.723086+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:25:39.723086+0000","last_undegraded":"2023-10-08T13:25:39.723086+0000","last_fullsized":"2023-10-08T13:25:39.723086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476164+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:25:38.476164+0000","last_peered":"2023-10-08T13:25:38.476164+0000","last_clean":"2023-10-08T13:25:38.476164+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:25:38.476164+0000","last_undegraded":"2023-10-08T13:25:38.476164+0000","last_fullsized":"2023-10-08T13:25:38.476164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472249+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:25:38.472249+0000","last_peered":"2023-10-08T13:25:38.472249+0000","last_clean":"2023-10-08T13:25:38.472249+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:25:38.472249+0000","last_undegraded":"2023-10-08T13:25:38.472249+0000","last_fullsized":"2023-10-08T13:25:38.472249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487218+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:25:39.487218+0000","last_peered":"2023-10-08T13:25:39.487218+0000","last_clean":"2023-10-08T13:25:39.487218+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:25:39.487218+0000","last_undegraded":"2023-10-08T13:25:39.487218+0000","last_fullsized":"2023-10-08T13:25:39.487218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387409+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:26:00.387409+0000","last_peered":"2023-10-08T13:26:00.387409+0000","last_clean":"2023-10-08T13:26:00.387409+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:26:00.387409+0000","last_undegraded":"2023-10-08T13:26:00.387409+0000","last_fullsized":"2023-10-08T13:26:00.387409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481420+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:25:38.481420+0000","last_peered":"2023-10-08T13:25:38.481420+0000","last_clean":"2023-10-08T13:25:38.481420+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:25:38.481420+0000","last_undegraded":"2023-10-08T13:25:38.481420+0000","last_fullsized":"2023-10-08T13:25:38.481420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721680+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:25:39.721680+0000","last_peered":"2023-10-08T13:25:39.721680+0000","last_clean":"2023-10-08T13:25:39.721680+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:25:39.721680+0000","last_undegraded":"2023-10-08T13:25:39.721680+0000","last_fullsized":"2023-10-08T13:25:39.721680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.406149+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:26:01.406149+0000","last_peered":"2023-10-08T13:26:01.406149+0000","last_clean":"2023-10-08T13:26:01.406149+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:26:01.406149+0000","last_undegraded":"2023-10-08T13:26:01.406149+0000","last_fullsized":"2023-10-08T13:26:01.406149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479610+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:25:38.479610+0000","last_peered":"2023-10-08T13:25:38.479610+0000","last_clean":"2023-10-08T13:25:38.479610+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:25:38.479610+0000","last_undegraded":"2023-10-08T13:25:38.479610+0000","last_fullsized":"2023-10-08T13:25:38.479610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722218+0000","last_change":"2023-10-08T13:25:38.489818+0000","last_active":"2023-10-08T13:25:39.722218+0000","last_peered":"2023-10-08T13:25:39.722218+0000","last_clean":"2023-10-08T13:25:39.722218+0000","last_became_active":"2023-10-08T13:25:38.489325+0000","last_became_peered":"2023-10-08T13:25:38.489325+0000","last_unstale":"2023-10-08T13:25:39.722218+0000","last_undegraded":"2023-10-08T13:25:39.722218+0000","last_fullsized":"2023-10-08T13:25:39.722218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:53.184502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386185+0000","last_change":"2023-10-08T13:25:33.440499+0000","last_active":"2023-10-08T13:26:00.386185+0000","last_peered":"2023-10-08T13:26:00.386185+0000","last_clean":"2023-10-08T13:26:00.386185+0000","last_became_active":"2023-10-08T13:25:33.440191+0000","last_became_peered":"2023-10-08T13:25:33.440191+0000","last_unstale":"2023-10-08T13:26:00.386185+0000","last_undegraded":"2023-10-08T13:26:00.386185+0000","last_fullsized":"2023-10-08T13:26:00.386185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:47.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478796+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:25:38.478796+0000","last_peered":"2023-10-08T13:25:38.478796+0000","last_clean":"2023-10-08T13:25:38.478796+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:25:38.478796+0000","last_undegraded":"2023-10-08T13:25:38.478796+0000","last_fullsized":"2023-10-08T13:25:38.478796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722334+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:25:39.722334+0000","last_peered":"2023-10-08T13:25:39.722334+0000","last_clean":"2023-10-08T13:25:39.722334+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:25:39.722334+0000","last_undegraded":"2023-10-08T13:25:39.722334+0000","last_fullsized":"2023-10-08T13:25:39.722334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479932+0000","last_change":"2023-10-08T13:25:33.435437+0000","last_active":"2023-10-08T13:25:38.479932+0000","last_peered":"2023-10-08T13:25:38.479932+0000","last_clean":"2023-10-08T13:25:38.479932+0000","last_became_active":"2023-10-08T13:25:33.435097+0000","last_became_peered":"2023-10-08T13:25:33.435097+0000","last_unstale":"2023-10-08T13:25:38.479932+0000","last_undegraded":"2023-10-08T13:25:38.479932+0000","last_fullsized":"2023-10-08T13:25:38.479932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:15.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470495+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:25:38.470495+0000","last_peered":"2023-10-08T13:25:38.470495+0000","last_clean":"2023-10-08T13:25:38.470495+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:25:38.470495+0000","last_undegraded":"2023-10-08T13:25:38.470495+0000","last_fullsized":"2023-10-08T13:25:38.470495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722351+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:25:39.722351+0000","last_peered":"2023-10-08T13:25:39.722351+0000","last_clean":"2023-10-08T13:25:39.722351+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:25:39.722351+0000","last_undegraded":"2023-10-08T13:25:39.722351+0000","last_fullsized":"2023-10-08T13:25:39.722351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.483908+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:25:38.483908+0000","last_peered":"2023-10-08T13:25:38.483908+0000","last_clean":"2023-10-08T13:25:38.483908+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:25:38.483908+0000","last_undegraded":"2023-10-08T13:25:38.483908+0000","last_fullsized":"2023-10-08T13:25:38.483908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566689+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:25:38.566689+0000","last_peered":"2023-10-08T13:25:38.566689+0000","last_clean":"2023-10-08T13:25:38.566689+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:25:38.566689+0000","last_undegraded":"2023-10-08T13:25:38.566689+0000","last_fullsized":"2023-10-08T13:25:38.566689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721710+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:25:39.721710+0000","last_peered":"2023-10-08T13:25:39.721710+0000","last_clean":"2023-10-08T13:25:39.721710+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:25:39.721710+0000","last_undegraded":"2023-10-08T13:25:39.721710+0000","last_fullsized":"2023-10-08T13:25:39.721710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480696+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:25:38.480696+0000","last_peered":"2023-10-08T13:25:38.480696+0000","last_clean":"2023-10-08T13:25:38.480696+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:25:38.480696+0000","last_undegraded":"2023-10-08T13:25:38.480696+0000","last_fullsized":"2023-10-08T13:25:38.480696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566516+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:25:38.566516+0000","last_peered":"2023-10-08T13:25:38.566516+0000","last_clean":"2023-10-08T13:25:38.566516+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:25:38.566516+0000","last_undegraded":"2023-10-08T13:25:38.566516+0000","last_fullsized":"2023-10-08T13:25:38.566516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721844+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:25:39.721844+0000","last_peered":"2023-10-08T13:25:39.721844+0000","last_clean":"2023-10-08T13:25:39.721844+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:25:39.721844+0000","last_undegraded":"2023-10-08T13:25:39.721844+0000","last_fullsized":"2023-10-08T13:25:39.721844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477674+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:25:38.477674+0000","last_peered":"2023-10-08T13:25:38.477674+0000","last_clean":"2023-10-08T13:25:38.477674+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:25:38.477674+0000","last_undegraded":"2023-10-08T13:25:38.477674+0000","last_fullsized":"2023-10-08T13:25:38.477674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.408260+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:26:01.408260+0000","last_peered":"2023-10-08T13:26:01.408260+0000","last_clean":"2023-10-08T13:26:01.408260+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:26:01.408260+0000","last_undegraded":"2023-10-08T13:26:01.408260+0000","last_fullsized":"2023-10-08T13:26:01.408260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722309+0000","last_change":"2023-10-08T13:25:38.493979+0000","last_active":"2023-10-08T13:25:39.722309+0000","last_peered":"2023-10-08T13:25:39.722309+0000","last_clean":"2023-10-08T13:25:39.722309+0000","last_became_active":"2023-10-08T13:25:38.493473+0000","last_became_peered":"2023-10-08T13:25:38.493473+0000","last_unstale":"2023-10-08T13:25:39.722309+0000","last_undegraded":"2023-10-08T13:25:39.722309+0000","last_fullsized":"2023-10-08T13:25:39.722309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:44.380527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476488+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:25:38.476488+0000","last_peered":"2023-10-08T13:25:38.476488+0000","last_clean":"2023-10-08T13:25:38.476488+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:25:38.476488+0000","last_undegraded":"2023-10-08T13:25:38.476488+0000","last_fullsized":"2023-10-08T13:25:38.476488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.388162+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:26:00.388162+0000","last_peered":"2023-10-08T13:26:00.388162+0000","last_clean":"2023-10-08T13:26:00.388162+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:26:00.388162+0000","last_undegraded":"2023-10-08T13:26:00.388162+0000","last_fullsized":"2023-10-08T13:26:00.388162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479419+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:25:38.479419+0000","last_peered":"2023-10-08T13:25:38.479419+0000","last_clean":"2023-10-08T13:25:38.479419+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:25:38.479419+0000","last_undegraded":"2023-10-08T13:25:38.479419+0000","last_fullsized":"2023-10-08T13:25:38.479419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722323+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:25:39.722323+0000","last_peered":"2023-10-08T13:25:39.722323+0000","last_clean":"2023-10-08T13:25:39.722323+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:25:39.722323+0000","last_undegraded":"2023-10-08T13:25:39.722323+0000","last_fullsized":"2023-10-08T13:25:39.722323+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472169+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:25:38.472169+0000","last_peered":"2023-10-08T13:25:38.472169+0000","last_clean":"2023-10-08T13:25:38.472169+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:25:38.472169+0000","last_undegraded":"2023-10-08T13:25:38.472169+0000","last_fullsized":"2023-10-08T13:25:38.472169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479608+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:25:38.479608+0000","last_peered":"2023-10-08T13:25:38.479608+0000","last_clean":"2023-10-08T13:25:38.479608+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:25:38.479608+0000","last_undegraded":"2023-10-08T13:25:38.479608+0000","last_fullsized":"2023-10-08T13:25:38.479608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487042+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:25:39.487042+0000","last_peered":"2023-10-08T13:25:39.487042+0000","last_clean":"2023-10-08T13:25:39.487042+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:25:39.487042+0000","last_undegraded":"2023-10-08T13:25:39.487042+0000","last_fullsized":"2023-10-08T13:25:39.487042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721952+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:25:39.721952+0000","last_peered":"2023-10-08T13:25:39.721952+0000","last_clean":"2023-10-08T13:25:39.721952+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:25:39.721952+0000","last_undegraded":"2023-10-08T13:25:39.721952+0000","last_fullsized":"2023-10-08T13:25:39.721952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472776+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:25:38.472776+0000","last_peered":"2023-10-08T13:25:38.472776+0000","last_clean":"2023-10-08T13:25:38.472776+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:25:38.472776+0000","last_undegraded":"2023-10-08T13:25:38.472776+0000","last_fullsized":"2023-10-08T13:25:38.472776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.486931+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:25:39.486931+0000","last_peered":"2023-10-08T13:25:39.486931+0000","last_clean":"2023-10-08T13:25:39.486931+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:25:39.486931+0000","last_undegraded":"2023-10-08T13:25:39.486931+0000","last_fullsized":"2023-10-08T13:25:39.486931+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.406320+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:26:01.406320+0000","last_peered":"2023-10-08T13:26:01.406320+0000","last_clean":"2023-10-08T13:26:01.406320+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:26:01.406320+0000","last_undegraded":"2023-10-08T13:26:01.406320+0000","last_fullsized":"2023-10-08T13:26:01.406320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476129+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:25:38.476129+0000","last_peered":"2023-10-08T13:25:38.476129+0000","last_clean":"2023-10-08T13:25:38.476129+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:25:38.476129+0000","last_undegraded":"2023-10-08T13:25:38.476129+0000","last_fullsized":"2023-10-08T13:25:38.476129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722605+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:25:39.722605+0000","last_peered":"2023-10-08T13:25:39.722605+0000","last_clean":"2023-10-08T13:25:39.722605+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:25:39.722605+0000","last_undegraded":"2023-10-08T13:25:39.722605+0000","last_fullsized":"2023-10-08T13:25:39.722605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386024+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:26:00.386024+0000","last_peered":"2023-10-08T13:26:00.386024+0000","last_clean":"2023-10-08T13:26:00.386024+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:26:00.386024+0000","last_undegraded":"2023-10-08T13:26:00.386024+0000","last_fullsized":"2023-10-08T13:26:00.386024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479643+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:25:38.479643+0000","last_peered":"2023-10-08T13:25:38.479643+0000","last_clean":"2023-10-08T13:25:38.479643+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:25:38.479643+0000","last_undegraded":"2023-10-08T13:25:38.479643+0000","last_fullsized":"2023-10-08T13:25:38.479643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487794+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:25:39.487794+0000","last_peered":"2023-10-08T13:25:39.487794+0000","last_clean":"2023-10-08T13:25:39.487794+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:25:39.487794+0000","last_undegraded":"2023-10-08T13:25:39.487794+0000","last_fullsized":"2023-10-08T13:25:39.487794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386199+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:26:00.386199+0000","last_peered":"2023-10-08T13:26:00.386199+0000","last_clean":"2023-10-08T13:26:00.386199+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:26:00.386199+0000","last_undegraded":"2023-10-08T13:26:00.386199+0000","last_fullsized":"2023-10-08T13:26:00.386199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476384+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:25:38.476384+0000","last_peered":"2023-10-08T13:25:38.476384+0000","last_clean":"2023-10-08T13:25:38.476384+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:25:38.476384+0000","last_undegraded":"2023-10-08T13:25:38.476384+0000","last_fullsized":"2023-10-08T13:25:38.476384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721903+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:25:39.721903+0000","last_peered":"2023-10-08T13:25:39.721903+0000","last_clean":"2023-10-08T13:25:39.721903+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:25:39.721903+0000","last_undegraded":"2023-10-08T13:25:39.721903+0000","last_fullsized":"2023-10-08T13:25:39.721903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480786+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:25:38.480786+0000","last_peered":"2023-10-08T13:25:38.480786+0000","last_clean":"2023-10-08T13:25:38.480786+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:25:38.480786+0000","last_undegraded":"2023-10-08T13:25:38.480786+0000","last_fullsized":"2023-10-08T13:25:38.480786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470348+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:25:38.470348+0000","last_peered":"2023-10-08T13:25:38.470348+0000","last_clean":"2023-10-08T13:25:38.470348+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:25:38.470348+0000","last_undegraded":"2023-10-08T13:25:38.470348+0000","last_fullsized":"2023-10-08T13:25:38.470348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487658+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:25:39.487658+0000","last_peered":"2023-10-08T13:25:39.487658+0000","last_clean":"2023-10-08T13:25:39.487658+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:25:39.487658+0000","last_undegraded":"2023-10-08T13:25:39.487658+0000","last_fullsized":"2023-10-08T13:25:39.487658+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478352+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:25:38.478352+0000","last_peered":"2023-10-08T13:25:38.478352+0000","last_clean":"2023-10-08T13:25:38.478352+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:25:38.478352+0000","last_undegraded":"2023-10-08T13:25:38.478352+0000","last_fullsized":"2023-10-08T13:25:38.478352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476377+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:25:38.476377+0000","last_peered":"2023-10-08T13:25:38.476377+0000","last_clean":"2023-10-08T13:25:38.476377+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:25:38.476377+0000","last_undegraded":"2023-10-08T13:25:38.476377+0000","last_fullsized":"2023-10-08T13:25:38.476377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487691+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:25:39.487691+0000","last_peered":"2023-10-08T13:25:39.487691+0000","last_clean":"2023-10-08T13:25:39.487691+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:25:39.487691+0000","last_undegraded":"2023-10-08T13:25:39.487691+0000","last_fullsized":"2023-10-08T13:25:39.487691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387832+0000","last_change":"2023-10-08T13:25:33.439503+0000","last_active":"2023-10-08T13:26:00.387832+0000","last_peered":"2023-10-08T13:26:00.387832+0000","last_clean":"2023-10-08T13:26:00.387832+0000","last_became_active":"2023-10-08T13:25:33.439197+0000","last_became_peered":"2023-10-08T13:25:33.439197+0000","last_unstale":"2023-10-08T13:26:00.387832+0000","last_undegraded":"2023-10-08T13:26:00.387832+0000","last_fullsized":"2023-10-08T13:26:00.387832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:19.983872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480788+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:25:38.480788+0000","last_peered":"2023-10-08T13:25:38.480788+0000","last_clean":"2023-10-08T13:25:38.480788+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:25:38.480788+0000","last_undegraded":"2023-10-08T13:25:38.480788+0000","last_fullsized":"2023-10-08T13:25:38.480788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721378+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:25:39.721378+0000","last_peered":"2023-10-08T13:25:39.721378+0000","last_clean":"2023-10-08T13:25:39.721378+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:25:39.721378+0000","last_undegraded":"2023-10-08T13:25:39.721378+0000","last_fullsized":"2023-10-08T13:25:39.721378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480237+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:25:38.480237+0000","last_peered":"2023-10-08T13:25:38.480237+0000","last_clean":"2023-10-08T13:25:38.480237+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:25:38.480237+0000","last_undegraded":"2023-10-08T13:25:38.480237+0000","last_fullsized":"2023-10-08T13:25:38.480237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481647+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:25:38.481647+0000","last_peered":"2023-10-08T13:25:38.481647+0000","last_clean":"2023-10-08T13:25:38.481647+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:25:38.481647+0000","last_undegraded":"2023-10-08T13:25:38.481647+0000","last_fullsized":"2023-10-08T13:25:38.481647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.790670+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:25:39.790670+0000","last_peered":"2023-10-08T13:25:39.790670+0000","last_clean":"2023-10-08T13:25:39.790670+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:25:39.790670+0000","last_undegraded":"2023-10-08T13:25:39.790670+0000","last_fullsized":"2023-10-08T13:25:39.790670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477958+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:25:38.477958+0000","last_peered":"2023-10-08T13:25:38.477958+0000","last_clean":"2023-10-08T13:25:38.477958+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:25:38.477958+0000","last_undegraded":"2023-10-08T13:25:38.477958+0000","last_fullsized":"2023-10-08T13:25:38.477958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481578+0000","last_change":"2023-10-08T13:25:34.445670+0000","last_active":"2023-10-08T13:25:38.481578+0000","last_peered":"2023-10-08T13:25:38.481578+0000","last_clean":"2023-10-08T13:25:38.481578+0000","last_became_active":"2023-10-08T13:25:34.443048+0000","last_became_peered":"2023-10-08T13:25:34.443048+0000","last_unstale":"2023-10-08T13:25:38.481578+0000","last_undegraded":"2023-10-08T13:25:38.481578+0000","last_fullsized":"2023-10-08T13:25:38.481578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:25:58.440282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721940+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:25:39.721940+0000","last_peered":"2023-10-08T13:25:39.721940+0000","last_clean":"2023-10-08T13:25:39.721940+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:25:39.721940+0000","last_undegraded":"2023-10-08T13:25:39.721940+0000","last_fullsized":"2023-10-08T13:25:39.721940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:03.415267+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:26:03.415267+0000","last_peered":"2023-10-08T13:26:03.415267+0000","last_clean":"2023-10-08T13:26:03.415267+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:26:03.415267+0000","last_undegraded":"2023-10-08T13:26:03.415267+0000","last_fullsized":"2023-10-08T13:26:03.415267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481069+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:25:38.481069+0000","last_peered":"2023-10-08T13:25:38.481069+0000","last_clean":"2023-10-08T13:25:38.481069+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:25:38.481069+0000","last_undegraded":"2023-10-08T13:25:38.481069+0000","last_fullsized":"2023-10-08T13:25:38.481069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470374+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:25:38.470374+0000","last_peered":"2023-10-08T13:25:38.470374+0000","last_clean":"2023-10-08T13:25:38.470374+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:25:38.470374+0000","last_undegraded":"2023-10-08T13:25:38.470374+0000","last_fullsized":"2023-10-08T13:25:38.470374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481050+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:25:38.481050+0000","last_peered":"2023-10-08T13:25:38.481050+0000","last_clean":"2023-10-08T13:25:38.481050+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:25:38.481050+0000","last_undegraded":"2023-10-08T13:25:38.481050+0000","last_fullsized":"2023-10-08T13:25:38.481050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478246+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:25:38.478246+0000","last_peered":"2023-10-08T13:25:38.478246+0000","last_clean":"2023-10-08T13:25:38.478246+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:25:38.478246+0000","last_undegraded":"2023-10-08T13:25:38.478246+0000","last_fullsized":"2023-10-08T13:25:38.478246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478958+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:25:38.478958+0000","last_peered":"2023-10-08T13:25:38.478958+0000","last_clean":"2023-10-08T13:25:38.478958+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:25:38.478958+0000","last_undegraded":"2023-10-08T13:25:38.478958+0000","last_fullsized":"2023-10-08T13:25:38.478958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472826+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:25:38.472826+0000","last_peered":"2023-10-08T13:25:38.472826+0000","last_clean":"2023-10-08T13:25:38.472826+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:25:38.472826+0000","last_undegraded":"2023-10-08T13:25:38.472826+0000","last_fullsized":"2023-10-08T13:25:38.472826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470536+0000","last_change":"2023-10-08T13:25:34.453499+0000","last_active":"2023-10-08T13:25:38.470536+0000","last_peered":"2023-10-08T13:25:38.470536+0000","last_clean":"2023-10-08T13:25:38.470536+0000","last_became_active":"2023-10-08T13:25:34.453126+0000","last_became_peered":"2023-10-08T13:25:34.453126+0000","last_unstale":"2023-10-08T13:25:38.470536+0000","last_undegraded":"2023-10-08T13:25:38.470536+0000","last_fullsized":"2023-10-08T13:25:38.470536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:02.482775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476592+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:25:38.476592+0000","last_peered":"2023-10-08T13:25:38.476592+0000","last_clean":"2023-10-08T13:25:38.476592+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:25:38.476592+0000","last_undegraded":"2023-10-08T13:25:38.476592+0000","last_fullsized":"2023-10-08T13:25:38.476592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476233+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:25:38.476233+0000","last_peered":"2023-10-08T13:25:38.476233+0000","last_clean":"2023-10-08T13:25:38.476233+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:25:38.476233+0000","last_undegraded":"2023-10-08T13:25:38.476233+0000","last_fullsized":"2023-10-08T13:25:38.476233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477583+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:25:38.477583+0000","last_peered":"2023-10-08T13:25:38.477583+0000","last_clean":"2023-10-08T13:25:38.477583+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:25:38.477583+0000","last_undegraded":"2023-10-08T13:25:38.477583+0000","last_fullsized":"2023-10-08T13:25:38.477583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481008+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:25:38.481008+0000","last_peered":"2023-10-08T13:25:38.481008+0000","last_clean":"2023-10-08T13:25:38.481008+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:25:38.481008+0000","last_undegraded":"2023-10-08T13:25:38.481008+0000","last_fullsized":"2023-10-08T13:25:38.481008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473470+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:25:38.473470+0000","last_peered":"2023-10-08T13:25:38.473470+0000","last_clean":"2023-10-08T13:25:38.473470+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:25:38.473470+0000","last_undegraded":"2023-10-08T13:25:38.473470+0000","last_fullsized":"2023-10-08T13:25:38.473470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472384+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:25:38.472384+0000","last_peered":"2023-10-08T13:25:38.472384+0000","last_clean":"2023-10-08T13:25:38.472384+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:25:38.472384+0000","last_undegraded":"2023-10-08T13:25:38.472384+0000","last_fullsized":"2023-10-08T13:25:38.472384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.471184+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:25:38.471184+0000","last_peered":"2023-10-08T13:25:38.471184+0000","last_clean":"2023-10-08T13:25:38.471184+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:25:38.471184+0000","last_undegraded":"2023-10-08T13:25:38.471184+0000","last_fullsized":"2023-10-08T13:25:38.471184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24161,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":75330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":480810,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.627},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64100000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.496},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68799999999999994}]},{"osd":10,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.71699999999999997}]}]},{"osd":10,"up_from":71,"seq":304942678037,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1075199,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.755},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.83099999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.77200000000000002}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":480436,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.317},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.438}]},{"osd":1,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.495},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.57399999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":8,"up_from":58,"seq":249108103197,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":479941,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.62,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65100000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.69999999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.313,"5min":0.311,"15min":0.311},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.319,"5min":4.319,"15min":4.319},"last":0.626}]},{"osd":7,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83199999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.88200000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":4.3339999999999996,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332129,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1070568,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.501},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.995,"15min":0.995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.33800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.435}]},{"osd":5,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.002,"5min":1.05,"15min":1.05},"last":0.80900000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495653,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":479730,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90700000000000003,"5min":1.085,"15min":1.085},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":1.131,"15min":1.131},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.46700000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88100000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92400000000000004,"5min":1.179,"15min":1.179},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90000000000000002,"5min":1.206,"15min":1.206},"last":0.52300000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.75900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85399999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.50900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":524013,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.73399999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.436},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36899999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.42299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.622},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.755,"15min":0.80300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.49199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56699999999999995,"15min":0.55100000000000005},"min":{"1min":0.41899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76000000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.78900000000000003}]},{"osd":9,"last update":"Sun Oct 8 13:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85999999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":481684,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.502},"min":{"1min":0.39200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.35499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 13:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.29199999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.42399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":0.996,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":45.225000000000001,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.7130000000000001,"5min":0.98499999999999999,"15min":0.68300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":45.244,"5min":45.244,"15min":45.244},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47999999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92700000000000005,"5min":3.403,"15min":3.403},"last":0.60199999999999998}]},{"osd":9,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.498}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65100000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70399999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":483494,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68600000000000005,"5min":0.872,"15min":0.872},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.442,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71899999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55500000000000005,"15min":0.53600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":5,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69299999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73099999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":479441,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.315},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.34499999999999997,"15min":0.32000000000000001},"min":{"1min":0.252,"5min":0.186,"15min":0.186},"max":{"1min":0.67100000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.433}]},{"osd":1,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.48399999999999999},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.50900000000000001},"min":{"1min":0.432,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.77100000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.33900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.28100000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70199999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.55800000000000005,"5min":0.44,"15min":0.44},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.67500000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.80400000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.88800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":4,"up_from":33,"seq":141733920814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":479640,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59199999999999997,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.434},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.86699999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.748}]},{"osd":6,"last update":"Sun Oct 8 13:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.50900000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70799999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72599999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1,"5min":1,"15min":1},"last":0.621}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757289,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1071462,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82399999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.627},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78300000000000003,"5min":1.032,"15min":1.032},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.751},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88800000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.754,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.84999999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":1.069,"15min":1.069},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80400000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.96499999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.878},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.91400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":40299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:26:05.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: from='client.15099 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: from='client.15105 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1209603653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: fsmap cephfs:5 7 up:standby 5 up:active 2023-10-08T13:26:05.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:04 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:26:05.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 -- 172.21.15.139:0/2147467632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100630 msgr2=0x7f6920100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 --2- 172.21.15.139:0/2147467632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100630 0x7f6920100ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6914009990 tx=0x7f6914009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 -- 172.21.15.139:0/2147467632 shutdown_connections 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 --2- 172.21.15.139:0/2147467632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100ff0 0x7f692010d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 --2- 172.21.15.139:0/2147467632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 0x7f6920106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 --2- 172.21.15.139:0/2147467632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100630 0x7f6920100ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 -- 172.21.15.139:0/2147467632 >> 172.21.15.139:0/2147467632 conn(0x7f69200fc1a0 msgr2=0x7f69200fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 -- 172.21.15.139:0/2147467632 shutdown_connections 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.235+0000 7f69266bc700 1 -- 172.21.15.139:0/2147467632 wait complete. 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 Processor -- start 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 -- start start 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100630 0x7f692019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 0x7f69201968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920196f20 con 0x7f6920100ff0 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920197090 con 0x7f6920100630 2023-10-08T13:26:05.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f69266bc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920197250 con 0x7f6920106640 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38700/0 (socket says 172.21.15.139:38700) 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 -- 172.21.15.139:0/4026106824 learned_addr learned my addr 172.21.15.139:0/4026106824 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f6924c59700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 0x7f69201968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691ffff700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100630 0x7f692019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 -- 172.21.15.139:0/4026106824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 msgr2=0x7f69201968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 0x7f69201968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 -- 172.21.15.139:0/4026106824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100630 msgr2=0x7f692019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100630 0x7f692019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.236+0000 7f691f7fe700 1 -- 172.21.15.139:0/4026106824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140095f0 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f691f7fe700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69140098e0 tx=0x7f691400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691401d070 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6914022470 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69201974d0 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914017650 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.237+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69201a3780 con 0x7f6920100ff0 2023-10-08T13:26:05.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.238+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920108c50 con 0x7f6920100ff0 2023-10-08T13:26:05.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.239+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 20) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f69140225e0 con 0x7f6920100ff0 2023-10-08T13:26:05.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.239+0000 7f691d7fa700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 0x7f69080a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:05.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.239+0000 7f691ffff700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 0x7f69080a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:05.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.240+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f69140ce390 con 0x7f6920100ff0 2023-10-08T13:26:05.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.240+0000 7f691ffff700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 0x7f69080a3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6910005950 tx=0x7f691000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:05.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.243+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69140977b0 con 0x7f6920100ff0 2023-10-08T13:26:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.425+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f6914097b80 con 0x7f6920100ff0 2023-10-08T13:26:05.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.436+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6920197df0 con 0x7f69080a14d0 2023-10-08T13:26:05.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.450+0000 7f691d7fa700 1 -- 172.21.15.139:0/4026106824 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+422930 (secure 0 0 0) 0x7f6920197df0 con 0x7f69080a14d0 2023-10-08T13:26:05.455 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:05.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 msgr2=0x7f69080a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 0x7f69080a3990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6910005950 tx=0x7f691000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 msgr2=0x7f692019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f69140098e0 tx=0x7f691400f670 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 shutdown_connections 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69080a14d0 0x7f69080a3990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6920106640 0x7f69201968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6920100630 0x7f692019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 --2- 172.21.15.139:0/4026106824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6920100ff0 0x7f692019ccd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 >> 172.21.15.139:0/4026106824 conn(0x7f69200fc1a0 msgr2=0x7f69200fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 shutdown_connections 2023-10-08T13:26:05.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:05.454+0000 7f69266bc700 1 -- 172.21.15.139:0/4026106824 wait complete. 2023-10-08T13:26:05.460 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:26:05.467 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2023-10-08T13:26:04.600201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614529,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":300,"num_write_kb":2998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335684,"kb_used_data":11476,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606140,"statfs":{"total":1151940427776,"available":1151596687360,"internally_reserved":0,"allocated":11751424,"data_stored":7586418,"data_compressed":282816,"data_compressed_allocated":380928,"data_compressed_original":2260992,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19662,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003914"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470938+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:25:38.470938+0000","last_peered":"2023-10-08T13:25:38.470938+0000","last_clean":"2023-10-08T13:25:38.470938+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:25:38.470938+0000","last_undegraded":"2023-10-08T13:25:38.470938+0000","last_fullsized":"2023-10-08T13:25:38.470938+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479555+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:25:38.479555+0000","last_peered":"2023-10-08T13:25:38.479555+0000","last_clean":"2023-10-08T13:25:38.479555+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:25:38.479555+0000","last_undegraded":"2023-10-08T13:25:38.479555+0000","last_fullsized":"2023-10-08T13:25:38.479555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476520+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:25:38.476520+0000","last_peered":"2023-10-08T13:25:38.476520+0000","last_clean":"2023-10-08T13:25:38.476520+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:25:38.476520+0000","last_undegraded":"2023-10-08T13:25:38.476520+0000","last_fullsized":"2023-10-08T13:25:38.476520+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479276+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:25:38.479276+0000","last_peered":"2023-10-08T13:25:38.479276+0000","last_clean":"2023-10-08T13:25:38.479276+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:25:38.479276+0000","last_undegraded":"2023-10-08T13:25:38.479276+0000","last_fullsized":"2023-10-08T13:25:38.479276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476566+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:25:38.476566+0000","last_peered":"2023-10-08T13:25:38.476566+0000","last_clean":"2023-10-08T13:25:38.476566+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:25:38.476566+0000","last_undegraded":"2023-10-08T13:25:38.476566+0000","last_fullsized":"2023-10-08T13:25:38.476566+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566454+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:25:38.566454+0000","last_peered":"2023-10-08T13:25:38.566454+0000","last_clean":"2023-10-08T13:25:38.566454+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:25:38.566454+0000","last_undegraded":"2023-10-08T13:25:38.566454+0000","last_fullsized":"2023-10-08T13:25:38.566454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479248+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:25:38.479248+0000","last_peered":"2023-10-08T13:25:38.479248+0000","last_clean":"2023-10-08T13:25:38.479248+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:25:38.479248+0000","last_undegraded":"2023-10-08T13:25:38.479248+0000","last_fullsized":"2023-10-08T13:25:38.479248+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479558+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:25:38.479558+0000","last_peered":"2023-10-08T13:25:38.479558+0000","last_clean":"2023-10-08T13:25:38.479558+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:25:38.479558+0000","last_undegraded":"2023-10-08T13:25:38.479558+0000","last_fullsized":"2023-10-08T13:25:38.479558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473711+0000","last_change":"2023-10-08T13:25:34.450050+0000","last_active":"2023-10-08T13:25:38.473711+0000","last_peered":"2023-10-08T13:25:38.473711+0000","last_clean":"2023-10-08T13:25:38.473711+0000","last_became_active":"2023-10-08T13:25:34.449689+0000","last_became_peered":"2023-10-08T13:25:34.449689+0000","last_unstale":"2023-10-08T13:25:38.473711+0000","last_undegraded":"2023-10-08T13:25:38.473711+0000","last_fullsized":"2023-10-08T13:25:38.473711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:14.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566793+0000","last_change":"2023-10-08T13:25:34.444970+0000","last_active":"2023-10-08T13:25:38.566793+0000","last_peered":"2023-10-08T13:25:38.566793+0000","last_clean":"2023-10-08T13:25:38.566793+0000","last_became_active":"2023-10-08T13:25:34.444058+0000","last_became_peered":"2023-10-08T13:25:34.444058+0000","last_unstale":"2023-10-08T13:25:38.566793+0000","last_undegraded":"2023-10-08T13:25:38.566793+0000","last_fullsized":"2023-10-08T13:25:38.566793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:16.743327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481563+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:25:38.481563+0000","last_peered":"2023-10-08T13:25:38.481563+0000","last_clean":"2023-10-08T13:25:38.481563+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:25:38.481563+0000","last_undegraded":"2023-10-08T13:25:38.481563+0000","last_fullsized":"2023-10-08T13:25:38.481563+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479180+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:25:38.479180+0000","last_peered":"2023-10-08T13:25:38.479180+0000","last_clean":"2023-10-08T13:25:38.479180+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:25:38.479180+0000","last_undegraded":"2023-10-08T13:25:38.479180+0000","last_fullsized":"2023-10-08T13:25:38.479180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472397+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:25:38.472397+0000","last_peered":"2023-10-08T13:25:38.472397+0000","last_clean":"2023-10-08T13:25:38.472397+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:25:38.472397+0000","last_undegraded":"2023-10-08T13:25:38.472397+0000","last_fullsized":"2023-10-08T13:25:38.472397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477320+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:25:38.477320+0000","last_peered":"2023-10-08T13:25:38.477320+0000","last_clean":"2023-10-08T13:25:38.477320+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:25:38.477320+0000","last_undegraded":"2023-10-08T13:25:38.477320+0000","last_fullsized":"2023-10-08T13:25:38.477320+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477222+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:25:38.477222+0000","last_peered":"2023-10-08T13:25:38.477222+0000","last_clean":"2023-10-08T13:25:38.477222+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:25:38.477222+0000","last_undegraded":"2023-10-08T13:25:38.477222+0000","last_fullsized":"2023-10-08T13:25:38.477222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472813+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:25:38.472813+0000","last_peered":"2023-10-08T13:25:38.472813+0000","last_clean":"2023-10-08T13:25:38.472813+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:25:38.472813+0000","last_undegraded":"2023-10-08T13:25:38.472813+0000","last_fullsized":"2023-10-08T13:25:38.472813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470663+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:25:38.470663+0000","last_peered":"2023-10-08T13:25:38.470663+0000","last_clean":"2023-10-08T13:25:38.470663+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:25:38.470663+0000","last_undegraded":"2023-10-08T13:25:38.470663+0000","last_fullsized":"2023-10-08T13:25:38.470663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476611+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:25:38.476611+0000","last_peered":"2023-10-08T13:25:38.476611+0000","last_clean":"2023-10-08T13:25:38.476611+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:25:38.476611+0000","last_undegraded":"2023-10-08T13:25:38.476611+0000","last_fullsized":"2023-10-08T13:25:38.476611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477373+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:25:38.477373+0000","last_peered":"2023-10-08T13:25:38.477373+0000","last_clean":"2023-10-08T13:25:38.477373+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:25:38.477373+0000","last_undegraded":"2023-10-08T13:25:38.477373+0000","last_fullsized":"2023-10-08T13:25:38.477373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722874+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:25:39.722874+0000","last_peered":"2023-10-08T13:25:39.722874+0000","last_clean":"2023-10-08T13:25:39.722874+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:25:39.722874+0000","last_undegraded":"2023-10-08T13:25:39.722874+0000","last_fullsized":"2023-10-08T13:25:39.722874+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.408179+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:26:01.408179+0000","last_peered":"2023-10-08T13:26:01.408179+0000","last_clean":"2023-10-08T13:26:01.408179+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:26:01.408179+0000","last_undegraded":"2023-10-08T13:26:01.408179+0000","last_fullsized":"2023-10-08T13:26:01.408179+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.482674+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:25:38.482674+0000","last_peered":"2023-10-08T13:25:38.482674+0000","last_clean":"2023-10-08T13:25:38.482674+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:25:38.482674+0000","last_undegraded":"2023-10-08T13:25:38.482674+0000","last_fullsized":"2023-10-08T13:25:38.482674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487311+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:25:39.487311+0000","last_peered":"2023-10-08T13:25:39.487311+0000","last_clean":"2023-10-08T13:25:39.487311+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:25:39.487311+0000","last_undegraded":"2023-10-08T13:25:39.487311+0000","last_fullsized":"2023-10-08T13:25:39.487311+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480810+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:25:38.480810+0000","last_peered":"2023-10-08T13:25:38.480810+0000","last_clean":"2023-10-08T13:25:38.480810+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:25:38.480810+0000","last_undegraded":"2023-10-08T13:25:38.480810+0000","last_fullsized":"2023-10-08T13:25:38.480810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477021+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:25:38.477021+0000","last_peered":"2023-10-08T13:25:38.477021+0000","last_clean":"2023-10-08T13:25:38.477021+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:25:38.477021+0000","last_undegraded":"2023-10-08T13:25:38.477021+0000","last_fullsized":"2023-10-08T13:25:38.477021+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487653+0000","last_change":"2023-10-08T13:25:38.488774+0000","last_active":"2023-10-08T13:25:39.487653+0000","last_peered":"2023-10-08T13:25:39.487653+0000","last_clean":"2023-10-08T13:25:39.487653+0000","last_became_active":"2023-10-08T13:25:38.488365+0000","last_became_peered":"2023-10-08T13:25:38.488365+0000","last_unstale":"2023-10-08T13:25:39.487653+0000","last_undegraded":"2023-10-08T13:25:39.487653+0000","last_fullsized":"2023-10-08T13:25:39.487653+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:20.298232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480235+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:25:38.480235+0000","last_peered":"2023-10-08T13:25:38.480235+0000","last_clean":"2023-10-08T13:25:38.480235+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:25:38.480235+0000","last_undegraded":"2023-10-08T13:25:38.480235+0000","last_fullsized":"2023-10-08T13:25:38.480235+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473360+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:25:38.473360+0000","last_peered":"2023-10-08T13:25:38.473360+0000","last_clean":"2023-10-08T13:25:38.473360+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:25:38.473360+0000","last_undegraded":"2023-10-08T13:25:38.473360+0000","last_fullsized":"2023-10-08T13:25:38.473360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487881+0000","last_change":"2023-10-08T13:25:38.487086+0000","last_active":"2023-10-08T13:25:39.487881+0000","last_peered":"2023-10-08T13:25:39.487881+0000","last_clean":"2023-10-08T13:25:39.487881+0000","last_became_active":"2023-10-08T13:25:38.486661+0000","last_became_peered":"2023-10-08T13:25:38.486661+0000","last_unstale":"2023-10-08T13:25:39.487881+0000","last_undegraded":"2023-10-08T13:25:39.487881+0000","last_fullsized":"2023-10-08T13:25:39.487881+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:04.031142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480155+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:25:38.480155+0000","last_peered":"2023-10-08T13:25:38.480155+0000","last_clean":"2023-10-08T13:25:38.480155+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:25:38.480155+0000","last_undegraded":"2023-10-08T13:25:38.480155+0000","last_fullsized":"2023-10-08T13:25:38.480155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477880+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:25:38.477880+0000","last_peered":"2023-10-08T13:25:38.477880+0000","last_clean":"2023-10-08T13:25:38.477880+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:25:38.477880+0000","last_undegraded":"2023-10-08T13:25:38.477880+0000","last_fullsized":"2023-10-08T13:25:38.477880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722601+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:25:39.722601+0000","last_peered":"2023-10-08T13:25:39.722601+0000","last_clean":"2023-10-08T13:25:39.722601+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:25:39.722601+0000","last_undegraded":"2023-10-08T13:25:39.722601+0000","last_fullsized":"2023-10-08T13:25:39.722601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387664+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:26:00.387664+0000","last_peered":"2023-10-08T13:26:00.387664+0000","last_clean":"2023-10-08T13:26:00.387664+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:26:00.387664+0000","last_undegraded":"2023-10-08T13:26:00.387664+0000","last_fullsized":"2023-10-08T13:26:00.387664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476454+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:25:38.476454+0000","last_peered":"2023-10-08T13:25:38.476454+0000","last_clean":"2023-10-08T13:25:38.476454+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:25:38.476454+0000","last_undegraded":"2023-10-08T13:25:38.476454+0000","last_fullsized":"2023-10-08T13:25:38.476454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722334+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:25:39.722334+0000","last_peered":"2023-10-08T13:25:39.722334+0000","last_clean":"2023-10-08T13:25:39.722334+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:25:39.722334+0000","last_undegraded":"2023-10-08T13:25:39.722334+0000","last_fullsized":"2023-10-08T13:25:39.722334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:02.411806+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:26:02.411806+0000","last_peered":"2023-10-08T13:26:02.411806+0000","last_clean":"2023-10-08T13:26:02.411806+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:26:02.411806+0000","last_undegraded":"2023-10-08T13:26:02.411806+0000","last_fullsized":"2023-10-08T13:26:02.411806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477615+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:25:38.477615+0000","last_peered":"2023-10-08T13:25:38.477615+0000","last_clean":"2023-10-08T13:25:38.477615+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:25:38.477615+0000","last_undegraded":"2023-10-08T13:25:38.477615+0000","last_fullsized":"2023-10-08T13:25:38.477615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487180+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:25:39.487180+0000","last_peered":"2023-10-08T13:25:39.487180+0000","last_clean":"2023-10-08T13:25:39.487180+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:25:39.487180+0000","last_undegraded":"2023-10-08T13:25:39.487180+0000","last_fullsized":"2023-10-08T13:25:39.487180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.407380+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:26:01.407380+0000","last_peered":"2023-10-08T13:26:01.407380+0000","last_clean":"2023-10-08T13:26:01.407380+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:26:01.407380+0000","last_undegraded":"2023-10-08T13:26:01.407380+0000","last_fullsized":"2023-10-08T13:26:01.407380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479484+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:25:38.479484+0000","last_peered":"2023-10-08T13:25:38.479484+0000","last_clean":"2023-10-08T13:25:38.479484+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:25:38.479484+0000","last_undegraded":"2023-10-08T13:25:38.479484+0000","last_fullsized":"2023-10-08T13:25:38.479484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.790793+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:25:39.790793+0000","last_peered":"2023-10-08T13:25:39.790793+0000","last_clean":"2023-10-08T13:25:39.790793+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:25:39.790793+0000","last_undegraded":"2023-10-08T13:25:39.790793+0000","last_fullsized":"2023-10-08T13:25:39.790793+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722114+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:25:39.722114+0000","last_peered":"2023-10-08T13:25:39.722114+0000","last_clean":"2023-10-08T13:25:39.722114+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:25:39.722114+0000","last_undegraded":"2023-10-08T13:25:39.722114+0000","last_fullsized":"2023-10-08T13:25:39.722114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476027+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:25:38.476027+0000","last_peered":"2023-10-08T13:25:38.476027+0000","last_clean":"2023-10-08T13:25:38.476027+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:25:38.476027+0000","last_undegraded":"2023-10-08T13:25:38.476027+0000","last_fullsized":"2023-10-08T13:25:38.476027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487081+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:25:39.487081+0000","last_peered":"2023-10-08T13:25:39.487081+0000","last_clean":"2023-10-08T13:25:39.487081+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:25:39.487081+0000","last_undegraded":"2023-10-08T13:25:39.487081+0000","last_fullsized":"2023-10-08T13:25:39.487081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387664+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:26:00.387664+0000","last_peered":"2023-10-08T13:26:00.387664+0000","last_clean":"2023-10-08T13:26:00.387664+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:26:00.387664+0000","last_undegraded":"2023-10-08T13:26:00.387664+0000","last_fullsized":"2023-10-08T13:26:00.387664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473757+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:25:38.473757+0000","last_peered":"2023-10-08T13:25:38.473757+0000","last_clean":"2023-10-08T13:25:38.473757+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:25:38.473757+0000","last_undegraded":"2023-10-08T13:25:38.473757+0000","last_fullsized":"2023-10-08T13:25:38.473757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721380+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:25:39.721380+0000","last_peered":"2023-10-08T13:25:39.721380+0000","last_clean":"2023-10-08T13:25:39.721380+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:25:39.721380+0000","last_undegraded":"2023-10-08T13:25:39.721380+0000","last_fullsized":"2023-10-08T13:25:39.721380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481002+0000","last_change":"2023-10-08T13:25:33.439513+0000","last_active":"2023-10-08T13:25:38.481002+0000","last_peered":"2023-10-08T13:25:38.481002+0000","last_clean":"2023-10-08T13:25:38.481002+0000","last_became_active":"2023-10-08T13:25:33.439118+0000","last_became_peered":"2023-10-08T13:25:33.439118+0000","last_unstale":"2023-10-08T13:25:38.481002+0000","last_undegraded":"2023-10-08T13:25:38.481002+0000","last_fullsized":"2023-10-08T13:25:38.481002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:05.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477070+0000","last_change":"2023-10-08T13:25:34.455215+0000","last_active":"2023-10-08T13:25:38.477070+0000","last_peered":"2023-10-08T13:25:38.477070+0000","last_clean":"2023-10-08T13:25:38.477070+0000","last_became_active":"2023-10-08T13:25:34.454659+0000","last_became_peered":"2023-10-08T13:25:34.454659+0000","last_unstale":"2023-10-08T13:25:38.477070+0000","last_undegraded":"2023-10-08T13:25:38.477070+0000","last_fullsized":"2023-10-08T13:25:38.477070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:30:13.504220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487908+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:25:39.487908+0000","last_peered":"2023-10-08T13:25:39.487908+0000","last_clean":"2023-10-08T13:25:39.487908+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:25:39.487908+0000","last_undegraded":"2023-10-08T13:25:39.487908+0000","last_fullsized":"2023-10-08T13:25:39.487908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722801+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:25:39.722801+0000","last_peered":"2023-10-08T13:25:39.722801+0000","last_clean":"2023-10-08T13:25:39.722801+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:25:39.722801+0000","last_undegraded":"2023-10-08T13:25:39.722801+0000","last_fullsized":"2023-10-08T13:25:39.722801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473709+0000","last_change":"2023-10-08T13:25:34.452739+0000","last_active":"2023-10-08T13:25:38.473709+0000","last_peered":"2023-10-08T13:25:38.473709+0000","last_clean":"2023-10-08T13:25:38.473709+0000","last_became_active":"2023-10-08T13:25:34.452398+0000","last_became_peered":"2023-10-08T13:25:34.452398+0000","last_unstale":"2023-10-08T13:25:38.473709+0000","last_undegraded":"2023-10-08T13:25:38.473709+0000","last_fullsized":"2023-10-08T13:25:38.473709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:38.169304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721395+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:25:39.721395+0000","last_peered":"2023-10-08T13:25:39.721395+0000","last_clean":"2023-10-08T13:25:39.721395+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:25:39.721395+0000","last_undegraded":"2023-10-08T13:25:39.721395+0000","last_fullsized":"2023-10-08T13:25:39.721395+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"87'18","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:02.817933+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:26:02.817933+0000","last_peered":"2023-10-08T13:26:02.817933+0000","last_clean":"2023-10-08T13:26:02.817933+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:26:02.817933+0000","last_undegraded":"2023-10-08T13:26:02.817933+0000","last_fullsized":"2023-10-08T13:26:02.817933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21223,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479993+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:25:38.479993+0000","last_peered":"2023-10-08T13:25:38.479993+0000","last_clean":"2023-10-08T13:25:38.479993+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:25:38.479993+0000","last_undegraded":"2023-10-08T13:25:38.479993+0000","last_fullsized":"2023-10-08T13:25:38.479993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.723086+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:25:39.723086+0000","last_peered":"2023-10-08T13:25:39.723086+0000","last_clean":"2023-10-08T13:25:39.723086+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:25:39.723086+0000","last_undegraded":"2023-10-08T13:25:39.723086+0000","last_fullsized":"2023-10-08T13:25:39.723086+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476164+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:25:38.476164+0000","last_peered":"2023-10-08T13:25:38.476164+0000","last_clean":"2023-10-08T13:25:38.476164+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:25:38.476164+0000","last_undegraded":"2023-10-08T13:25:38.476164+0000","last_fullsized":"2023-10-08T13:25:38.476164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472249+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:25:38.472249+0000","last_peered":"2023-10-08T13:25:38.472249+0000","last_clean":"2023-10-08T13:25:38.472249+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:25:38.472249+0000","last_undegraded":"2023-10-08T13:25:38.472249+0000","last_fullsized":"2023-10-08T13:25:38.472249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487218+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:25:39.487218+0000","last_peered":"2023-10-08T13:25:39.487218+0000","last_clean":"2023-10-08T13:25:39.487218+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:25:39.487218+0000","last_undegraded":"2023-10-08T13:25:39.487218+0000","last_fullsized":"2023-10-08T13:25:39.487218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387409+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:26:00.387409+0000","last_peered":"2023-10-08T13:26:00.387409+0000","last_clean":"2023-10-08T13:26:00.387409+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:26:00.387409+0000","last_undegraded":"2023-10-08T13:26:00.387409+0000","last_fullsized":"2023-10-08T13:26:00.387409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481420+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:25:38.481420+0000","last_peered":"2023-10-08T13:25:38.481420+0000","last_clean":"2023-10-08T13:25:38.481420+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:25:38.481420+0000","last_undegraded":"2023-10-08T13:25:38.481420+0000","last_fullsized":"2023-10-08T13:25:38.481420+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721680+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:25:39.721680+0000","last_peered":"2023-10-08T13:25:39.721680+0000","last_clean":"2023-10-08T13:25:39.721680+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:25:39.721680+0000","last_undegraded":"2023-10-08T13:25:39.721680+0000","last_fullsized":"2023-10-08T13:25:39.721680+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.406149+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:26:01.406149+0000","last_peered":"2023-10-08T13:26:01.406149+0000","last_clean":"2023-10-08T13:26:01.406149+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:26:01.406149+0000","last_undegraded":"2023-10-08T13:26:01.406149+0000","last_fullsized":"2023-10-08T13:26:01.406149+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479610+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:25:38.479610+0000","last_peered":"2023-10-08T13:25:38.479610+0000","last_clean":"2023-10-08T13:25:38.479610+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:25:38.479610+0000","last_undegraded":"2023-10-08T13:25:38.479610+0000","last_fullsized":"2023-10-08T13:25:38.479610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722218+0000","last_change":"2023-10-08T13:25:38.489818+0000","last_active":"2023-10-08T13:25:39.722218+0000","last_peered":"2023-10-08T13:25:39.722218+0000","last_clean":"2023-10-08T13:25:39.722218+0000","last_became_active":"2023-10-08T13:25:38.489325+0000","last_became_peered":"2023-10-08T13:25:38.489325+0000","last_unstale":"2023-10-08T13:25:39.722218+0000","last_undegraded":"2023-10-08T13:25:39.722218+0000","last_fullsized":"2023-10-08T13:25:39.722218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:53.184502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386185+0000","last_change":"2023-10-08T13:25:33.440499+0000","last_active":"2023-10-08T13:26:00.386185+0000","last_peered":"2023-10-08T13:26:00.386185+0000","last_clean":"2023-10-08T13:26:00.386185+0000","last_became_active":"2023-10-08T13:25:33.440191+0000","last_became_peered":"2023-10-08T13:25:33.440191+0000","last_unstale":"2023-10-08T13:26:00.386185+0000","last_undegraded":"2023-10-08T13:26:00.386185+0000","last_fullsized":"2023-10-08T13:26:00.386185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:47.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478796+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:25:38.478796+0000","last_peered":"2023-10-08T13:25:38.478796+0000","last_clean":"2023-10-08T13:25:38.478796+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:25:38.478796+0000","last_undegraded":"2023-10-08T13:25:38.478796+0000","last_fullsized":"2023-10-08T13:25:38.478796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722334+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:25:39.722334+0000","last_peered":"2023-10-08T13:25:39.722334+0000","last_clean":"2023-10-08T13:25:39.722334+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:25:39.722334+0000","last_undegraded":"2023-10-08T13:25:39.722334+0000","last_fullsized":"2023-10-08T13:25:39.722334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479932+0000","last_change":"2023-10-08T13:25:33.435437+0000","last_active":"2023-10-08T13:25:38.479932+0000","last_peered":"2023-10-08T13:25:38.479932+0000","last_clean":"2023-10-08T13:25:38.479932+0000","last_became_active":"2023-10-08T13:25:33.435097+0000","last_became_peered":"2023-10-08T13:25:33.435097+0000","last_unstale":"2023-10-08T13:25:38.479932+0000","last_undegraded":"2023-10-08T13:25:38.479932+0000","last_fullsized":"2023-10-08T13:25:38.479932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:15.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470495+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:25:38.470495+0000","last_peered":"2023-10-08T13:25:38.470495+0000","last_clean":"2023-10-08T13:25:38.470495+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:25:38.470495+0000","last_undegraded":"2023-10-08T13:25:38.470495+0000","last_fullsized":"2023-10-08T13:25:38.470495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722351+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:25:39.722351+0000","last_peered":"2023-10-08T13:25:39.722351+0000","last_clean":"2023-10-08T13:25:39.722351+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:25:39.722351+0000","last_undegraded":"2023-10-08T13:25:39.722351+0000","last_fullsized":"2023-10-08T13:25:39.722351+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.483908+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:25:38.483908+0000","last_peered":"2023-10-08T13:25:38.483908+0000","last_clean":"2023-10-08T13:25:38.483908+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:25:38.483908+0000","last_undegraded":"2023-10-08T13:25:38.483908+0000","last_fullsized":"2023-10-08T13:25:38.483908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566689+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:25:38.566689+0000","last_peered":"2023-10-08T13:25:38.566689+0000","last_clean":"2023-10-08T13:25:38.566689+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:25:38.566689+0000","last_undegraded":"2023-10-08T13:25:38.566689+0000","last_fullsized":"2023-10-08T13:25:38.566689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721710+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:25:39.721710+0000","last_peered":"2023-10-08T13:25:39.721710+0000","last_clean":"2023-10-08T13:25:39.721710+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:25:39.721710+0000","last_undegraded":"2023-10-08T13:25:39.721710+0000","last_fullsized":"2023-10-08T13:25:39.721710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480696+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:25:38.480696+0000","last_peered":"2023-10-08T13:25:38.480696+0000","last_clean":"2023-10-08T13:25:38.480696+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:25:38.480696+0000","last_undegraded":"2023-10-08T13:25:38.480696+0000","last_fullsized":"2023-10-08T13:25:38.480696+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.566516+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:25:38.566516+0000","last_peered":"2023-10-08T13:25:38.566516+0000","last_clean":"2023-10-08T13:25:38.566516+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:25:38.566516+0000","last_undegraded":"2023-10-08T13:25:38.566516+0000","last_fullsized":"2023-10-08T13:25:38.566516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721844+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:25:39.721844+0000","last_peered":"2023-10-08T13:25:39.721844+0000","last_clean":"2023-10-08T13:25:39.721844+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:25:39.721844+0000","last_undegraded":"2023-10-08T13:25:39.721844+0000","last_fullsized":"2023-10-08T13:25:39.721844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477674+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:25:38.477674+0000","last_peered":"2023-10-08T13:25:38.477674+0000","last_clean":"2023-10-08T13:25:38.477674+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:25:38.477674+0000","last_undegraded":"2023-10-08T13:25:38.477674+0000","last_fullsized":"2023-10-08T13:25:38.477674+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.408260+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:26:01.408260+0000","last_peered":"2023-10-08T13:26:01.408260+0000","last_clean":"2023-10-08T13:26:01.408260+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:26:01.408260+0000","last_undegraded":"2023-10-08T13:26:01.408260+0000","last_fullsized":"2023-10-08T13:26:01.408260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722309+0000","last_change":"2023-10-08T13:25:38.493979+0000","last_active":"2023-10-08T13:25:39.722309+0000","last_peered":"2023-10-08T13:25:39.722309+0000","last_clean":"2023-10-08T13:25:39.722309+0000","last_became_active":"2023-10-08T13:25:38.493473+0000","last_became_peered":"2023-10-08T13:25:38.493473+0000","last_unstale":"2023-10-08T13:25:39.722309+0000","last_undegraded":"2023-10-08T13:25:39.722309+0000","last_fullsized":"2023-10-08T13:25:39.722309+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:35:44.380527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476488+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:25:38.476488+0000","last_peered":"2023-10-08T13:25:38.476488+0000","last_clean":"2023-10-08T13:25:38.476488+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:25:38.476488+0000","last_undegraded":"2023-10-08T13:25:38.476488+0000","last_fullsized":"2023-10-08T13:25:38.476488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.388162+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:26:00.388162+0000","last_peered":"2023-10-08T13:26:00.388162+0000","last_clean":"2023-10-08T13:26:00.388162+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:26:00.388162+0000","last_undegraded":"2023-10-08T13:26:00.388162+0000","last_fullsized":"2023-10-08T13:26:00.388162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479419+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:25:38.479419+0000","last_peered":"2023-10-08T13:25:38.479419+0000","last_clean":"2023-10-08T13:25:38.479419+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:25:38.479419+0000","last_undegraded":"2023-10-08T13:25:38.479419+0000","last_fullsized":"2023-10-08T13:25:38.479419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722323+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:25:39.722323+0000","last_peered":"2023-10-08T13:25:39.722323+0000","last_clean":"2023-10-08T13:25:39.722323+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:25:39.722323+0000","last_undegraded":"2023-10-08T13:25:39.722323+0000","last_fullsized":"2023-10-08T13:25:39.722323+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472169+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:25:38.472169+0000","last_peered":"2023-10-08T13:25:38.472169+0000","last_clean":"2023-10-08T13:25:38.472169+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:25:38.472169+0000","last_undegraded":"2023-10-08T13:25:38.472169+0000","last_fullsized":"2023-10-08T13:25:38.472169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479608+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:25:38.479608+0000","last_peered":"2023-10-08T13:25:38.479608+0000","last_clean":"2023-10-08T13:25:38.479608+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:25:38.479608+0000","last_undegraded":"2023-10-08T13:25:38.479608+0000","last_fullsized":"2023-10-08T13:25:38.479608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487042+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:25:39.487042+0000","last_peered":"2023-10-08T13:25:39.487042+0000","last_clean":"2023-10-08T13:25:39.487042+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:25:39.487042+0000","last_undegraded":"2023-10-08T13:25:39.487042+0000","last_fullsized":"2023-10-08T13:25:39.487042+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721952+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:25:39.721952+0000","last_peered":"2023-10-08T13:25:39.721952+0000","last_clean":"2023-10-08T13:25:39.721952+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:25:39.721952+0000","last_undegraded":"2023-10-08T13:25:39.721952+0000","last_fullsized":"2023-10-08T13:25:39.721952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472776+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:25:38.472776+0000","last_peered":"2023-10-08T13:25:38.472776+0000","last_clean":"2023-10-08T13:25:38.472776+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:25:38.472776+0000","last_undegraded":"2023-10-08T13:25:38.472776+0000","last_fullsized":"2023-10-08T13:25:38.472776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.486931+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:25:39.486931+0000","last_peered":"2023-10-08T13:25:39.486931+0000","last_clean":"2023-10-08T13:25:39.486931+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:25:39.486931+0000","last_undegraded":"2023-10-08T13:25:39.486931+0000","last_fullsized":"2023-10-08T13:25:39.486931+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'3","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:01.406320+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:26:01.406320+0000","last_peered":"2023-10-08T13:26:01.406320+0000","last_clean":"2023-10-08T13:26:01.406320+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:26:01.406320+0000","last_undegraded":"2023-10-08T13:26:01.406320+0000","last_fullsized":"2023-10-08T13:26:01.406320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476129+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:25:38.476129+0000","last_peered":"2023-10-08T13:25:38.476129+0000","last_clean":"2023-10-08T13:25:38.476129+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:25:38.476129+0000","last_undegraded":"2023-10-08T13:25:38.476129+0000","last_fullsized":"2023-10-08T13:25:38.476129+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.722605+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:25:39.722605+0000","last_peered":"2023-10-08T13:25:39.722605+0000","last_clean":"2023-10-08T13:25:39.722605+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:25:39.722605+0000","last_undegraded":"2023-10-08T13:25:39.722605+0000","last_fullsized":"2023-10-08T13:25:39.722605+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386024+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:26:00.386024+0000","last_peered":"2023-10-08T13:26:00.386024+0000","last_clean":"2023-10-08T13:26:00.386024+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:26:00.386024+0000","last_undegraded":"2023-10-08T13:26:00.386024+0000","last_fullsized":"2023-10-08T13:26:00.386024+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.479643+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:25:38.479643+0000","last_peered":"2023-10-08T13:25:38.479643+0000","last_clean":"2023-10-08T13:25:38.479643+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:25:38.479643+0000","last_undegraded":"2023-10-08T13:25:38.479643+0000","last_fullsized":"2023-10-08T13:25:38.479643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487794+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:25:39.487794+0000","last_peered":"2023-10-08T13:25:39.487794+0000","last_clean":"2023-10-08T13:25:39.487794+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:25:39.487794+0000","last_undegraded":"2023-10-08T13:25:39.487794+0000","last_fullsized":"2023-10-08T13:25:39.487794+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.386199+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:26:00.386199+0000","last_peered":"2023-10-08T13:26:00.386199+0000","last_clean":"2023-10-08T13:26:00.386199+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:26:00.386199+0000","last_undegraded":"2023-10-08T13:26:00.386199+0000","last_fullsized":"2023-10-08T13:26:00.386199+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476384+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:25:38.476384+0000","last_peered":"2023-10-08T13:25:38.476384+0000","last_clean":"2023-10-08T13:25:38.476384+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:25:38.476384+0000","last_undegraded":"2023-10-08T13:25:38.476384+0000","last_fullsized":"2023-10-08T13:25:38.476384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721903+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:25:39.721903+0000","last_peered":"2023-10-08T13:25:39.721903+0000","last_clean":"2023-10-08T13:25:39.721903+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:25:39.721903+0000","last_undegraded":"2023-10-08T13:25:39.721903+0000","last_fullsized":"2023-10-08T13:25:39.721903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480786+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:25:38.480786+0000","last_peered":"2023-10-08T13:25:38.480786+0000","last_clean":"2023-10-08T13:25:38.480786+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:25:38.480786+0000","last_undegraded":"2023-10-08T13:25:38.480786+0000","last_fullsized":"2023-10-08T13:25:38.480786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470348+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:25:38.470348+0000","last_peered":"2023-10-08T13:25:38.470348+0000","last_clean":"2023-10-08T13:25:38.470348+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:25:38.470348+0000","last_undegraded":"2023-10-08T13:25:38.470348+0000","last_fullsized":"2023-10-08T13:25:38.470348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487658+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:25:39.487658+0000","last_peered":"2023-10-08T13:25:39.487658+0000","last_clean":"2023-10-08T13:25:39.487658+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:25:39.487658+0000","last_undegraded":"2023-10-08T13:25:39.487658+0000","last_fullsized":"2023-10-08T13:25:39.487658+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478352+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:25:38.478352+0000","last_peered":"2023-10-08T13:25:38.478352+0000","last_clean":"2023-10-08T13:25:38.478352+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:25:38.478352+0000","last_undegraded":"2023-10-08T13:25:38.478352+0000","last_fullsized":"2023-10-08T13:25:38.478352+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476377+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:25:38.476377+0000","last_peered":"2023-10-08T13:25:38.476377+0000","last_clean":"2023-10-08T13:25:38.476377+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:25:38.476377+0000","last_undegraded":"2023-10-08T13:25:38.476377+0000","last_fullsized":"2023-10-08T13:25:38.476377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.487691+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:25:39.487691+0000","last_peered":"2023-10-08T13:25:39.487691+0000","last_clean":"2023-10-08T13:25:39.487691+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:25:39.487691+0000","last_undegraded":"2023-10-08T13:25:39.487691+0000","last_fullsized":"2023-10-08T13:25:39.487691+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:00.387832+0000","last_change":"2023-10-08T13:25:33.439503+0000","last_active":"2023-10-08T13:26:00.387832+0000","last_peered":"2023-10-08T13:26:00.387832+0000","last_clean":"2023-10-08T13:26:00.387832+0000","last_became_active":"2023-10-08T13:25:33.439197+0000","last_became_peered":"2023-10-08T13:25:33.439197+0000","last_unstale":"2023-10-08T13:26:00.387832+0000","last_undegraded":"2023-10-08T13:26:00.387832+0000","last_fullsized":"2023-10-08T13:26:00.387832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:19.983872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480788+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:25:38.480788+0000","last_peered":"2023-10-08T13:25:38.480788+0000","last_clean":"2023-10-08T13:25:38.480788+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:25:38.480788+0000","last_undegraded":"2023-10-08T13:25:38.480788+0000","last_fullsized":"2023-10-08T13:25:38.480788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721378+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:25:39.721378+0000","last_peered":"2023-10-08T13:25:39.721378+0000","last_clean":"2023-10-08T13:25:39.721378+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:25:39.721378+0000","last_undegraded":"2023-10-08T13:25:39.721378+0000","last_fullsized":"2023-10-08T13:25:39.721378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.480237+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:25:38.480237+0000","last_peered":"2023-10-08T13:25:38.480237+0000","last_clean":"2023-10-08T13:25:38.480237+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:25:38.480237+0000","last_undegraded":"2023-10-08T13:25:38.480237+0000","last_fullsized":"2023-10-08T13:25:38.480237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481647+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:25:38.481647+0000","last_peered":"2023-10-08T13:25:38.481647+0000","last_clean":"2023-10-08T13:25:38.481647+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:25:38.481647+0000","last_undegraded":"2023-10-08T13:25:38.481647+0000","last_fullsized":"2023-10-08T13:25:38.481647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.790670+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:25:39.790670+0000","last_peered":"2023-10-08T13:25:39.790670+0000","last_clean":"2023-10-08T13:25:39.790670+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:25:39.790670+0000","last_undegraded":"2023-10-08T13:25:39.790670+0000","last_fullsized":"2023-10-08T13:25:39.790670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477958+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:25:38.477958+0000","last_peered":"2023-10-08T13:25:38.477958+0000","last_clean":"2023-10-08T13:25:38.477958+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:25:38.477958+0000","last_undegraded":"2023-10-08T13:25:38.477958+0000","last_fullsized":"2023-10-08T13:25:38.477958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481578+0000","last_change":"2023-10-08T13:25:34.445670+0000","last_active":"2023-10-08T13:25:38.481578+0000","last_peered":"2023-10-08T13:25:38.481578+0000","last_clean":"2023-10-08T13:25:38.481578+0000","last_became_active":"2023-10-08T13:25:34.443048+0000","last_became_peered":"2023-10-08T13:25:34.443048+0000","last_unstale":"2023-10-08T13:25:38.481578+0000","last_undegraded":"2023-10-08T13:25:38.481578+0000","last_fullsized":"2023-10-08T13:25:38.481578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:25:58.440282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:25:39.721940+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:25:39.721940+0000","last_peered":"2023-10-08T13:25:39.721940+0000","last_clean":"2023-10-08T13:25:39.721940+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:25:39.721940+0000","last_undegraded":"2023-10-08T13:25:39.721940+0000","last_fullsized":"2023-10-08T13:25:39.721940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T13:26:03.415267+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:26:03.415267+0000","last_peered":"2023-10-08T13:26:03.415267+0000","last_clean":"2023-10-08T13:26:03.415267+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:26:03.415267+0000","last_undegraded":"2023-10-08T13:26:03.415267+0000","last_fullsized":"2023-10-08T13:26:03.415267+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481069+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:25:38.481069+0000","last_peered":"2023-10-08T13:25:38.481069+0000","last_clean":"2023-10-08T13:25:38.481069+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:25:38.481069+0000","last_undegraded":"2023-10-08T13:25:38.481069+0000","last_fullsized":"2023-10-08T13:25:38.481069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470374+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:25:38.470374+0000","last_peered":"2023-10-08T13:25:38.470374+0000","last_clean":"2023-10-08T13:25:38.470374+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:25:38.470374+0000","last_undegraded":"2023-10-08T13:25:38.470374+0000","last_fullsized":"2023-10-08T13:25:38.470374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481050+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:25:38.481050+0000","last_peered":"2023-10-08T13:25:38.481050+0000","last_clean":"2023-10-08T13:25:38.481050+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:25:38.481050+0000","last_undegraded":"2023-10-08T13:25:38.481050+0000","last_fullsized":"2023-10-08T13:25:38.481050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478246+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:25:38.478246+0000","last_peered":"2023-10-08T13:25:38.478246+0000","last_clean":"2023-10-08T13:25:38.478246+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:25:38.478246+0000","last_undegraded":"2023-10-08T13:25:38.478246+0000","last_fullsized":"2023-10-08T13:25:38.478246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.478958+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:25:38.478958+0000","last_peered":"2023-10-08T13:25:38.478958+0000","last_clean":"2023-10-08T13:25:38.478958+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:25:38.478958+0000","last_undegraded":"2023-10-08T13:25:38.478958+0000","last_fullsized":"2023-10-08T13:25:38.478958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472826+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:25:38.472826+0000","last_peered":"2023-10-08T13:25:38.472826+0000","last_clean":"2023-10-08T13:25:38.472826+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:25:38.472826+0000","last_undegraded":"2023-10-08T13:25:38.472826+0000","last_fullsized":"2023-10-08T13:25:38.472826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.470536+0000","last_change":"2023-10-08T13:25:34.453499+0000","last_active":"2023-10-08T13:25:38.470536+0000","last_peered":"2023-10-08T13:25:38.470536+0000","last_clean":"2023-10-08T13:25:38.470536+0000","last_became_active":"2023-10-08T13:25:34.453126+0000","last_became_peered":"2023-10-08T13:25:34.453126+0000","last_unstale":"2023-10-08T13:25:38.470536+0000","last_undegraded":"2023-10-08T13:25:38.470536+0000","last_fullsized":"2023-10-08T13:25:38.470536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:53:02.482775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476592+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:25:38.476592+0000","last_peered":"2023-10-08T13:25:38.476592+0000","last_clean":"2023-10-08T13:25:38.476592+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:25:38.476592+0000","last_undegraded":"2023-10-08T13:25:38.476592+0000","last_fullsized":"2023-10-08T13:25:38.476592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.476233+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:25:38.476233+0000","last_peered":"2023-10-08T13:25:38.476233+0000","last_clean":"2023-10-08T13:25:38.476233+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:25:38.476233+0000","last_undegraded":"2023-10-08T13:25:38.476233+0000","last_fullsized":"2023-10-08T13:25:38.476233+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.477583+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:25:38.477583+0000","last_peered":"2023-10-08T13:25:38.477583+0000","last_clean":"2023-10-08T13:25:38.477583+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:25:38.477583+0000","last_undegraded":"2023-10-08T13:25:38.477583+0000","last_fullsized":"2023-10-08T13:25:38.477583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.481008+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:25:38.481008+0000","last_peered":"2023-10-08T13:25:38.481008+0000","last_clean":"2023-10-08T13:25:38.481008+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:25:38.481008+0000","last_undegraded":"2023-10-08T13:25:38.481008+0000","last_fullsized":"2023-10-08T13:25:38.481008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.473470+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:25:38.473470+0000","last_peered":"2023-10-08T13:25:38.473470+0000","last_clean":"2023-10-08T13:25:38.473470+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:25:38.473470+0000","last_undegraded":"2023-10-08T13:25:38.473470+0000","last_fullsized":"2023-10-08T13:25:38.473470+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.472384+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:25:38.472384+0000","last_peered":"2023-10-08T13:25:38.472384+0000","last_clean":"2023-10-08T13:25:38.472384+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:25:38.472384+0000","last_undegraded":"2023-10-08T13:25:38.472384+0000","last_fullsized":"2023-10-08T13:25:38.472384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T13:25:38.471184+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:25:38.471184+0000","last_peered":"2023-10-08T13:25:38.471184+0000","last_clean":"2023-10-08T13:25:38.471184+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:25:38.471184+0000","last_undegraded":"2023-10-08T13:25:38.471184+0000","last_fullsized":"2023-10-08T13:25:38.471184+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24161,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":75330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":480810,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.627},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64100000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.496},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.68799999999999994}]},{"osd":10,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.71699999999999997}]}]},{"osd":10,"up_from":71,"seq":304942678037,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1075199,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.755},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.83099999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.77200000000000002}]}]},{"osd":9,"up_from":66,"seq":283467841561,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":480436,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.317},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.438}]},{"osd":1,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":4.4619999999999997,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.495},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":0.57399999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.68000000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.56200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":8,"up_from":58,"seq":249108103197,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":479941,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.62,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65100000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.69999999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.313,"5min":0.311,"15min":0.311},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.319,"5min":4.319,"15min":4.319},"last":0.626}]},{"osd":7,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83199999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:25:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.88200000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:25:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":4.3049999999999997,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":4.3339999999999996,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.92900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332129,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1070568,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46800000000000003,"15min":0.46300000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.501},{"interface":"front","average":{"1min":0.443,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.79100000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63100000000000001,"15min":0.64200000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74099999999999999,"5min":0.995,"15min":0.995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89700000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.33800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.435}]},{"osd":5,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.67600000000000005,"15min":0.68300000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.002,"5min":1.05,"15min":1.05},"last":0.80900000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.68899999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.77900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":6,"up_from":46,"seq":197568495653,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":479730,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.40300000000000002,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.40999999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.33800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.42099999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90700000000000003,"5min":1.085,"15min":1.085},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.75600000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82399999999999995,"5min":1.131,"15min":1.131},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.46700000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88100000000000001,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.46400000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92400000000000004,"5min":1.179,"15min":1.179},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63900000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90000000000000002,"5min":1.206,"15min":1.206},"last":0.52300000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.75900000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85399999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.50900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":524013,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.502},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.73399999999999999,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.436},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.34899999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36899999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.42299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.622},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:25:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84999999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93500000000000005,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.5}]},{"osd":5,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.755,"15min":0.80300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60599999999999998,"15min":0.59899999999999998},"min":{"1min":0.49199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.60999999999999999,"15min":0.60699999999999998},"min":{"1min":0.495,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82699999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56699999999999995,"15min":0.55100000000000005},"min":{"1min":0.41899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.45700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76000000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.78900000000000003}]},{"osd":9,"last update":"Sun Oct 8 13:25:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.85999999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":481684,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.51300000000000001,"15min":0.502},"min":{"1min":0.39200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.35499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.627}]},{"osd":3,"last update":"Sun Oct 8 13:24:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38200000000000001},"min":{"1min":0.29199999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.436},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56100000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.51300000000000001},"min":{"1min":0.42399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.437,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":0.996,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":45.225000000000001,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.7130000000000001,"5min":0.98499999999999999,"15min":0.68300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":45.244,"5min":45.244,"15min":45.244},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.501,"15min":0.48599999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.32900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39100000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47999999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92700000000000005,"5min":3.403,"15min":3.403},"last":0.60199999999999998}]},{"osd":9,"last update":"Sun Oct 8 13:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.498}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65100000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70399999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378677,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":483494,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68600000000000005,"5min":0.872,"15min":0.872},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.442,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85399999999999998,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.41299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71899999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44}]},{"osd":4,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.55500000000000005,"15min":0.53600000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85299999999999998,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.70999999999999996}]},{"osd":5,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69299999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.62}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.749},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73099999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":950272,"data_stored":479441,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.315},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.34499999999999997,"15min":0.32000000000000001},"min":{"1min":0.252,"5min":0.186,"15min":0.186},"max":{"1min":0.67100000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.433}]},{"osd":1,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.51900000000000002,"15min":0.49399999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.48399999999999999},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.53800000000000003,"15min":0.50900000000000001},"min":{"1min":0.432,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.77100000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.44900000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.59699999999999998,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.33900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.28100000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.70199999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.55800000000000005,"5min":0.44,"15min":0.44},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.67500000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.80400000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:25:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":0.88800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":4,"up_from":33,"seq":141733920814,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":479640,"data_compressed":14664,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39300000000000002},"min":{"1min":0.29399999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59199999999999997,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.79600000000000004,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.434},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.58299999999999996,"15min":0.54200000000000004},"min":{"1min":0.35299999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.86699999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85399999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.748}]},{"osd":6,"last update":"Sun Oct 8 13:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.50900000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70799999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.72599999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:25:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1,"5min":1,"15min":1},"last":0.621}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.64800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":5,"up_from":38,"seq":163208757289,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1071462,"data_compressed":50280,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.82399999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.627},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78300000000000003,"5min":1.032,"15min":1.032},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.40300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83899999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.751},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65200000000000002,"15min":0.65100000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64400000000000002,"15min":0.64600000000000002},"min":{"1min":0.441,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88800000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.754,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.84999999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":1.069,"15min":1.069},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.80400000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.96499999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.878},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.91400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":40299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:26:05.476 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T13:26:05.476 INFO:tasks.cephadm:Setting up client nodes... 2023-10-08T13:26:05.477 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-08T13:26:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:05 smithi139 ceph-mon[99506]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:05 smithi139 ceph-mon[99506]: pgmap v253: 129 pgs: 129 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2023-10-08T13:26:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:05 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/151628837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:05.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:05 smithi139 ceph-mon[99506]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:26:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:05 smithi187 ceph-mon[104336]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:05 smithi187 ceph-mon[104336]: pgmap v253: 129 pgs: 129 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2023-10-08T13:26:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:05 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/151628837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:05 smithi187 ceph-mon[104336]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:26:06.066 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:05 smithi155 ceph-mon[103467]: from='client.15111 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:05 smithi155 ceph-mon[103467]: pgmap v253: 129 pgs: 129 active+clean; 600 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s wr, 5 op/s 2023-10-08T13:26:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:05 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/151628837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:05 smithi155 ceph-mon[103467]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T13:26:06.799 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:06 smithi139 ceph-mon[99506]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:06.799 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:06 smithi139 ceph-mon[99506]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:06 smithi187 ceph-mon[104336]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:06 smithi187 ceph-mon[104336]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:07.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:06 smithi155 ceph-mon[103467]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:07.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:06 smithi155 ceph-mon[103467]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.256+0000 7f633c942700 1 -- 172.21.15.139:0/3165182773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6338104540 msgr2=0x7f6338104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.256+0000 7f633c942700 1 --2- 172.21.15.139:0/3165182773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6338104540 0x7f6338104920 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f633000b0d0 tx=0x7f633000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 -- 172.21.15.139:0/3165182773 shutdown_connections 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 --2- 172.21.15.139:0/3165182773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63381000e0 0x7f633810c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 --2- 172.21.15.139:0/3165182773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6338104540 0x7f6338104920 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 --2- 172.21.15.139:0/3165182773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63380ff720 0x7f63380ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 -- 172.21.15.139:0/3165182773 >> 172.21.15.139:0/3165182773 conn(0x7f6338075710 msgr2=0x7f6338075b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:07.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 -- 172.21.15.139:0/3165182773 shutdown_connections 2023-10-08T13:26:07.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 -- 172.21.15.139:0/3165182773 wait complete. 2023-10-08T13:26:07.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 Processor -- start 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.257+0000 7f633c942700 1 -- start start 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63381000e0 0x7f6338195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 0x7f6338196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381a5120 con 0x7f63380ff720 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381a5290 con 0x7f6338104540 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633c942700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63381a5450 con 0x7f63381000e0 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38712/0 (socket says 172.21.15.139:38712) 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 -- 172.21.15.139:0/3719479802 learned_addr learned my addr 172.21.15.139:0/3719479802 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:07.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f6335d9b700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63381000e0 0x7f6338195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f6336d9d700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 0x7f6338196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 -- 172.21.15.139:0/3719479802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63381000e0 msgr2=0x7f6338195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63381000e0 0x7f6338195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 -- 172.21.15.139:0/3719479802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 msgr2=0x7f6338196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 0x7f6338196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 -- 172.21.15.139:0/3719479802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009d00 con 0x7f63380ff720 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f6336d9d700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 0x7f6338196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f633659c700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f633000bd80 tx=0x7f633000bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.258+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000e040 con 0x7f63380ff720 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.259+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f633001b8e0 con 0x7f63380ff720 2023-10-08T13:26:07.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.259+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63381a56d0 con 0x7f63380ff720 2023-10-08T13:26:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.259+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330012830 con 0x7f63380ff720 2023-10-08T13:26:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.259+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63381a5b40 con 0x7f63380ff720 2023-10-08T13:26:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.259+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338107be0 con 0x7f63380ff720 2023-10-08T13:26:07.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.261+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f633001ba50 con 0x7f63380ff720 2023-10-08T13:26:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.261+0000 7f63277fe700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 0x7f63200a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.262+0000 7f6335d9b700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 0x7f63200a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.262+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8945+0+0 (secure 0 0 0) 0x7f63300cea30 con 0x7f63380ff720 2023-10-08T13:26:07.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.262+0000 7f6335d9b700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 0x7f63200a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6338197b00 tx=0x7f632c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:07.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.265+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6330097cf0 con 0x7f63380ff720 2023-10-08T13:26:07.532 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.531+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6338100db0 con 0x7f63380ff720 2023-10-08T13:26:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.534+0000 7f63277fe700 1 -- 172.21.15.139:0/3719479802 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f633009b310 con 0x7f63380ff720 2023-10-08T13:26:07.535 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2023-10-08T13:26:07.535 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDvrSJlSlzKHxAAzuddLBBeITUfFIIamhD6Yw== 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 msgr2=0x7f63200a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 0x7f63200a3a20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6338197b00 tx=0x7f632c009260 comp rx=0 tx=0).stop 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 msgr2=0x7f63381959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f633000bd80 tx=0x7f633000bdb0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 shutdown_connections 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f63200a1560 0x7f63200a3a20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6338104540 0x7f6338196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63380ff720 0x7f63381959a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 --2- 172.21.15.139:0/3719479802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63381000e0 0x7f6338195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 >> 172.21.15.139:0/3719479802 conn(0x7f6338075710 msgr2=0x7f63380fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 shutdown_connections 2023-10-08T13:26:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:07.536+0000 7f633c942700 1 -- 172.21.15.139:0/3719479802 wait complete. 2023-10-08T13:26:07.860 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:07 smithi139 ceph-mon[99506]: pgmap v254: 129 pgs: 129 active+clean; 604 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-08T13:26:07.860 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:07 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:26:07.860 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:07 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:26:07.917 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:26:07.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-08T13:26:07.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T13:26:07.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-08T13:26:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:07 smithi187 ceph-mon[104336]: pgmap v254: 129 pgs: 129 active+clean; 604 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-08T13:26:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:07 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:26:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:07 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:26:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:07 smithi155 ceph-mon[103467]: pgmap v254: 129 pgs: 129 active+clean; 604 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2023-10-08T13:26:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:07 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T13:26:08.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:07 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3719479802' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T13:26:08.554 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-08T13:26:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:26:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-10-08T13:26:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-08T13:26:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-08T13:26:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2023-10-08T13:26:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2023-10-08T13:26:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2023-10-08T13:26:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2023-10-08T13:26:08.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-08T13:26:09.079 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2023-10-08T13:26:09.080 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2023-10-08T13:26:09.080 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2023-10-08T13:26:09.080 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2023-10-08T13:26:09.080 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-10-08T13:26:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-10-08T13:26:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2023-10-08T13:26:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-10-08T13:26:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2023-10-08T13:26:09.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2023-10-08T13:26:09.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 -- 172.21.15.139:0/1415608844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94341056b0 msgr2=0x7f9434105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:09.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 --2- 172.21.15.139:0/1415608844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94341056b0 0x7f9434105a90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9428009990 tx=0x7f9428009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 -- 172.21.15.139:0/1415608844 shutdown_connections 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 --2- 172.21.15.139:0/1415608844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 0x7f943410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 --2- 172.21.15.139:0/1415608844 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94341056b0 0x7f9434105a90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 --2- 172.21.15.139:0/1415608844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94340ff750 0x7f94340ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 -- 172.21.15.139:0/1415608844 >> 172.21.15.139:0/1415608844 conn(0x7f9434075790 msgr2=0x7f9434075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 -- 172.21.15.139:0/1415608844 shutdown_connections 2023-10-08T13:26:09.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.784+0000 7f943a301700 1 -- 172.21.15.139:0/1415608844 wait complete. 2023-10-08T13:26:09.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 Processor -- start 2023-10-08T13:26:09.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 -- start start 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 0x7f9434197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94341056b0 0x7f94341a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9434198810 con 0x7f94340ff750 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341a2fd0 con 0x7f9434100110 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943a301700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94341a3110 con 0x7f94341056b0 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f9433fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f9433fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38726/0 (socket says 172.21.15.139:38726) 2023-10-08T13:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f9433fff700 1 -- 172.21.15.139:0/2446255747 learned_addr learned my addr 172.21.15.139:0/2446255747 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f943889e700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94341056b0 0x7f94341a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.785+0000 7f94337fe700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 0x7f9434197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 -- 172.21.15.139:0/2446255747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94341056b0 msgr2=0x7f94341a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94341056b0 0x7f94341a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 -- 172.21.15.139:0/2446255747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 msgr2=0x7f9434197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 0x7f9434197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 -- 172.21.15.139:0/2446255747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280095f0 con 0x7f94340ff750 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f9433fff700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94280098e0 tx=0x7f942800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942801d070 con 0x7f94340ff750 2023-10-08T13:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341a3330 con 0x7f94340ff750 2023-10-08T13:26:09.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9428022470 con 0x7f94340ff750 2023-10-08T13:26:09.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428017650 con 0x7f94340ff750 2023-10-08T13:26:09.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.786+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94341a3740 con 0x7f94340ff750 2023-10-08T13:26:09.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.787+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9434107c40 con 0x7f94340ff750 2023-10-08T13:26:09.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.788+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f94280225e0 con 0x7f94340ff750 2023-10-08T13:26:09.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.789+0000 7f94317fa700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 0x7f941c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:09.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.789+0000 7f94337fe700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 0x7f941c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:09.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.789+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f94280ce620 con 0x7f94340ff750 2023-10-08T13:26:09.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.789+0000 7f94337fe700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 0x7f941c0a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94340689a0 tx=0x7f942400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:09.793 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.792+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f94280977c0 con 0x7f94340ff750 2023-10-08T13:26:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: pgmap v255: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2023-10-08T13:26:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2023-10-08T13:26:09.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2023-10-08T13:26:09.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2023-10-08T13:26:09.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-10-08T13:26:09.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:09 smithi139 ceph-mon[99506]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:26:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: pgmap v255: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2023-10-08T13:26:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-08T13:26:09.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:26:09.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-10-08T13:26:09.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-08T13:26:09.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-08T13:26:09.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2023-10-08T13:26:09.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2023-10-08T13:26:09.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2023-10-08T13:26:09.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2023-10-08T13:26:09.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-10-08T13:26:09.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:09 smithi187 ceph-mon[104336]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:26:09.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.982+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f9434100df0 con 0x7f94340ff750 2023-10-08T13:26:09.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.983+0000 7f94317fa700 1 -- 172.21.15.139:0/2446255747 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7f94280270a0 con 0x7f94340ff750 2023-10-08T13:26:09.984 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:09.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 msgr2=0x7f941c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:09.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 0x7f941c0a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94340689a0 tx=0x7f942400b410 comp rx=0 tx=0).stop 2023-10-08T13:26:09.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 msgr2=0x7f9434197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f94280098e0 tx=0x7f942800f670 comp rx=0 tx=0).stop 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 shutdown_connections 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f941c0a1560 0x7f941c0a3a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94341056b0 0x7f94341a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94340ff750 0x7f9434197a10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 --2- 172.21.15.139:0/2446255747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9434100110 0x7f9434197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 >> 172.21.15.139:0/2446255747 conn(0x7f9434075790 msgr2=0x7f94340fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 shutdown_connections 2023-10-08T13:26:09.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:09.985+0000 7f943a301700 1 -- 172.21.15.139:0/2446255747 wait complete. 2023-10-08T13:26:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: pgmap v255: 129 pgs: 129 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.8 KiB/s wr, 19 op/s 2023-10-08T13:26:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2023-10-08T13:26:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:09 smithi155 ceph-mon[103467]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T13:26:10.406 INFO:teuthology.orchestra.run.smithi139.stdout:[{"version":46,"timestamp":"2023-10-08T13:25:28.390500+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-08T13:26:10.407 INFO:tasks.ceph_manager:config epoch is 46 2023-10-08T13:26:10.407 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T13:26:10.407 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-08T13:26:10.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-08T13:26:10.972 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:10 smithi187 ceph-mon[104336]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:26:10.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:10 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2446255747' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:26:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:10 smithi155 ceph-mon[103467]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:26:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:10 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2446255747' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:26:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:10 smithi139 ceph-mon[99506]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T13:26:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:10 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2446255747' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T13:26:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:11 smithi139 ceph-mon[99506]: pgmap v258: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:11 smithi155 ceph-mon[103467]: pgmap v258: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:11 smithi187 ceph-mon[104336]: pgmap v258: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 27 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:12.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 -- 172.21.15.139:0/379390283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ffb10 msgr2=0x7f661c10bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 --2- 172.21.15.139:0/379390283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ffb10 0x7f661c10bd30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f661400b0d0 tx=0x7f661400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 -- 172.21.15.139:0/379390283 shutdown_connections 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 --2- 172.21.15.139:0/379390283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ffb10 0x7f661c10bd30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 --2- 172.21.15.139:0/379390283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c104f10 0x7f661c1052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 --2- 172.21.15.139:0/379390283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c0ff150 0x7f661c0ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 -- 172.21.15.139:0/379390283 >> 172.21.15.139:0/379390283 conn(0x7f661c074aa0 msgr2=0x7f661c074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 -- 172.21.15.139:0/379390283 shutdown_connections 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.329+0000 7f6620ba8700 1 -- 172.21.15.139:0/379390283 wait complete. 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 Processor -- start 2023-10-08T13:26:12.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 -- start start 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c0ffb10 0x7f661c1010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c104f10 0x7f661c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1a5130 con 0x7f661c0ff150 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1a52a0 con 0x7f661c0ffb10 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6620ba8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1a5460 con 0x7f661c104f10 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38738/0 (socket says 172.21.15.139:38738) 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 -- 172.21.15.139:0/3152133661 learned_addr learned my addr 172.21.15.139:0/3152133661 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:12.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f6619d9b700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c0ffb10 0x7f661c1010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661ad9d700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c104f10 0x7f661c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 -- 172.21.15.139:0/3152133661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c104f10 msgr2=0x7f661c1015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c104f10 0x7f661c1015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 -- 172.21.15.139:0/3152133661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c0ffb10 msgr2=0x7f661c1010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c0ffb10 0x7f661c1010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 -- 172.21.15.139:0/3152133661 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614009d00 con 0x7f661c0ff150 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.330+0000 7f661a59c700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f660c00d950 tx=0x7f660c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.331+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c009940 con 0x7f661c0ff150 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.331+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f660c010460 con 0x7f661c0ff150 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.331+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00f620 con 0x7f661c0ff150 2023-10-08T13:26:12.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.331+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c1a5740 con 0x7f661c0ff150 2023-10-08T13:26:12.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.331+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c1a5c40 con 0x7f661c0ff150 2023-10-08T13:26:12.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.332+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c109400 con 0x7f661c0ff150 2023-10-08T13:26:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.332+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f660c0108d0 con 0x7f661c0ff150 2023-10-08T13:26:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.333+0000 7f660b7fe700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 0x7f66040a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.333+0000 7f6619d9b700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 0x7f66040a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.333+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f660c0cd010 con 0x7f661c0ff150 2023-10-08T13:26:12.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.333+0000 7f6619d9b700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 0x7f66040a3aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f661c102290 tx=0x7f661000b490 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:12.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.337+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f660c096120 con 0x7f661c0ff150 2023-10-08T13:26:12.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.585+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f661c1005a0 con 0x7f661c0ff150 2023-10-08T13:26:12.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.589+0000 7f660b7fe700 1 -- 172.21.15.139:0/3152133661 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260431 (secure 0 0 0) 0x7f660c099740 con 0x7f661c0ff150 2023-10-08T13:26:12.596 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:12.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 msgr2=0x7f66040a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 0x7f66040a3aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f661c102290 tx=0x7f661000b490 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 msgr2=0x7f661c100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f660c00d950 tx=0x7f660c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 shutdown_connections 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66040a15e0 0x7f66040a3aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f661c104f10 0x7f661c1015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f661c0ff150 0x7f661c100b60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 --2- 172.21.15.139:0/3152133661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f661c0ffb10 0x7f661c1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 >> 172.21.15.139:0/3152133661 conn(0x7f661c074aa0 msgr2=0x7f661c103410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:12.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 shutdown_connections 2023-10-08T13:26:12.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:12.592+0000 7f6620ba8700 1 -- 172.21.15.139:0/3152133661 wait complete. 2023-10-08T13:26:12.917 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:12 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3152133661' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:26:12.927 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":21,"active_gid":14217,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4190664653},{"type":"v1","addr":"172.21.15.139:6801","nonce":4190664653}]},"active_addr":"172.21.15.139:6801/4190664653","active_change":"2023-10-08T13:20:08.526118+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24139,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24146,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.139:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":496172019}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":4224656222}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":2967129286}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":3768596099}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":673201133}]}]} 2023-10-08T13:26:12.933 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-08T13:26:12.934 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-08T13:26:12.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:26:13.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:12 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3152133661' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:26:13.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:12 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3152133661' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T13:26:13.493 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:14.036 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:13 smithi139 ceph-mon[99506]: pgmap v259: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:13 smithi155 ceph-mon[103467]: pgmap v259: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:13 smithi187 ceph-mon[104336]: pgmap v259: 129 pgs: 3 peering, 126 active+clean; 626 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 24 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:14.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/1135933181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 msgr2=0x7f2bd810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:14.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/1135933181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd810d670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000b0a0 tx=0x7f2bd000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/1135933181 shutdown_connections 2023-10-08T13:26:14.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/1135933181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd810d670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/1135933181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd81067a0 0x7f2bd8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/1135933181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd8068190 0x7f2bd80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/1135933181 >> 172.21.15.139:0/1135933181 conn(0x7f2bd8075790 msgr2=0x7f2bd8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:14.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/1135933181 shutdown_connections 2023-10-08T13:26:14.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.630+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/1135933181 wait complete. 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 Processor -- start 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 -- start start 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 0x7f2bd80ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd81067a0 0x7f2bd81002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81a5080 con 0x7f2bd8068b30 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81a51f0 con 0x7f2bd81067a0 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdfb7c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81a53b0 con 0x7f2bd8068190 2023-10-08T13:26:14.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38754/0 (socket says 172.21.15.139:38754) 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 -- 172.21.15.139:0/3148057867 learned_addr learned my addr 172.21.15.139:0/3148057867 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bde119700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd81067a0 0x7f2bd81002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd918700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 0x7f2bd80ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 -- 172.21.15.139:0/3148057867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 msgr2=0x7f2bd80ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 0x7f2bd80ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 -- 172.21.15.139:0/3148057867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd81067a0 msgr2=0x7f2bd81002a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd81067a0 0x7f2bd81002a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd117700 1 -- 172.21.15.139:0/3148057867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009d00 con 0x7f2bd8068b30 2023-10-08T13:26:14.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.631+0000 7f2bdd918700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 0x7f2bd80ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bdd117700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800d980 tx=0x7f2bc800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8004220 con 0x7f2bd8068b30 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2bc8007640 con 0x7f2bd8068b30 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd81a5690 con 0x7f2bd8068b30 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8005610 con 0x7f2bd8068b30 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.632+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd81a5b90 con 0x7f2bd8068b30 2023-10-08T13:26:14.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.633+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8108d50 con 0x7f2bd8068b30 2023-10-08T13:26:14.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.634+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f2bc8004750 con 0x7f2bd8068b30 2023-10-08T13:26:14.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.634+0000 7f2bceffd700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 0x7f2bc40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:14.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.634+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2bc80cd610 con 0x7f2bd8068b30 2023-10-08T13:26:14.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.634+0000 7f2bdd918700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 0x7f2bc40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:14.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.635+0000 7f2bdd918700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 0x7f2bc40a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005e10 tx=0x7f2bd4005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:14.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.638+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2bc8096720 con 0x7f2bd8068b30 2023-10-08T13:26:14.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.828+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd8101ee0 con 0x7f2bd8068b30 2023-10-08T13:26:14.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.829+0000 7f2bceffd700 1 -- 172.21.15.139:0/3148057867 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24773 (secure 0 0 0) 0x7f2bc8016090 con 0x7f2bd8068b30 2023-10-08T13:26:14.831 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:14.831 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":89,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:26:09.712811+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.831+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 msgr2=0x7f2bc40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.831+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 0x7f2bc40a3a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005e10 tx=0x7f2bd4005d60 comp rx=0 tx=0).stop 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.831+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 msgr2=0x7f2bd80ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.831+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800d980 tx=0x7f2bc800dc90 comp rx=0 tx=0).stop 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 shutdown_connections 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2bc40a1560 0x7f2bc40a3a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd81067a0 0x7f2bd81002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bd8068190 0x7f2bd80ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 --2- 172.21.15.139:0/3148057867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bd8068b30 0x7f2bd80ffd60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 >> 172.21.15.139:0/3148057867 conn(0x7f2bd8075790 msgr2=0x7f2bd80fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 shutdown_connections 2023-10-08T13:26:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:14.832+0000 7f2bdfb7c700 1 -- 172.21.15.139:0/3148057867 wait complete. 2023-10-08T13:26:15.258 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-08T13:26:15.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T13:26:15.818 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:16.017 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:15 smithi139 ceph-mon[99506]: pgmap v260: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 13 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:16.017 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3148057867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:15 smithi155 ceph-mon[103467]: pgmap v260: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 13 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3148057867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:15 smithi187 ceph-mon[104336]: pgmap v260: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 13 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3148057867' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- 172.21.15.139:0/1094761438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c41008a0 msgr2=0x7f66c4100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/1094761438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c41008a0 0x7f66c4100d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009990 tx=0x7f66c0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- 172.21.15.139:0/1094761438 shutdown_connections 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/1094761438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c4101260 0x7f66c410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/1094761438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41057c0 0x7f66c4105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/1094761438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c41008a0 0x7f66c4100d20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- 172.21.15.139:0/1094761438 >> 172.21.15.139:0/1094761438 conn(0x7f66c40779e0 msgr2=0x7f66c4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:17.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- 172.21.15.139:0/1094761438 shutdown_connections 2023-10-08T13:26:17.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- 172.21.15.139:0/1094761438 wait complete. 2023-10-08T13:26:17.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 Processor -- start 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 -- start start 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41008a0 0x7f66c4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.029+0000 7f66cc0e4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 0x7f66c4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66cc0e4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41a4fa0 con 0x7f66c4101260 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66cc0e4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41a5110 con 0x7f66c41057c0 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66cc0e4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c41a52d0 con 0x7f66c41008a0 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38764/0 (socket says 172.21.15.139:38764) 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 -- 172.21.15.139:0/611598172 learned_addr learned my addr 172.21.15.139:0/611598172 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:17.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c9e80700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41008a0 0x7f66c4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66ca681700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 0x7f66c4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 -- 172.21.15.139:0/611598172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41008a0 msgr2=0x7f66c4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41008a0 0x7f66c4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 -- 172.21.15.139:0/611598172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 msgr2=0x7f66c4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 0x7f66c4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 -- 172.21.15.139:0/611598172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c00095f0 con 0x7f66c4101260 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66ca681700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 0x7f66c4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66c967f700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f66c00098e0 tx=0x7f66c000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c001d070 con 0x7f66c4101260 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c41a5550 con 0x7f66c4101260 2023-10-08T13:26:17.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c0022470 con 0x7f66c4101260 2023-10-08T13:26:17.035 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0017650 con 0x7f66c4101260 2023-10-08T13:26:17.035 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.030+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c41a59c0 con 0x7f66c4101260 2023-10-08T13:26:17.035 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.031+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4108da0 con 0x7f66c4101260 2023-10-08T13:26:17.035 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.032+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f66c00225e0 con 0x7f66c4101260 2023-10-08T13:26:17.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.033+0000 7f66baffd700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 0x7f66b00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:17.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.033+0000 7f66c9e80700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 0x7f66b00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:17.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.033+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f66c00ce6e0 con 0x7f66c4101260 2023-10-08T13:26:17.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.033+0000 7f66c9e80700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 0x7f66b00a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66c4101930 tx=0x7f66b400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:17.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.036+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f66c0097820 con 0x7f66c4101260 2023-10-08T13:26:17.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.225+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c404e520 con 0x7f66c4101260 2023-10-08T13:26:17.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.227+0000 7f66baffd700 1 -- 172.21.15.139:0/611598172 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24773 (secure 0 0 0) 0x7f66c009ae40 con 0x7f66c4101260 2023-10-08T13:26:17.228 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:17.228 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":89,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:26:09.712811+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:17.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 msgr2=0x7f66b00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 0x7f66b00a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66c4101930 tx=0x7f66b400b410 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 msgr2=0x7f66c4073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f66c00098e0 tx=0x7f66c000f670 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 shutdown_connections 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66b00a15e0 0x7f66b00a3aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c41057c0 0x7f66c4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66c41008a0 0x7f66c4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 --2- 172.21.15.139:0/611598172 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66c4101260 0x7f66c4073030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 >> 172.21.15.139:0/611598172 conn(0x7f66c40779e0 msgr2=0x7f66c40fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 shutdown_connections 2023-10-08T13:26:17.231 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:17.229+0000 7f66cc0e4700 1 -- 172.21.15.139:0/611598172 wait complete. 2023-10-08T13:26:17.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-08T13:26:17.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-08T13:26:17.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-08T13:26:17.582 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-08T13:26:17.582 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-08T13:26:17.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-08T13:26:17.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-08T13:26:17.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-08T13:26:17.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-08T13:26:17.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-08T13:26:17.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-08T13:26:17.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-08T13:26:17.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:17 smithi139 ceph-mon[99506]: pgmap v261: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:17.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:17 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/611598172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:17 smithi155 ceph-mon[103467]: pgmap v261: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:17 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/611598172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:17 smithi187 ceph-mon[104336]: pgmap v261: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s; 15 B/s, 0 objects/s recovering 2023-10-08T13:26:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:17 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/611598172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:18.366 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.383 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.493 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.493 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.608 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.668 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:18.876 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:20.004 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:19 smithi139 ceph-mon[99506]: pgmap v262: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 12 B/s, 0 objects/s recovering 2023-10-08T13:26:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:19 smithi155 ceph-mon[103467]: pgmap v262: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 12 B/s, 0 objects/s recovering 2023-10-08T13:26:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:19 smithi187 ceph-mon[104336]: pgmap v262: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 12 B/s, 0 objects/s recovering 2023-10-08T13:26:20.226 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:21.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 -- 172.21.15.139:0/970520256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 msgr2=0x7f25cc0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/970520256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc0ffbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009990 tx=0x7f25b4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 -- 172.21.15.139:0/970520256 shutdown_connections 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/970520256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100110 0x7f25cc10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/970520256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc1056b0 0x7f25cc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/970520256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc0ffbd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 -- 172.21.15.139:0/970520256 >> 172.21.15.139:0/970520256 conn(0x7f25cc075790 msgr2=0x7f25cc075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 -- 172.21.15.139:0/970520256 shutdown_connections 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.086+0000 7f25d1fdf700 1 -- 172.21.15.139:0/970520256 wait complete. 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 Processor -- start 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 -- start start 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:21.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100110 0x7f25cc197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc1056b0 0x7f25cc1a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc198770 con 0x7f25cc0ff750 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a2f30 con 0x7f25cc1056b0 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25d1fdf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a3070 con 0x7f25cc100110 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38776/0 (socket says 172.21.15.139:38776) 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.087+0000 7f25cb7fe700 1 -- 172.21.15.139:0/1237244307 learned_addr learned my addr 172.21.15.139:0/1237244307 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cbfff700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc1056b0 0x7f25cc1a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25caffd700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100110 0x7f25cc197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 -- 172.21.15.139:0/1237244307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100110 msgr2=0x7f25cc197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100110 0x7f25cc197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 -- 172.21.15.139:0/1237244307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc1056b0 msgr2=0x7f25cc1a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25cc1056b0 0x7f25cc1a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40095f0 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25cb7fe700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc197970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25bc007e20 tx=0x7f25bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00ad40 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25bc0128e0 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1a32f0 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0117a0 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.088+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a37f0 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.089+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25cc10f910 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.090+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f25bc012a50 con 0x7f25cc0ff750 2023-10-08T13:26:21.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25c8ff9700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25b80a1560 0x7f25b80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25caffd700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25b80a1560 0x7f25b80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f25bc0cd8c0 con 0x7f25cc0ff750 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25c8ff9700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] conn(0x7f25b80ac710 0x7f25b80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25b80af280 con 0x7f25b80ac710 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25bc0cdcd0 con 0x7f25cc0ff750 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25cbfff700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] conn(0x7f25b80ac710 0x7f25b80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25caffd700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25b80a1560 0x7f25b80a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006010 tx=0x7f25b400b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.091+0000 7f25cbfff700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] conn(0x7f25b80ac710 0x7f25b80aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.092+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== osd.6 v2:172.21.15.139:6818/3559626556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f25b80af280 con 0x7f25b80ac710 2023-10-08T13:26:21.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.108+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 --> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25cc100df0 con 0x7f25b80ac710 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.108+0000 7f25c8ff9700 1 -- 172.21.15.139:0/1237244307 <== osd.6 v2:172.21.15.139:6818/3559626556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f25cc100df0 con 0x7f25b80ac710 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] conn(0x7f25b80ac710 msgr2=0x7f25b80aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] conn(0x7f25b80ac710 0x7f25b80aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25b80a1560 msgr2=0x7f25b80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25b80a1560 0x7f25b80a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006010 tx=0x7f25b400b260 comp rx=0 tx=0).stop 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 msgr2=0x7f25cc197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25d1fdf700 1 --2- 172.21.15.139:0/1237244307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25cc0ff750 0x7f25cc197970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25bc007e20 tx=0x7f25bc00a340 comp rx=0 tx=0).stop 2023-10-08T13:26:21.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.109+0000 7f25cbfff700 1 -- 172.21.15.139:0/1237244307 reap_dead start 2023-10-08T13:26:21.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.110+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 shutdown_connections 2023-10-08T13:26:21.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.110+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 >> 172.21.15.139:0/1237244307 conn(0x7f25cc075790 msgr2=0x7f25cc0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:21.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.110+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 shutdown_connections 2023-10-08T13:26:21.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:21.110+0000 7f25d1fdf700 1 -- 172.21.15.139:0/1237244307 wait complete. 2023-10-08T13:26:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:21 smithi139 ceph-mon[99506]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T13:26:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:21 smithi187 ceph-mon[104336]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T13:26:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:21 smithi155 ceph-mon[103467]: pgmap v263: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T13:26:22.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 -- 172.21.15.139:0/1005221852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd754100110 msgr2=0x7fd75410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1005221852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd754100110 0x7fd75410c580 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b0a0 tx=0x7fd74c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 -- 172.21.15.139:0/1005221852 shutdown_connections 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1005221852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd754100110 0x7fd75410c580 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1005221852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7541056b0 0x7fd754105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1005221852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7540ff750 0x7fd7540ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 -- 172.21.15.139:0/1005221852 >> 172.21.15.139:0/1005221852 conn(0x7fd754075790 msgr2=0x7fd754075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 -- 172.21.15.139:0/1005221852 shutdown_connections 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.333+0000 7fd75bf96700 1 -- 172.21.15.139:0/1005221852 wait complete. 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 Processor -- start 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 -- start start 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7540ff750 0x7fd754101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754100110 0x7fd7541017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 0x7fd754101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a5140 con 0x7fd7541056b0 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a52b0 con 0x7fd754100110 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75bf96700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7541a5470 con 0x7fd7540ff750 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 0x7fd754101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 0x7fd754101d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38794/0 (socket says 172.21.15.139:38794) 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 -- 172.21.15.139:0/1889315340 learned_addr learned my addr 172.21.15.139:0/1889315340 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd759531700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754100110 0x7fd7541017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd759d32700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7540ff750 0x7fd754101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 -- 172.21.15.139:0/1889315340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7540ff750 msgr2=0x7fd754101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.338 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7540ff750 0x7fd754101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 -- 172.21.15.139:0/1889315340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754100110 msgr2=0x7fd7541017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754100110 0x7fd7541017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd75a533700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009d00 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.334+0000 7fd759531700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd754100110 0x7fd7541017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd75a533700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 0x7fd754101d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0077f0 tx=0x7fd74c007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00e040 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd74c004c60 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7541a56f0 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c005280 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7541a5b60 con 0x7fd7541056b0 2023-10-08T13:26:22.339 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.335+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd75410f950 con 0x7fd7541056b0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd74c01b450 con 0x7fd7541056b0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7400a16b0 0x7fd7400a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd759d32700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7400a16b0 0x7fd7400a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd74c0cf070 con 0x7fd7541056b0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] conn(0x7fd7400ac730 0x7fd7400aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7400af2a0 con 0x7fd7400ac730 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.337+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd74c0cf480 con 0x7fd7541056b0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.338+0000 7fd759531700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] conn(0x7fd7400ac730 0x7fd7400aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.338+0000 7fd759d32700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7400a16b0 0x7fd7400a3b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd75000abd0 tx=0x7fd75000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.338+0000 7fd759531700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] conn(0x7fd7400ac730 0x7fd7400aebd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.339+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== osd.3 v2:172.21.15.139:6810/254276736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd7400af2a0 con 0x7fd7400ac730 2023-10-08T13:26:22.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.354+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 --> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd754100df0 con 0x7fd7400ac730 2023-10-08T13:26:22.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd74affd700 1 -- 172.21.15.139:0/1889315340 <== osd.3 v2:172.21.15.139:6810/254276736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd754100df0 con 0x7fd7400ac730 2023-10-08T13:26:22.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] conn(0x7fd7400ac730 msgr2=0x7fd7400aebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] conn(0x7fd7400ac730 0x7fd7400aebd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7400a16b0 msgr2=0x7fd7400a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7400a16b0 0x7fd7400a3b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd75000abd0 tx=0x7fd75000a380 comp rx=0 tx=0).stop 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 msgr2=0x7fd754101d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 --2- 172.21.15.139:0/1889315340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7541056b0 0x7fd754101d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0077f0 tx=0x7fd74c007820 comp rx=0 tx=0).stop 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75a533700 1 -- 172.21.15.139:0/1889315340 reap_dead start 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 shutdown_connections 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 >> 172.21.15.139:0/1889315340 conn(0x7fd754075790 msgr2=0x7fd7541034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 shutdown_connections 2023-10-08T13:26:22.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.355+0000 7fd75bf96700 1 -- 172.21.15.139:0/1889315340 wait complete. 2023-10-08T13:26:22.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 -- 172.21.15.139:0/574782074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 msgr2=0x7f6e4c104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 --2- 172.21.15.139:0/574782074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c104b00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009990 tx=0x7f6e3c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 -- 172.21.15.139:0/574782074 shutdown_connections 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 --2- 172.21.15.139:0/574782074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 0x7f6e4c10c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 --2- 172.21.15.139:0/574782074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c104b00 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 --2- 172.21.15.139:0/574782074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e4c1002a0 0x7f6e4c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 -- 172.21.15.139:0/574782074 >> 172.21.15.139:0/574782074 conn(0x7f6e4c074a10 msgr2=0x7f6e4c074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 -- 172.21.15.139:0/574782074 shutdown_connections 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.962+0000 7f6e5208d700 1 -- 172.21.15.139:0/574782074 wait complete. 2023-10-08T13:26:22.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 Processor -- start 2023-10-08T13:26:22.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 -- start start 2023-10-08T13:26:22.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e4c1002a0 0x7f6e4c197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 0x7f6e4c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c1a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c198790 con 0x7f6e4c104720 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a2fc0 con 0x7f6e4c1002a0 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e5208d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a3100 con 0x7f6e4c100c60 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c1a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c1a2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38810/0 (socket says 172.21.15.139:38810) 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e4bfff700 1 -- 172.21.15.139:0/3518061233 learned_addr learned my addr 172.21.15.139:0/3518061233 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.963+0000 7f6e4b7fe700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e4c1002a0 0x7f6e4c197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4affd700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 0x7f6e4c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 -- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 msgr2=0x7f6e4c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 0x7f6e4c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 -- 172.21.15.139:0/3518061233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e4c1002a0 msgr2=0x7f6e4c197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e4c1002a0 0x7f6e4c197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c0095f0 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4affd700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c100c60 0x7f6e4c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e4bfff700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c1a2a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007d40 tx=0x7f6e4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400ad60 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c1a3360 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e44007e90 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440116b0 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.964+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c1a3860 con 0x7f6e4c104720 2023-10-08T13:26:22.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.965+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e4c067d10 con 0x7f6e4c104720 2023-10-08T13:26:22.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.966+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f6e44012420 con 0x7f6e4c104720 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e48ff9700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6e340a1560 0x7f6e340a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e4b7fe700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6e340a1560 0x7f6e340a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f6e440cd9a0 con 0x7f6e4c104720 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e48ff9700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] conn(0x7f6e340ac710 0x7f6e340aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e340af280 con 0x7f6e340ac710 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e440cddb0 con 0x7f6e4c104720 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e4b7fe700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6e340a1560 0x7f6e340a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0098e0 tx=0x7f6e3c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.967+0000 7f6e4affd700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] conn(0x7f6e340ac710 0x7f6e340aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.968+0000 7f6e4affd700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] conn(0x7f6e340ac710 0x7f6e340aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:22.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.968+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== osd.8 v2:172.21.15.187:6816/3076471964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6e340af280 con 0x7f6e340ac710 2023-10-08T13:26:23.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.984+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 --> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e4c10f920 con 0x7f6e340ac710 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e48ff9700 1 -- 172.21.15.139:0/3518061233 <== osd.8 v2:172.21.15.187:6816/3076471964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6e4c10f920 con 0x7f6e340ac710 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] conn(0x7f6e340ac710 msgr2=0x7f6e340aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] conn(0x7f6e340ac710 0x7f6e340aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6e340a1560 msgr2=0x7f6e340a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6e340a1560 0x7f6e340a3a20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0098e0 tx=0x7f6e3c005960 comp rx=0 tx=0).stop 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 msgr2=0x7f6e4c1a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 --2- 172.21.15.139:0/3518061233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e4c104720 0x7f6e4c1a2a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007d40 tx=0x7f6e4400a340 comp rx=0 tx=0).stop 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e4bfff700 1 -- 172.21.15.139:0/3518061233 reap_dead start 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 shutdown_connections 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 >> 172.21.15.139:0/3518061233 conn(0x7f6e4c074a10 msgr2=0x7f6e4c0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:23.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 shutdown_connections 2023-10-08T13:26:23.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:22.985+0000 7f6e5208d700 1 -- 172.21.15.139:0/3518061233 wait complete. 2023-10-08T13:26:23.050 INFO:teuthology.orchestra.run.smithi139.stdout:197568495657 2023-10-08T13:26:23.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-08T13:26:23.066 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 -- 172.21.15.139:0/563748406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 msgr2=0x7fccb41008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 --2- 172.21.15.139:0/563748406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb41008a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009990 tx=0x7fccb0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 -- 172.21.15.139:0/563748406 shutdown_connections 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 --2- 172.21.15.139:0/563748406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccb4104ae0 0x7fccb410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 --2- 172.21.15.139:0/563748406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb41008a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 --2- 172.21.15.139:0/563748406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb4100e70 0x7fccb41043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 -- 172.21.15.139:0/563748406 >> 172.21.15.139:0/563748406 conn(0x7fccb4074aa0 msgr2=0x7fccb4074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 -- 172.21.15.139:0/563748406 shutdown_connections 2023-10-08T13:26:23.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.533+0000 7fccbb368700 1 -- 172.21.15.139:0/563748406 wait complete. 2023-10-08T13:26:23.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 Processor -- start 2023-10-08T13:26:23.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 -- start start 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb4197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccb4100e70 0x7fccb4198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb4104ae0 0x7fccb41a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41988f0 con 0x7fccb41004c0 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41a30d0 con 0x7fccb4104ae0 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccbb368700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb41a3210 con 0x7fccb4100e70 2023-10-08T13:26:23.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccb9104700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb4197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccb9104700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb4197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38822/0 (socket says 172.21.15.139:38822) 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.534+0000 7fccb9104700 1 -- 172.21.15.139:0/2474155647 learned_addr learned my addr 172.21.15.139:0/2474155647 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb8903700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccb4100e70 0x7fccb4198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 -- 172.21.15.139:0/2474155647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccb4100e70 msgr2=0x7fccb4198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9905700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb4104ae0 0x7fccb41a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccb4100e70 0x7fccb4198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 -- 172.21.15.139:0/2474155647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb4104ae0 msgr2=0x7fccb41a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccb4104ae0 0x7fccb41a2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00095f0 con 0x7fccb41004c0 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccb9104700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb4197b10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fccb000f7d0 tx=0x7fccb000f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:23.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb001d070 con 0x7fccb41004c0 2023-10-08T13:26:23.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb41a3460 con 0x7fccb41004c0 2023-10-08T13:26:23.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fccb000fdd0 con 0x7fccb41004c0 2023-10-08T13:26:23.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017790 con 0x7fccb41004c0 2023-10-08T13:26:23.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.535+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb41a38d0 con 0x7fccb41004c0 2023-10-08T13:26:23.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.536+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccb410f990 con 0x7fccb41004c0 2023-10-08T13:26:23.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.537+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fccb0022aa0 con 0x7fccb41004c0 2023-10-08T13:26:23.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccaa7fc700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcca00a1560 0x7fcca00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:23.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccb8903700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcca00a1560 0x7fcca00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:23.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fccb00cec50 con 0x7fccb41004c0 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccaa7fc700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] conn(0x7fcca00ac710 0x7fcca00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcca00af280 con 0x7fcca00ac710 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb00cefc0 con 0x7fccb41004c0 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccb9905700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] conn(0x7fcca00ac710 0x7fcca00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccb8903700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcca00a1560 0x7fcca00a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ff9a0 tx=0x7fcca4005cf0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.538+0000 7fccb9905700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] conn(0x7fcca00ac710 0x7fcca00aebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:23.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.539+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== osd.9 v2:172.21.15.139:6826/317853684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcca00af280 con 0x7fcca00ac710 2023-10-08T13:26:23.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.555+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 --> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccb4068a40 con 0x7fcca00ac710 2023-10-08T13:26:23.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.555+0000 7fccaa7fc700 1 -- 172.21.15.139:0/2474155647 <== osd.9 v2:172.21.15.139:6826/317853684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fccb4068a40 con 0x7fcca00ac710 2023-10-08T13:26:23.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] conn(0x7fcca00ac710 msgr2=0x7fcca00aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] conn(0x7fcca00ac710 0x7fcca00aebb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcca00a1560 msgr2=0x7fcca00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcca00a1560 0x7fcca00a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ff9a0 tx=0x7fcca4005cf0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 msgr2=0x7fccb4197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 --2- 172.21.15.139:0/2474155647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccb41004c0 0x7fccb4197b10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fccb000f7d0 tx=0x7fccb000f8b0 comp rx=0 tx=0).stop 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccb9905700 1 -- 172.21.15.139:0/2474155647 reap_dead start 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 shutdown_connections 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 >> 172.21.15.139:0/2474155647 conn(0x7fccb4074aa0 msgr2=0x7fccb40fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 shutdown_connections 2023-10-08T13:26:23.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:23.556+0000 7fccbb368700 1 -- 172.21.15.139:0/2474155647 wait complete. 2023-10-08T13:26:23.837 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:23.841 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:23 smithi139 ceph-mon[99506]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:26:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:23 smithi187 ceph-mon[104336]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:26:24.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:23 smithi155 ceph-mon[103467]: pgmap v264: 129 pgs: 129 active+clean; 636 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 -- 172.21.15.139:0/4096892169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f01056b0 msgr2=0x7f36f0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/4096892169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f01056b0 0x7f36f0105a90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009990 tx=0x7f36e4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 -- 172.21.15.139:0/4096892169 shutdown_connections 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/4096892169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f0100110 0x7f36f010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/4096892169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f01056b0 0x7f36f0105a90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/4096892169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36f00ff750 0x7f36f00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 -- 172.21.15.139:0/4096892169 >> 172.21.15.139:0/4096892169 conn(0x7f36f0075790 msgr2=0x7f36f0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:24.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 -- 172.21.15.139:0/4096892169 shutdown_connections 2023-10-08T13:26:24.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.148+0000 7f36f4dc2700 1 -- 172.21.15.139:0/4096892169 wait complete. 2023-10-08T13:26:24.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 Processor -- start 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 -- start start 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 0x7f36f019c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36f0100110 0x7f36f019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f01056b0 0x7f36f0196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0197060 con 0x7f36f00ff750 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f01971d0 con 0x7f36f01056b0 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36f4dc2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0197390 con 0x7f36f0100110 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 0x7f36f019c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 0x7f36f019c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38836/0 (socket says 172.21.15.139:38836) 2023-10-08T13:26:24.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 -- 172.21.15.139:0/2854873587 learned_addr learned my addr 172.21.15.139:0/2854873587 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36eed9d700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f01056b0 0x7f36f0196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36edd9b700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36f0100110 0x7f36f019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 -- 172.21.15.139:0/2854873587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36f0100110 msgr2=0x7f36f019ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36f0100110 0x7f36f019ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 -- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f01056b0 msgr2=0x7f36f0196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f01056b0 0x7f36f0196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40095f0 con 0x7f36f00ff750 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36eed9d700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36f01056b0 0x7f36f0196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.149+0000 7f36ee59c700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 0x7f36f019c8c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009fd0 tx=0x7f36e400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.150+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e401d070 con 0x7f36f00ff750 2023-10-08T13:26:24.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.150+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36e4005510 con 0x7f36f00ff750 2023-10-08T13:26:24.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.150+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f0197610 con 0x7f36f00ff750 2023-10-08T13:26:24.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.150+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4004bd0 con 0x7f36f00ff750 2023-10-08T13:26:24.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.150+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f01a38b0 con 0x7f36f00ff750 2023-10-08T13:26:24.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.151+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36f010f910 con 0x7f36f00ff750 2023-10-08T13:26:24.154 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.152+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f36e4004d30 con 0x7f36f00ff750 2023-10-08T13:26:24.154 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.152+0000 7f36df7fe700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f36d80a15e0 0x7f36d80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.154 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36edd9b700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f36d80a15e0 0x7f36d80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.154 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f36e40ce750 con 0x7f36f00ff750 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36df7fe700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] conn(0x7f36d80ac710 0x7f36d80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36d80af280 con 0x7f36d80ac710 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36e40ceb60 con 0x7f36f00ff750 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36edd9b700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f36d80a15e0 0x7f36d80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005950 tx=0x7f36e00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36eed9d700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] conn(0x7f36d80ac710 0x7f36d80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.153+0000 7f36eed9d700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] conn(0x7f36d80ac710 0x7f36d80aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.154+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== osd.1 v2:172.21.15.155:6800/765538581 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f36d80af280 con 0x7f36d80ac710 2023-10-08T13:26:24.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.172+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 --> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36f0060e70 con 0x7f36d80ac710 2023-10-08T13:26:24.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.173+0000 7f36df7fe700 1 -- 172.21.15.139:0/2854873587 <== osd.1 v2:172.21.15.155:6800/765538581 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36f0060e70 con 0x7f36d80ac710 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.173+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] conn(0x7f36d80ac710 msgr2=0x7f36d80aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.173+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] conn(0x7f36d80ac710 0x7f36d80aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f36d80a15e0 msgr2=0x7f36d80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f36d80a15e0 0x7f36d80a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f36e0005950 tx=0x7f36e00058e0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 msgr2=0x7f36f019c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 --2- 172.21.15.139:0/2854873587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f36f00ff750 0x7f36f019c8c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009fd0 tx=0x7f36e400f720 comp rx=0 tx=0).stop 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36eed9d700 1 -- 172.21.15.139:0/2854873587 reap_dead start 2023-10-08T13:26:24.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 shutdown_connections 2023-10-08T13:26:24.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 >> 172.21.15.139:0/2854873587 conn(0x7f36f0075790 msgr2=0x7f36f0068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:24.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 shutdown_connections 2023-10-08T13:26:24.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.174+0000 7f36f4dc2700 1 -- 172.21.15.139:0/2854873587 wait complete. 2023-10-08T13:26:24.192 INFO:teuthology.orchestra.run.smithi139.stdout:111669149750 2023-10-08T13:26:24.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-08T13:26:24.691 INFO:teuthology.orchestra.run.smithi139.stdout:249108103202 2023-10-08T13:26:24.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-08T13:26:24.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 -- 172.21.15.139:0/15706284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7078068b30 msgr2=0x7f707810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 --2- 172.21.15.139:0/15706284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7078068b30 0x7f707810d670 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f707000b0a0 tx=0x7f707000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 -- 172.21.15.139:0/15706284 shutdown_connections 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 --2- 172.21.15.139:0/15706284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7078068b30 0x7f707810d670 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 --2- 172.21.15.139:0/15706284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70781067a0 0x7f7078106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 --2- 172.21.15.139:0/15706284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7078068190 0x7f70780685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.727+0000 7f707d489700 1 -- 172.21.15.139:0/15706284 >> 172.21.15.139:0/15706284 conn(0x7f7078075790 msgr2=0x7f7078075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.728+0000 7f707d489700 1 -- 172.21.15.139:0/15706284 shutdown_connections 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.728+0000 7f707d489700 1 -- 172.21.15.139:0/15706284 wait complete. 2023-10-08T13:26:24.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.728+0000 7f707d489700 1 Processor -- start 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.728+0000 7f707d489700 1 -- start start 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7078068190 0x7f707819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7078068b30 0x7f707819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 0x7f7078196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70781971f0 con 0x7f70781067a0 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078197360 con 0x7f7078068190 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f707d489700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078197520 con 0x7f7078068b30 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 0x7f7078196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 0x7f7078196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38856/0 (socket says 172.21.15.139:38856) 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 -- 172.21.15.139:0/3159284491 learned_addr learned my addr 172.21.15.139:0/3159284491 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f7076ffd700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7078068190 0x7f707819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70767fc700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7078068b30 0x7f707819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 -- 172.21.15.139:0/3159284491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7078068b30 msgr2=0x7f707819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7078068b30 0x7f707819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 -- 172.21.15.139:0/3159284491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7078068190 msgr2=0x7f707819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7078068190 0x7f707819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070009d00 con 0x7f70781067a0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.729+0000 7f70777fe700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 0x7f7078196b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f707000b070 tx=0x7f7070007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.730+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000e040 con 0x7f70781067a0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.730+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f707001d470 con 0x7f70781067a0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.730+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70781977a0 con 0x7f70781067a0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.730+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70700052a0 con 0x7f70781067a0 2023-10-08T13:26:24.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.730+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70781a3a40 con 0x7f70781067a0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.731+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7078110970 con 0x7f70781067a0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f707001d870 con 0x7f70781067a0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f705ffff700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f70600a1560 0x7f70600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f7076ffd700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f70600a1560 0x7f70600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f70700ce980 con 0x7f70781067a0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f705ffff700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] conn(0x7f70600ac710 0x7f70600aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.732+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70600af280 con 0x7f70600ac710 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.733+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70700cecf0 con 0x7f70781067a0 2023-10-08T13:26:24.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.733+0000 7f70767fc700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] conn(0x7f70600ac710 0x7f70600aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.733+0000 7f7076ffd700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f70600a1560 0x7f70600a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7068009be0 tx=0x7f7068009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.733+0000 7f70767fc700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] conn(0x7f70600ac710 0x7f70600aebb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.734+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== osd.0 v2:172.21.15.139:6802/927870802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f70600af280 con 0x7f70600ac710 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.749+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 --> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7078101ee0 con 0x7f70600ac710 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f705ffff700 1 -- 172.21.15.139:0/3159284491 <== osd.0 v2:172.21.15.139:6802/927870802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7078101ee0 con 0x7f70600ac710 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] conn(0x7f70600ac710 msgr2=0x7f70600aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] conn(0x7f70600ac710 0x7f70600aebb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f70600a1560 msgr2=0x7f70600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f70600a1560 0x7f70600a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7068009be0 tx=0x7f7068009260 comp rx=0 tx=0).stop 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 msgr2=0x7f7078196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 --2- 172.21.15.139:0/3159284491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70781067a0 0x7f7078196b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f707000b070 tx=0x7f7070007930 comp rx=0 tx=0).stop 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f70777fe700 1 -- 172.21.15.139:0/3159284491 reap_dead start 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 shutdown_connections 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.750+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 >> 172.21.15.139:0/3159284491 conn(0x7f7078075790 msgr2=0x7f70780fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.751+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 shutdown_connections 2023-10-08T13:26:24.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:24.751+0000 7f707d489700 1 -- 172.21.15.139:0/3159284491 wait complete. 2023-10-08T13:26:25.108 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:25.140 INFO:teuthology.orchestra.run.smithi139.stdout:283467841566 2023-10-08T13:26:25.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-08T13:26:25.196 INFO:teuthology.orchestra.run.smithi139.stdout:60129542206 2023-10-08T13:26:25.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-08T13:26:25.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 -- 172.21.15.139:0/2439779827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c105670 msgr2=0x7fdf0c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 --2- 172.21.15.139:0/2439779827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c105670 0x7fdf0c105a50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0099c0 tx=0x7fdefc009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 -- 172.21.15.139:0/2439779827 shutdown_connections 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 --2- 172.21.15.139:0/2439779827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf0c069450 0x7fdf0c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 --2- 172.21.15.139:0/2439779827 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c105670 0x7fdf0c105a50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 --2- 172.21.15.139:0/2439779827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf0c068a90 0x7fdf0c068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 -- 172.21.15.139:0/2439779827 >> 172.21.15.139:0/2439779827 conn(0x7fdf0c0766c0 msgr2=0x7fdf0c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 -- 172.21.15.139:0/2439779827 shutdown_connections 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.553+0000 7fdf127eb700 1 -- 172.21.15.139:0/2439779827 wait complete. 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 Processor -- start 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 -- start start 2023-10-08T13:26:25.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 0x7fdf0c0ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf0c069450 0x7fdf0c0ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf0c105670 0x7fdf0c100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a4f40 con 0x7fdf0c068a90 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a50b0 con 0x7fdf0c069450 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf127eb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c1a5270 con 0x7fdf0c105670 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 0x7fdf0c0ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 0x7fdf0c0ff7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38866/0 (socket says 172.21.15.139:38866) 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 -- 172.21.15.139:0/1718962636 learned_addr learned my addr 172.21.15.139:0/1718962636 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf10d88700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf0c105670 0x7fdf0c100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0b7fe700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf0c069450 0x7fdf0c0ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 -- 172.21.15.139:0/1718962636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf0c105670 msgr2=0x7fdf0c100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.576 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf0c105670 0x7fdf0c100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 -- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf0c069450 msgr2=0x7fdf0c0ffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf0c069450 0x7fdf0c0ffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.554+0000 7fdf0bfff700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0095f0 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf0bfff700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 0x7fdf0c0ff7b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00b580 tx=0x7fdefc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc01d070 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf127eb700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1a54f0 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdefc00fb30 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf127eb700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1a5910 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.555+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc022c20 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.556+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdeec000fc0 con 0x7fdf0c068a90 2023-10-08T13:26:25.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.557+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fdefc00fca0 con 0x7fdf0c068a90 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.557+0000 7fdf097fa700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdef40a1560 0x7fdef40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf0b7fe700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdef40a1560 0x7fdef40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdefc0ce700 con 0x7fdf0c068a90 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf097fa700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] conn(0x7fdef40ac710 0x7fdef40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdef40af280 con 0x7fdef40ac710 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc0ceb10 con 0x7fdf0c068a90 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf0b7fe700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdef40a1560 0x7fdef40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c100ee0 tx=0x7fdf0000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.558+0000 7fdf10d88700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] conn(0x7fdef40ac710 0x7fdef40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.559+0000 7fdf10d88700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] conn(0x7fdef40ac710 0x7fdef40aebb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.559+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== osd.10 v2:172.21.15.155:6824/1252167532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdef40af280 con 0x7fdef40ac710 2023-10-08T13:26:25.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.576+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 --> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdeec002d40 con 0x7fdef40ac710 2023-10-08T13:26:25.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdf097fa700 1 -- 172.21.15.139:0/1718962636 <== osd.10 v2:172.21.15.155:6824/1252167532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdeec002d40 con 0x7fdef40ac710 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] conn(0x7fdef40ac710 msgr2=0x7fdef40aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] conn(0x7fdef40ac710 0x7fdef40aebb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdef40a1560 msgr2=0x7fdef40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdef40a1560 0x7fdef40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c100ee0 tx=0x7fdf0000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 msgr2=0x7fdf0c0ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 --2- 172.21.15.139:0/1718962636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf0c068a90 0x7fdf0c0ff7b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00b580 tx=0x7fdefc004730 comp rx=0 tx=0).stop 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdf10d88700 1 -- 172.21.15.139:0/1718962636 reap_dead start 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 shutdown_connections 2023-10-08T13:26:25.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.577+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 >> 172.21.15.139:0/1718962636 conn(0x7fdf0c0766c0 msgr2=0x7fdf0c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:25.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.578+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 shutdown_connections 2023-10-08T13:26:25.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.578+0000 7fdef2ffd700 1 -- 172.21.15.139:0/1718962636 wait complete. 2023-10-08T13:26:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 -- 172.21.15.139:0/3004552833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf41056b0 msgr2=0x7f5cf4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/3004552833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf41056b0 0x7f5cf4105a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009990 tx=0x7f5cf0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 -- 172.21.15.139:0/3004552833 shutdown_connections 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/3004552833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf4100110 0x7f5cf410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/3004552833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf41056b0 0x7f5cf4105a90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/3004552833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf40ff750 0x7f5cf40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 -- 172.21.15.139:0/3004552833 >> 172.21.15.139:0/3004552833 conn(0x7f5cf4075790 msgr2=0x7f5cf4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.588+0000 7f5cfbe78700 1 -- 172.21.15.139:0/3004552833 shutdown_connections 2023-10-08T13:26:25.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 -- 172.21.15.139:0/3004552833 wait complete. 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 Processor -- start 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 -- start start 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf40ff750 0x7f5cf4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 0x7f5cf4197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf41056b0 0x7f5cf41a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf41987f0 con 0x7f5cf4100110 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf41a3020 con 0x7f5cf40ff750 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cfbe78700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf41a3160 con 0x7f5cf41056b0 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cf9413700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 0x7f5cf4197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cf9413700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 0x7f5cf4197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38884/0 (socket says 172.21.15.139:38884) 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.589+0000 7f5cf9413700 1 -- 172.21.15.139:0/4026342097 learned_addr learned my addr 172.21.15.139:0/4026342097 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9c14700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf40ff750 0x7f5cf4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cfa415700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf41056b0 0x7f5cf41a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 -- 172.21.15.139:0/4026342097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf41056b0 msgr2=0x7f5cf41a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf41056b0 0x7f5cf41a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 -- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf40ff750 msgr2=0x7f5cf4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cf40ff750 0x7f5cf4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00095f0 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cf9413700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 0x7f5cf4197fa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d9b0 tx=0x7f5ce400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4009b40 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ce400be80 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40054b0 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf41a33c0 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.590+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf41a3870 con 0x7f5cf4100110 2023-10-08T13:26:25.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.591+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cf410f920 con 0x7f5cf4100110 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.593+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f5ce4005610 con 0x7f5cf4100110 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.593+0000 7f5ceaffd700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ce00a1560 0x7f5ce00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.593+0000 7f5cf9c14700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ce00a1560 0x7f5ce00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.593+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ce40cd800 con 0x7f5cf4100110 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5ceaffd700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] conn(0x7f5ce00ac710 0x7f5ce00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ce00af280 con 0x7f5ce00ac710 2023-10-08T13:26:25.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce40cdc10 con 0x7f5cf4100110 2023-10-08T13:26:25.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5cf9c14700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ce00a1560 0x7f5ce00a3a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0006010 tx=0x7f5cf000b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5cfa415700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] conn(0x7f5ce00ac710 0x7f5ce00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:25.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.594+0000 7f5cfa415700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] conn(0x7f5ce00ac710 0x7f5ce00aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:25.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.595+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== osd.4 v2:172.21.15.155:6808/3389759441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5ce00af280 con 0x7f5ce00ac710 2023-10-08T13:26:25.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.613+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 --> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cf4060e70 con 0x7f5ce00ac710 2023-10-08T13:26:25.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.614+0000 7f5ceaffd700 1 -- 172.21.15.139:0/4026342097 <== osd.4 v2:172.21.15.155:6808/3389759441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5cf4060e70 con 0x7f5ce00ac710 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] conn(0x7f5ce00ac710 msgr2=0x7f5ce00aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] conn(0x7f5ce00ac710 0x7f5ce00aebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ce00a1560 msgr2=0x7f5ce00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ce00a1560 0x7f5ce00a3a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0006010 tx=0x7f5cf000b260 comp rx=0 tx=0).stop 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 msgr2=0x7f5cf4197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 --2- 172.21.15.139:0/4026342097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cf4100110 0x7f5cf4197fa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d9b0 tx=0x7f5ce400dd70 comp rx=0 tx=0).stop 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfa415700 1 -- 172.21.15.139:0/4026342097 reap_dead start 2023-10-08T13:26:25.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 shutdown_connections 2023-10-08T13:26:25.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 >> 172.21.15.139:0/4026342097 conn(0x7f5cf4075790 msgr2=0x7f5cf40fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:25.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 shutdown_connections 2023-10-08T13:26:25.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:25.615+0000 7f5cfbe78700 1 -- 172.21.15.139:0/4026342097 wait complete. 2023-10-08T13:26:25.674 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:25.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:25 smithi139 ceph-mon[99506]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:26:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:25 smithi187 ceph-mon[104336]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:26:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:25 smithi155 ceph-mon[103467]: pgmap v265: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T13:26:26.626 INFO:teuthology.orchestra.run.smithi139.stdout:38654705730 2023-10-08T13:26:26.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 -- 172.21.15.139:0/4104199279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 msgr2=0x7fccdc100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 --2- 172.21.15.139:0/4104199279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc100d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009990 tx=0x7fcccc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 -- 172.21.15.139:0/4104199279 shutdown_connections 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 --2- 172.21.15.139:0/4104199279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccdc101260 0x7fccdc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 --2- 172.21.15.139:0/4104199279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccdc1057c0 0x7fccdc105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 --2- 172.21.15.139:0/4104199279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc100d20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 -- 172.21.15.139:0/4104199279 >> 172.21.15.139:0/4104199279 conn(0x7fccdc0779e0 msgr2=0x7fccdc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 -- 172.21.15.139:0/4104199279 shutdown_connections 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 -- 172.21.15.139:0/4104199279 wait complete. 2023-10-08T13:26:26.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.192+0000 7fcce34fd700 1 Processor -- start 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 -- start start 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccdc101260 0x7fccdc19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccdc1057c0 0x7fccdc196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc197090 con 0x7fccdc1008a0 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc197200 con 0x7fccdc1057c0 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce34fd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1973c0 con 0x7fccdc101260 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38898/0 (socket says 172.21.15.139:38898) 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 -- 172.21.15.139:0/3208671729 learned_addr learned my addr 172.21.15.139:0/3208671729 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce0a98700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccdc101260 0x7fccdc19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:26.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1a9a700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccdc1057c0 0x7fccdc196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 -- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccdc101260 msgr2=0x7fccdc19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fccdc101260 0x7fccdc19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 -- 172.21.15.139:0/3208671729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccdc1057c0 msgr2=0x7fccdc196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccdc1057c0 0x7fccdc196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0095f0 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fcce1299700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc19c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fccd800e970 tx=0x7fccd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.193+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8009790 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.194+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fccd800eec0 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.194+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc1976a0 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.194+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd8003cf0 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.194+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1a38e0 con 0x7fccdc1008a0 2023-10-08T13:26:26.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.194+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccdc110a30 con 0x7fccdc1008a0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fccd800ccd0 con 0x7fccdc1008a0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fccc80a15e0 0x7fccc80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fcce0a98700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fccc80a15e0 0x7fccc80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fccd8014070 con 0x7fccdc1008a0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] conn(0x7fccc80ac790 0x7fccc80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccc80af300 con 0x7fccc80ac790 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.196+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccd80cd9a0 con 0x7fccdc1008a0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.197+0000 7fcce0a98700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fccc80a15e0 0x7fccc80a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00b2e0 tx=0x7fcccc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.197+0000 7fcce1a9a700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] conn(0x7fccc80ac790 0x7fccc80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:26.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.197+0000 7fcce1a9a700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] conn(0x7fccc80ac790 0x7fccc80aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.198+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== osd.2 v2:172.21.15.187:6800/3332520457 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fccc80af300 con 0x7fccc80ac790 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.214+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 --> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccdc060ef0 con 0x7fccc80ac790 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fccd27fc700 1 -- 172.21.15.139:0/3208671729 <== osd.2 v2:172.21.15.187:6800/3332520457 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fccdc060ef0 con 0x7fccc80ac790 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] conn(0x7fccc80ac790 msgr2=0x7fccc80aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] conn(0x7fccc80ac790 0x7fccc80aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fccc80a15e0 msgr2=0x7fccc80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fccc80a15e0 0x7fccc80a3aa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00b2e0 tx=0x7fcccc005960 comp rx=0 tx=0).stop 2023-10-08T13:26:26.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 msgr2=0x7fccdc19c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 --2- 172.21.15.139:0/3208671729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccdc1008a0 0x7fccdc19c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fccd800e970 tx=0x7fccd800ec80 comp rx=0 tx=0).stop 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce1a9a700 1 -- 172.21.15.139:0/3208671729 reap_dead start 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 shutdown_connections 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 >> 172.21.15.139:0/3208671729 conn(0x7fccdc0779e0 msgr2=0x7fccdc0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 shutdown_connections 2023-10-08T13:26:26.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:26.215+0000 7fcce34fd700 1 -- 172.21.15.139:0/3208671729 wait complete. 2023-10-08T13:26:26.779 INFO:teuthology.orchestra.run.smithi139.stdout:141733920819 2023-10-08T13:26:26.779 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-08T13:26:27.211 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:27.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:27 smithi139 ceph-mon[99506]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:26:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:27 smithi187 ceph-mon[104336]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:26:28.083 INFO:teuthology.orchestra.run.smithi139.stdout:304942678042 2023-10-08T13:26:28.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-08T13:26:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:27 smithi155 ceph-mon[103467]: pgmap v266: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2023-10-08T13:26:29.207 INFO:teuthology.orchestra.run.smithi139.stdout:81604378683 2023-10-08T13:26:29.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-08T13:26:29.359 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:29.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 -- 172.21.15.139:0/2343853361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b01068e0 msgr2=0x7f53b0106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 --2- 172.21.15.139:0/2343853361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b01068e0 0x7f53b0106cc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f53a40099c0 tx=0x7f53a4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 -- 172.21.15.139:0/2343853361 shutdown_connections 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 --2- 172.21.15.139:0/2343853361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b00698a0 0x7f53b010d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 --2- 172.21.15.139:0/2343853361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b01068e0 0x7f53b0106cc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 --2- 172.21.15.139:0/2343853361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53b0068ee0 0x7f53b0069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 -- 172.21.15.139:0/2343853361 >> 172.21.15.139:0/2343853361 conn(0x7f53b00765b0 msgr2=0x7f53b00769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 -- 172.21.15.139:0/2343853361 shutdown_connections 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.486+0000 7f53b6fec700 1 -- 172.21.15.139:0/2343853361 wait complete. 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 Processor -- start 2023-10-08T13:26:29.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 -- start start 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 0x7f53b019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53b00698a0 0x7f53b019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b01068e0 0x7f53b0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0197110 con 0x7f53b0068ee0 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0197280 con 0x7f53b00698a0 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b6fec700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0197440 con 0x7f53b01068e0 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 0x7f53b019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 0x7f53b019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38910/0 (socket says 172.21.15.139:38910) 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 -- 172.21.15.139:0/988407936 learned_addr learned my addr 172.21.15.139:0/988407936 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53affff700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53b00698a0 0x7f53b019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b5589700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b01068e0 0x7f53b0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 -- 172.21.15.139:0/988407936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b01068e0 msgr2=0x7f53b0196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53b01068e0 0x7f53b0196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 -- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53b00698a0 msgr2=0x7f53b019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53b00698a0 0x7f53b019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.487+0000 7f53b4d88700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40095f0 con 0x7f53b0068ee0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53b4d88700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 0x7f53b019c970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53a400b580 tx=0x7f53a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a401d070 con 0x7f53b0068ee0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a400fb30 con 0x7f53b0068ee0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4022c80 con 0x7f53b0068ee0 2023-10-08T13:26:29.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b01976c0 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.488+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b01a3960 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.489+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53b0110a10 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.490+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f53a400fca0 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53adffb700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f53a00a1560 0x7f53a00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53affff700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f53a00a1560 0x7f53a00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f53a40ce6f0 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53adffb700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] conn(0x7f53a00ac710 0x7f53a00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53a00af280 con 0x7f53a00ac710 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53a40ceb00 con 0x7f53b0068ee0 2023-10-08T13:26:29.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53affff700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f53a00a1560 0x7f53a00a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53b0197c70 tx=0x7f539c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.491+0000 7f53b5589700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] conn(0x7f53a00ac710 0x7f53a00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.492+0000 7f53b5589700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] conn(0x7f53a00ac710 0x7f53a00aebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.492+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== osd.7 v2:172.21.15.155:6816/1735491118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f53a00af280 con 0x7f53a00ac710 2023-10-08T13:26:29.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.508+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 --> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53b0060e70 con 0x7f53a00ac710 2023-10-08T13:26:29.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53adffb700 1 -- 172.21.15.139:0/988407936 <== osd.7 v2:172.21.15.155:6816/1735491118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f53b0060e70 con 0x7f53a00ac710 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] conn(0x7f53a00ac710 msgr2=0x7f53a00aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] conn(0x7f53a00ac710 0x7f53a00aebb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f53a00a1560 msgr2=0x7f53a00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f53a00a1560 0x7f53a00a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53b0197c70 tx=0x7f539c00b410 comp rx=0 tx=0).stop 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 msgr2=0x7f53b019c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b6fec700 1 --2- 172.21.15.139:0/988407936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0068ee0 0x7f53b019c970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f53a400b580 tx=0x7f53a4004730 comp rx=0 tx=0).stop 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.509+0000 7f53b5589700 1 -- 172.21.15.139:0/988407936 reap_dead start 2023-10-08T13:26:29.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.510+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 shutdown_connections 2023-10-08T13:26:29.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.510+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 >> 172.21.15.139:0/988407936 conn(0x7f53b00765b0 msgr2=0x7f53b00fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:29.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.510+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 shutdown_connections 2023-10-08T13:26:29.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.510+0000 7f53b6fec700 1 -- 172.21.15.139:0/988407936 wait complete. 2023-10-08T13:26:29.518 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:29.521 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:29.554 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:29.627 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:29.817 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:29 smithi139 ceph-mon[99506]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 -- 172.21.15.139:0/1873289606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc0ff190 msgr2=0x7f7bdc0ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/1873289606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc0ff190 0x7f7bdc0ff5f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009990 tx=0x7f7bd0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 -- 172.21.15.139:0/1873289606 shutdown_connections 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/1873289606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bdc0ffb30 0x7f7bdc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/1873289606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/1873289606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc0ff190 0x7f7bdc0ff5f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 -- 172.21.15.139:0/1873289606 >> 172.21.15.139:0/1873289606 conn(0x7f7bdc074a10 msgr2=0x7f7bdc074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 -- 172.21.15.139:0/1873289606 shutdown_connections 2023-10-08T13:26:29.899 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.772+0000 7f7be3c7e700 1 -- 172.21.15.139:0/1873289606 wait complete. 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 Processor -- start 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 -- start start 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bdc0ff190 0x7f7bdc19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bdc0ffb30 0x7f7bdc19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc197080 con 0x7f7bdc1058d0 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc1971f0 con 0x7f7bdc0ff190 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be3c7e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc1973b0 con 0x7f7bdc0ffb30 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be221b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be221b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38930/0 (socket says 172.21.15.139:38930) 2023-10-08T13:26:29.900 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be221b700 1 -- 172.21.15.139:0/4235174949 learned_addr learned my addr 172.21.15.139:0/4235174949 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be1219700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bdc0ffb30 0x7f7bdc19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.773+0000 7f7be1a1a700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bdc0ff190 0x7f7bdc19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 -- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bdc0ffb30 msgr2=0x7f7bdc19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bdc0ffb30 0x7f7bdc19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 -- 172.21.15.139:0/4235174949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bdc0ff190 msgr2=0x7f7bdc19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7bdc0ff190 0x7f7bdc19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00095f0 con 0x7f7bdc1058d0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be221b700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc196a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400e970 tx=0x7f7bd400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4009750 con 0x7f7bdc1058d0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc197690 con 0x7f7bdc1058d0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bd4005020 con 0x7f7bdc1058d0 2023-10-08T13:26:29.901 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400cba0 con 0x7f7bdc1058d0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.774+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1a38d0 con 0x7f7bdc1058d0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.775+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bdc1109a0 con 0x7f7bdc1058d0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.776+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7bd400cd00 con 0x7f7bdc1058d0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.776+0000 7f7bdaffd700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7bc40a1560 0x7f7bc40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7be1a1a700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7bc40a1560 0x7f7bc40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f7bd4014070 con 0x7f7bdc1058d0 2023-10-08T13:26:29.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7bdaffd700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] conn(0x7f7bc40ac710 0x7f7bc40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7bc40af280 con 0x7f7bc40ac710 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bd40cdab0 con 0x7f7bdc1058d0 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7be1a1a700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7bc40a1560 0x7f7bc40a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc068160 tx=0x7f7bcc00b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7be1219700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] conn(0x7f7bc40ac710 0x7f7bc40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.777+0000 7f7be1219700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] conn(0x7f7bc40ac710 0x7f7bc40aebb0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.778+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== osd.11 v2:172.21.15.187:6824/599992854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7bc40af280 con 0x7f7bc40ac710 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.794+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 --> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bdc060ef0 con 0x7f7bc40ac710 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7bdaffd700 1 -- 172.21.15.139:0/4235174949 <== osd.11 v2:172.21.15.187:6824/599992854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7bdc060ef0 con 0x7f7bc40ac710 2023-10-08T13:26:29.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] conn(0x7f7bc40ac710 msgr2=0x7f7bc40aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] conn(0x7f7bc40ac710 0x7f7bc40aebb0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7bc40a1560 msgr2=0x7f7bc40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7bc40a1560 0x7f7bc40a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc068160 tx=0x7f7bcc00b040 comp rx=0 tx=0).stop 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 msgr2=0x7f7bdc196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 --2- 172.21.15.139:0/4235174949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bdc1058d0 0x7f7bdc196a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400e970 tx=0x7f7bd400ec80 comp rx=0 tx=0).stop 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be221b700 1 -- 172.21.15.139:0/4235174949 reap_dead start 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 shutdown_connections 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 >> 172.21.15.139:0/4235174949 conn(0x7f7bdc074a10 msgr2=0x7f7bdc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 shutdown_connections 2023-10-08T13:26:29.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.795+0000 7f7be3c7e700 1 -- 172.21.15.139:0/4235174949 wait complete. 2023-10-08T13:26:29.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:29 smithi187 ceph-mon[104336]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:26:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:29 smithi155 ceph-mon[103467]: pgmap v267: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 -- 172.21.15.139:0/2020358879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 msgr2=0x7f01a810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/2020358879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a810d5c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f01a000b0a0 tx=0x7f01a000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 -- 172.21.15.139:0/2020358879 shutdown_connections 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/2020358879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a810d5c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/2020358879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a81058d0 0x7f01a8105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/2020358879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a80ff190 0x7f01a80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 -- 172.21.15.139:0/2020358879 >> 172.21.15.139:0/2020358879 conn(0x7f01a8074a10 msgr2=0x7f01a8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:30.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 -- 172.21.15.139:0/2020358879 shutdown_connections 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.958+0000 7f01ad2ac700 1 -- 172.21.15.139:0/2020358879 wait complete. 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 Processor -- start 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 -- start start 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a80ff190 0x7f01a8100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a81058d0 0x7f01a8100df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81a4f50 con 0x7f01a80ffb30 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81a50c0 con 0x7f01a81058d0 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01ad2ac700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81a5280 con 0x7f01a80ff190 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01a67fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:30.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01a67fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38944/0 (socket says 172.21.15.139:38944) 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01a67fc700 1 -- 172.21.15.139:0/344323092 learned_addr learned my addr 172.21.15.139:0/344323092 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.959+0000 7f01a77fe700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a81058d0 0x7f01a8100df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a6ffd700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a80ff190 0x7f01a8100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 -- 172.21.15.139:0/344323092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a80ff190 msgr2=0x7f01a8100370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a80ff190 0x7f01a8100370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 -- 172.21.15.139:0/344323092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a81058d0 msgr2=0x7f01a8100df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a81058d0 0x7f01a8100df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 -- 172.21.15.139:0/344323092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0009d00 con 0x7f01a80ffb30 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01a67fc700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c9b0 tx=0x7f019c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:30.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c007b00 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f019c007c60 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a81a5560 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c018660 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.960+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a81a5a60 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.961+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8067c30 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.962+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f019c00f450 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.962+0000 7f018ffff700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 0x7f01900a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.963+0000 7f01a6ffd700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 0x7f01900a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.963+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f019c0cd570 con 0x7f01a80ffb30 2023-10-08T13:26:30.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.963+0000 7f01a6ffd700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 0x7f01900a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01a8068160 tx=0x7f0198005d70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:29.966+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f019c0966b0 con 0x7f01a80ffb30 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.164+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f01a804e4c0 con 0x7f01a80ffb30 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.164+0000 7f018ffff700 1 -- 172.21.15.139:0/344323092 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f019c099cd0 con 0x7f01a80ffb30 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stdout:197568495658 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 msgr2=0x7f01900a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:30.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 0x7f01900a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f01a8068160 tx=0x7f0198005d70 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 msgr2=0x7f01a81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c9b0 tx=0x7f019c00ccc0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 shutdown_connections 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f01900a1560 0x7f01900a3a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01a81058d0 0x7f01a8100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01a80ff190 0x7f01a8100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 --2- 172.21.15.139:0/344323092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01a80ffb30 0x7f01a81008b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.166+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 >> 172.21.15.139:0/344323092 conn(0x7f01a8074a10 msgr2=0x7f01a80fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.167+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 shutdown_connections 2023-10-08T13:26:30.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:30.167+0000 7f01ad2ac700 1 -- 172.21.15.139:0/344323092 wait complete. 2023-10-08T13:26:30.230 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:30.584 INFO:teuthology.orchestra.run.smithi139.stdout:219043332135 2023-10-08T13:26:30.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-08T13:26:30.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:30 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/344323092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:26:30.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:30 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/344323092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:26:31.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:30 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/344323092' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T13:26:31.326 INFO:teuthology.orchestra.run.smithi139.stdout:335007449110 2023-10-08T13:26:31.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-08T13:26:31.597 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:31 smithi139 ceph-mon[99506]: pgmap v268: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:31 smithi187 ceph-mon[104336]: pgmap v268: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.083+0000 7f1581435700 1 -- 172.21.15.139:0/1206283079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 msgr2=0x7f157c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.083+0000 7f1581435700 1 --2- 172.21.15.139:0/1206283079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c10c580 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f156c009990 tx=0x7f156c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 -- 172.21.15.139:0/1206283079 shutdown_connections 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 --2- 172.21.15.139:0/1206283079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c10c580 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 --2- 172.21.15.139:0/1206283079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c1056b0 0x7f157c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 --2- 172.21.15.139:0/1206283079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f157c0ff750 0x7f157c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 -- 172.21.15.139:0/1206283079 >> 172.21.15.139:0/1206283079 conn(0x7f157c075790 msgr2=0x7f157c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 -- 172.21.15.139:0/1206283079 shutdown_connections 2023-10-08T13:26:32.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 -- 172.21.15.139:0/1206283079 wait complete. 2023-10-08T13:26:32.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.084+0000 7f1581435700 1 Processor -- start 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 -- start start 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c0ff750 0x7f157c197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f157c1056b0 0x7f157c1a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1987c0 con 0x7f157c100110 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1a2f50 con 0x7f157c0ff750 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f1581435700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c1a30c0 con 0x7f157c1056b0 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38956/0 (socket says 172.21.15.139:38956) 2023-10-08T13:26:32.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 -- 172.21.15.139:0/69964565 learned_addr learned my addr 172.21.15.139:0/69964565 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157affd700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c0ff750 0x7f157c197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157b7fe700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f157c1056b0 0x7f157c1a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 -- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f157c1056b0 msgr2=0x7f157c1a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f157c1056b0 0x7f157c1a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 -- 172.21.15.139:0/69964565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c0ff750 msgr2=0x7f157c197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c0ff750 0x7f157c197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157a7fc700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0095f0 con 0x7f157c100110 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.085+0000 7f157affd700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f157c0ff750 0x7f157c197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f157a7fc700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c197ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f156400d950 tx=0x7f156400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:32.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564009940 con 0x7f157c100110 2023-10-08T13:26:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c1a3340 con 0x7f157c100110 2023-10-08T13:26:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1564010460 con 0x7f157c100110 2023-10-08T13:26:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400f620 con 0x7f157c100110 2023-10-08T13:26:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c1a3840 con 0x7f157c100110 2023-10-08T13:26:32.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.086+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f157c10f910 con 0x7f157c100110 2023-10-08T13:26:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.088+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f15640108d0 con 0x7f157c100110 2023-10-08T13:26:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.088+0000 7f1573fff700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15680a1560 0x7f15680a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.088+0000 7f157affd700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15680a1560 0x7f15680a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.088+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f15640cd660 con 0x7f157c100110 2023-10-08T13:26:32.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f1573fff700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] conn(0x7f15680ac710 0x7f15680aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15680af280 con 0x7f15680ac710 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15640cda70 con 0x7f157c100110 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f157affd700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15680a1560 0x7f15680a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1574007fd0 tx=0x7f1574009040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f157b7fe700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] conn(0x7f15680ac710 0x7f15680aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.089+0000 7f157b7fe700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] conn(0x7f15680ac710 0x7f15680aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:32.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.090+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== osd.5 v2:172.21.15.187:6808/247670329 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f15680af280 con 0x7f15680ac710 2023-10-08T13:26:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:31 smithi155 ceph-mon[103467]: pgmap v268: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:32.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.106+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 --> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f157c060e70 con 0x7f15680ac710 2023-10-08T13:26:32.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1573fff700 1 -- 172.21.15.139:0/69964565 <== osd.5 v2:172.21.15.187:6808/247670329 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f157c060e70 con 0x7f15680ac710 2023-10-08T13:26:32.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] conn(0x7f15680ac710 msgr2=0x7f15680aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] conn(0x7f15680ac710 0x7f15680aebb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:32.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15680a1560 msgr2=0x7f15680a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15680a1560 0x7f15680a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1574007fd0 tx=0x7f1574009040 comp rx=0 tx=0).stop 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 msgr2=0x7f157c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 --2- 172.21.15.139:0/69964565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157c100110 0x7f157c197ed0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f156400d950 tx=0x7f156400dc60 comp rx=0 tx=0).stop 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f157b7fe700 1 -- 172.21.15.139:0/69964565 reap_dead start 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 shutdown_connections 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 >> 172.21.15.139:0/69964565 conn(0x7f157c075790 msgr2=0x7f157c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 shutdown_connections 2023-10-08T13:26:32.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:32.107+0000 7f1581435700 1 -- 172.21.15.139:0/69964565 wait complete. 2023-10-08T13:26:32.675 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495657 got 197568495658 for osd.6 2023-10-08T13:26:32.676 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 -- 172.21.15.139:0/1647683153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c0ff750 msgr2=0x7ff30c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 --2- 172.21.15.139:0/1647683153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c0ff750 0x7ff30c0ffbd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009a10 tx=0x7ff2f8009d20 comp rx=0 tx=0).stop 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 -- 172.21.15.139:0/1647683153 shutdown_connections 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 --2- 172.21.15.139:0/1647683153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c100110 0x7ff30c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 --2- 172.21.15.139:0/1647683153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 --2- 172.21.15.139:0/1647683153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c0ff750 0x7ff30c0ffbd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 -- 172.21.15.139:0/1647683153 >> 172.21.15.139:0/1647683153 conn(0x7ff30c075790 msgr2=0x7ff30c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 -- 172.21.15.139:0/1647683153 shutdown_connections 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.392+0000 7ff313043700 1 -- 172.21.15.139:0/1647683153 wait complete. 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 Processor -- start 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 -- start start 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c0ff750 0x7ff30c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c19dca0 con 0x7ff30c100110 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c19de10 con 0x7ff30c0ff750 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff313043700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c19dfd0 con 0x7ff30c1056b0 2023-10-08T13:26:33.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38972/0 (socket says 172.21.15.139:38972) 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 -- 172.21.15.139:0/2928766971 learned_addr learned my addr 172.21.15.139:0/2928766971 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff310ddf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c0ff750 0x7ff30c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff3115e0700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 -- 172.21.15.139:0/2928766971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 msgr2=0x7ff30c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 -- 172.21.15.139:0/2928766971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c0ff750 msgr2=0x7ff30c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c0ff750 0x7ff30c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff30bfff700 1 -- 172.21.15.139:0/2928766971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80095f0 con 0x7ff30c100110 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.393+0000 7ff3115e0700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff30bfff700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8018040 tx=0x7ff2f8003b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:33.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800bb60 con 0x7ff30c100110 2023-10-08T13:26:33.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2f8005da0 con 0x7ff30c100110 2023-10-08T13:26:33.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8010440 con 0x7ff30c100110 2023-10-08T13:26:33.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c19e250 con 0x7ff30c100110 2023-10-08T13:26:33.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.394+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1a5b10 con 0x7ff30c100110 2023-10-08T13:26:33.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.395+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c107c40 con 0x7ff30c100110 2023-10-08T13:26:33.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.396+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff2f801f440 con 0x7ff30c100110 2023-10-08T13:26:33.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.397+0000 7ff309ffb700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 0x7ff2fc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:33.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.397+0000 7ff310ddf700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 0x7ff2fc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:33.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.397+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff2f80cfc70 con 0x7ff30c100110 2023-10-08T13:26:33.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.397+0000 7ff310ddf700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 0x7ff2fc0a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff300005950 tx=0x7ff30000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:33.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.400+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff2f8062100 con 0x7ff30c100110 2023-10-08T13:26:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.603+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff30c100df0 con 0x7ff30c100110 2023-10-08T13:26:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.604+0000 7ff309ffb700 1 -- 172.21.15.139:0/2928766971 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2f8098ec0 con 0x7ff30c100110 2023-10-08T13:26:33.605 INFO:teuthology.orchestra.run.smithi139.stdout:111669149752 2023-10-08T13:26:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 msgr2=0x7ff2fc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 0x7ff2fc0a3aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff300005950 tx=0x7ff30000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:33.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 msgr2=0x7ff30c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8018040 tx=0x7ff2f8003b10 comp rx=0 tx=0).stop 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 shutdown_connections 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff2fc0a15e0 0x7ff2fc0a3aa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff30c1056b0 0x7ff30c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff30c0ff750 0x7ff30c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 --2- 172.21.15.139:0/2928766971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff30c100110 0x7ff30c199330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 >> 172.21.15.139:0/2928766971 conn(0x7ff30c075790 msgr2=0x7ff30c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 shutdown_connections 2023-10-08T13:26:33.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.606+0000 7ff313043700 1 -- 172.21.15.139:0/2928766971 wait complete. 2023-10-08T13:26:33.903 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:33 smithi139 ceph-mon[99506]: pgmap v269: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:33.903 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2928766971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:26:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:33 smithi187 ceph-mon[104336]: pgmap v269: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2928766971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:26:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:33 smithi155 ceph-mon[103467]: pgmap v269: 129 pgs: 129 active+clean; 639 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:26:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2928766971' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T13:26:34.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 -- 172.21.15.139:0/1919693707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0100e70 msgr2=0x7f3ce01043b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 --2- 172.21.15.139:0/1919693707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0100e70 0x7f3ce01043b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009990 tx=0x7f3cd0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 -- 172.21.15.139:0/1919693707 shutdown_connections 2023-10-08T13:26:34.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 --2- 172.21.15.139:0/1919693707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce0104ae0 0x7f3ce010c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 --2- 172.21.15.139:0/1919693707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce01004c0 0x7f3ce01008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 --2- 172.21.15.139:0/1919693707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0100e70 0x7f3ce01043b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 -- 172.21.15.139:0/1919693707 >> 172.21.15.139:0/1919693707 conn(0x7f3ce0074aa0 msgr2=0x7f3ce0074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 -- 172.21.15.139:0/1919693707 shutdown_connections 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.952+0000 7f3ce6375700 1 -- 172.21.15.139:0/1919693707 wait complete. 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 Processor -- start 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 -- start start 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce01004c0 0x7f3ce0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0100e70 0x7f3ce0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce01a5080 con 0x7f3ce0104ae0 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce01a51f0 con 0x7f3ce01004c0 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce6375700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce01a53b0 con 0x7f3ce0100e70 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38986/0 (socket says 172.21.15.139:38986) 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 -- 172.21.15.139:0/3038771402 learned_addr learned my addr 172.21.15.139:0/3038771402 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3cdffff700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce01004c0 0x7f3ce0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3cdf7fe700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0100e70 0x7f3ce0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 -- 172.21.15.139:0/3038771402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0100e70 msgr2=0x7f3ce0195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0100e70 0x7f3ce0195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 -- 172.21.15.139:0/3038771402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce01004c0 msgr2=0x7f3ce0195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce01004c0 0x7f3ce0195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.953+0000 7f3ce4912700 1 -- 172.21.15.139:0/3038771402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00095f0 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3ce4912700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8007ee0 tx=0x7f3cd800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8017070 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cd800f040 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce01a5690 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8005580 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.954+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce01a5b60 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.955+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0107d20 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.956+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f3cd800db20 con 0x7f3ce0104ae0 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.956+0000 7f3cdd7fa700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 0x7f3ccc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.957+0000 7f3cdffff700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 0x7f3ccc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.957+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3cd80cc950 con 0x7f3ce0104ae0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.957+0000 7f3cdffff700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 0x7f3ccc0a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8005950 tx=0x7f3cc800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:33.961+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3cd8095a60 con 0x7f3ce0104ae0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.169+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ce0068a40 con 0x7f3ce0104ae0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.169+0000 7f3cdd7fa700 1 -- 172.21.15.139:0/3038771402 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cd8099080 con 0x7f3ce0104ae0 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stdout:60129542208 2023-10-08T13:26:34.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.171+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 msgr2=0x7f3ccc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 0x7f3ccc0a3aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8005950 tx=0x7f3cc800b410 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 msgr2=0x7f3ce01963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8007ee0 tx=0x7f3cd800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 shutdown_connections 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ccc0a15e0 0x7f3ccc0a3aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3ce0104ae0 0x7f3ce01963b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ce01004c0 0x7f3ce0195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 --2- 172.21.15.139:0/3038771402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ce0100e70 0x7f3ce0195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 >> 172.21.15.139:0/3038771402 conn(0x7f3ce0074aa0 msgr2=0x7f3ce00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 shutdown_connections 2023-10-08T13:26:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.172+0000 7f3ce6375700 1 -- 172.21.15.139:0/3038771402 wait complete. 2023-10-08T13:26:34.485 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:34.519 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149750 got 111669149752 for osd.3 2023-10-08T13:26:34.520 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 -- 172.21.15.139:0/4246504692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf501057b0 msgr2=0x7fdf50105b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 --2- 172.21.15.139:0/4246504692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf501057b0 0x7fdf50105b90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009990 tx=0x7fdf3c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 -- 172.21.15.139:0/4246504692 shutdown_connections 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 --2- 172.21.15.139:0/4246504692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf50100400 0x7fdf5010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 --2- 172.21.15.139:0/4246504692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf501057b0 0x7fdf50105b90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 --2- 172.21.15.139:0/4246504692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf500ffa40 0x7fdf500ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 -- 172.21.15.139:0/4246504692 >> 172.21.15.139:0/4246504692 conn(0x7fdf500764a0 msgr2=0x7fdf500768b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:34.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 -- 172.21.15.139:0/4246504692 shutdown_connections 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.879+0000 7fdf56095700 1 -- 172.21.15.139:0/4246504692 wait complete. 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.880+0000 7fdf56095700 1 Processor -- start 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.880+0000 7fdf56095700 1 -- start start 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.880+0000 7fdf56095700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 0x7fdf50195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 0x7fdf501962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a4f70 con 0x7fdf500ffa40 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a50e0 con 0x7fdf501057b0 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a52a0 con 0x7fdf50100400 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:38996/0 (socket says 172.21.15.139:38996) 2023-10-08T13:26:34.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 -- 172.21.15.139:0/3900587992 learned_addr learned my addr 172.21.15.139:0/3900587992 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4ffff700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 0x7fdf501962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4effd700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 0x7fdf50195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 -- 172.21.15.139:0/3900587992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 msgr2=0x7fdf50195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 0x7fdf50195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 -- 172.21.15.139:0/3900587992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 msgr2=0x7fdf501962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 0x7fdf501962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 -- 172.21.15.139:0/3900587992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c0095f0 con 0x7fdf500ffa40 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4ffff700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 0x7fdf501962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4effd700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 0x7fdf50195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4f7fe700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000c00 tx=0x7fdf3c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:34.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c01d070 con 0x7fdf500ffa40 2023-10-08T13:26:34.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf3c022470 con 0x7fdf500ffa40 2023-10-08T13:26:34.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c017650 con 0x7fdf500ffa40 2023-10-08T13:26:34.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf501a5520 con 0x7fdf500ffa40 2023-10-08T13:26:34.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.881+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf501a59c0 con 0x7fdf500ffa40 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.882+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf50107c60 con 0x7fdf500ffa40 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.884+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fdf3c0225e0 con 0x7fdf500ffa40 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.884+0000 7fdf4cff9700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 0x7fdf340a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.884+0000 7fdf4effd700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 0x7fdf340a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.884+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdf3c0ceba0 con 0x7fdf500ffa40 2023-10-08T13:26:34.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.885+0000 7fdf4effd700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 0x7fdf340a3aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf40005fd0 tx=0x7fdf40005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:34.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:34.887+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf3c097d40 con 0x7fdf500ffa40 2023-10-08T13:26:34.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3038771402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:26:34.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3038771402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:26:35.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3038771402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T13:26:35.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.110+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdf500694a0 con 0x7fdf500ffa40 2023-10-08T13:26:35.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.110+0000 7fdf4cff9700 1 -- 172.21.15.139:0/3900587992 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf3c09b360 con 0x7fdf500ffa40 2023-10-08T13:26:35.112 INFO:teuthology.orchestra.run.smithi139.stdout:38654705732 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 msgr2=0x7fdf340a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 0x7fdf340a3aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf40005fd0 tx=0x7fdf40005dc0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 msgr2=0x7fdf50195820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c000c00 tx=0x7fdf3c005ef0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 shutdown_connections 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf340a15e0 0x7fdf340a3aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf501057b0 0x7fdf501962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf500ffa40 0x7fdf50195820 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 --2- 172.21.15.139:0/3900587992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf50100400 0x7fdf50195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 >> 172.21.15.139:0/3900587992 conn(0x7fdf500764a0 msgr2=0x7fdf500fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 shutdown_connections 2023-10-08T13:26:35.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.113+0000 7fdf56095700 1 -- 172.21.15.139:0/3900587992 wait complete. 2023-10-08T13:26:35.297 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542206 got 60129542208 for osd.1 2023-10-08T13:26:35.297 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 -- 172.21.15.139:0/1505533492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62100ffa10 msgr2=0x7f62100ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 --2- 172.21.15.139:0/1505533492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62100ffa10 0x7f62100ffe90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6204009990 tx=0x7f6204009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 -- 172.21.15.139:0/1505533492 shutdown_connections 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 --2- 172.21.15.139:0/1505533492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62101003d0 0x7f621010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 --2- 172.21.15.139:0/1505533492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6210105760 0x7f6210105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 --2- 172.21.15.139:0/1505533492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62100ffa10 0x7f62100ffe90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 -- 172.21.15.139:0/1505533492 >> 172.21.15.139:0/1505533492 conn(0x7f6210076490 msgr2=0x7f62100768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 -- 172.21.15.139:0/1505533492 shutdown_connections 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.420+0000 7f6216387700 1 -- 172.21.15.139:0/1505533492 wait complete. 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 Processor -- start 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 -- start start 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62100ffa10 0x7f621019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210105760 0x7f6210195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62101960d0 con 0x7f62101003d0 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210196240 con 0x7f6210105760 2023-10-08T13:26:35.657 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f6216387700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210196400 con 0x7f62100ffa10 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39012/0 (socket says 172.21.15.139:39012) 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.421+0000 7f620f7fe700 1 -- 172.21.15.139:0/78734915 learned_addr learned my addr 172.21.15.139:0/78734915 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620ffff700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62100ffa10 0x7f621019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 -- 172.21.15.139:0/78734915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62100ffa10 msgr2=0x7f621019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62100ffa10 0x7f621019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 -- 172.21.15.139:0/78734915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210105760 msgr2=0x7f6210195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f6214924700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210105760 0x7f6210195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210105760 0x7f6210195920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 -- 172.21.15.139:0/78734915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040095f0 con 0x7f62101003d0 2023-10-08T13:26:35.658 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620f7fe700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f6204004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620401d070 con 0x7f62101003d0 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210196680 con 0x7f62101003d0 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6204022470 con 0x7f62101003d0 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204017650 con 0x7f62101003d0 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stdout:283467841568 2023-10-08T13:26:35.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.422+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62101a27f0 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.423+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210100e10 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.424+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f62040225e0 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.425+0000 7f620d7fa700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 0x7f61f80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.425+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f62040ce5a0 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.425+0000 7f620ffff700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 0x7f61f80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.425+0000 7f620ffff700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 0x7f61f80a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6200009be0 tx=0x7f6200009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.429+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6204097740 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.636+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f6210196e00 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.637+0000 7f620d7fa700 1 -- 172.21.15.139:0/78734915 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6204027020 con 0x7f62101003d0 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 msgr2=0x7f61f80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 0x7f61f80a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6200009be0 tx=0x7f6200009260 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 msgr2=0x7f621019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f6204004730 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 shutdown_connections 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f61f80a1560 0x7f61f80a3a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6210105760 0x7f6210195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62100ffa10 0x7f621019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 --2- 172.21.15.139:0/78734915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62101003d0 0x7f621019bdb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 >> 172.21.15.139:0/78734915 conn(0x7f6210076490 msgr2=0x7f62100fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 shutdown_connections 2023-10-08T13:26:35.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:35.639+0000 7f6216387700 1 -- 172.21.15.139:0/78734915 wait complete. 2023-10-08T13:26:35.872 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:35 smithi139 ceph-mon[99506]: pgmap v270: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:26:35.872 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:35 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:26:35.872 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3900587992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:26:35.873 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:35 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/78734915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:26:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:35 smithi187 ceph-mon[104336]: pgmap v270: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:26:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:35 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:26:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3900587992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:26:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:35 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/78734915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:26:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:35 smithi155 ceph-mon[103467]: pgmap v270: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T13:26:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:35 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:26:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3900587992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T13:26:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:35 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/78734915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T13:26:36.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841566 got 283467841568 for osd.9 2023-10-08T13:26:36.210 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 -- 172.21.15.139:0/12400475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c100110 msgr2=0x7f628c10c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 --2- 172.21.15.139:0/12400475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c100110 0x7f628c10c560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f628400b0a0 tx=0x7f628400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 -- 172.21.15.139:0/12400475 shutdown_connections 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 --2- 172.21.15.139:0/12400475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c100110 0x7f628c10c560 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 --2- 172.21.15.139:0/12400475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c105690 0x7f628c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 --2- 172.21.15.139:0/12400475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c0ff750 0x7f628c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.239+0000 7f6290d2f700 1 -- 172.21.15.139:0/12400475 >> 172.21.15.139:0/12400475 conn(0x7f628c0757d0 msgr2=0x7f628c075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:36.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 -- 172.21.15.139:0/12400475 shutdown_connections 2023-10-08T13:26:36.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 -- 172.21.15.139:0/12400475 wait complete. 2023-10-08T13:26:36.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 Processor -- start 2023-10-08T13:26:36.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 -- start start 2023-10-08T13:26:36.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.240+0000 7f6290d2f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c100110 0x7f628c1017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.243 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6290d2f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6290d2f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c1a5060 con 0x7f628c105690 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6290d2f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c1a51d0 con 0x7f628c0ff750 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6290d2f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c1a5390 con 0x7f628c100110 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39028/0 (socket says 172.21.15.139:39028) 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:57544/0 (socket says 172.21.15.139:57544) 2023-10-08T13:26:36.244 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 -- 172.21.15.139:0/851554181 learned_addr learned my addr 172.21.15.139:0/851554181 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6289d9b700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c100110 0x7f628c1017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 -- 172.21.15.139:0/851554181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c100110 msgr2=0x7f628c1017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c100110 0x7f628c1017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 -- 172.21.15.139:0/851554181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 msgr2=0x7f628c101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 -- 172.21.15.139:0/851554181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284009d00 con 0x7f628c105690 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628a59c700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f628ad9d700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f628400b070 tx=0x7f6284007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400e040 con 0x7f628c105690 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f628401d470 con 0x7f628c105690 2023-10-08T13:26:36.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c1a5610 con 0x7f628c105690 2023-10-08T13:26:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.241+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62840052a0 con 0x7f628c105690 2023-10-08T13:26:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.242+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c1a5a80 con 0x7f628c105690 2023-10-08T13:26:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.242+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c108c30 con 0x7f628c105690 2023-10-08T13:26:36.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.244+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f628401d870 con 0x7f628c105690 2023-10-08T13:26:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.244+0000 7f62837fe700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 0x7f62780a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.245+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f62840ceaa0 con 0x7f628c105690 2023-10-08T13:26:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.245+0000 7f628a59c700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 0x7f62780a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.245+0000 7f628a59c700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 0x7f62780a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6274009fd0 tx=0x7f6274009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:36.249 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.249+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6284097c40 con 0x7f628c105690 2023-10-08T13:26:36.306 INFO:teuthology.orchestra.run.smithi139.stdout:163208757296 2023-10-08T13:26:36.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-08T13:26:36.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.463+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f628c04e4c0 con 0x7f628c105690 2023-10-08T13:26:36.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.463+0000 7f62837fe700 1 -- 172.21.15.139:0/851554181 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f628409b260 con 0x7f628c105690 2023-10-08T13:26:36.465 INFO:teuthology.orchestra.run.smithi139.stdout:304942678044 2023-10-08T13:26:36.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 msgr2=0x7f62780a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 0x7f62780a3aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6274009fd0 tx=0x7f6274009260 comp rx=0 tx=0).stop 2023-10-08T13:26:36.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 msgr2=0x7f628c101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f628400b070 tx=0x7f6284007930 comp rx=0 tx=0).stop 2023-10-08T13:26:36.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 shutdown_connections 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62780a15e0 0x7f62780a3aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f628c105690 0x7f628c101ce0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f628c0ff750 0x7f628c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 --2- 172.21.15.139:0/851554181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f628c100110 0x7f628c1017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 >> 172.21.15.139:0/851554181 conn(0x7f628c0757d0 msgr2=0x7f628c069180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 shutdown_connections 2023-10-08T13:26:36.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.466+0000 7f6290d2f700 1 -- 172.21.15.139:0/851554181 wait complete. 2023-10-08T13:26:36.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 -- 172.21.15.139:0/1159985578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 msgr2=0x7ff550100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 --2- 172.21.15.139:0/1159985578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff550100720 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff544009990 tx=0x7ff544009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 -- 172.21.15.139:0/1159985578 shutdown_connections 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 --2- 172.21.15.139:0/1159985578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550100c60 0x7ff55010c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 --2- 172.21.15.139:0/1159985578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550104720 0x7ff550104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 --2- 172.21.15.139:0/1159985578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff550100720 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 -- 172.21.15.139:0/1159985578 >> 172.21.15.139:0/1159985578 conn(0x7ff550074a10 msgr2=0x7ff550074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 -- 172.21.15.139:0/1159985578 shutdown_connections 2023-10-08T13:26:36.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.546+0000 7ff555260700 1 -- 172.21.15.139:0/1159985578 wait complete. 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 Processor -- start 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 -- start start 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff55019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 0x7ff55019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 0x7ff550195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550195f60 con 0x7ff5501002a0 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501960d0 con 0x7ff550104720 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.547+0000 7ff555260700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550196290 con 0x7ff550100c60 2023-10-08T13:26:36.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 0x7ff55019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 0x7ff550195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff55019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 0x7ff55019bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:38756/0 (socket says 172.21.15.139:38756) 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54e59c700 1 -- 172.21.15.139:0/4086756420 learned_addr learned my addr 172.21.15.139:0/4086756420 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 -- 172.21.15.139:0/4086756420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 msgr2=0x7ff55019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 0x7ff55019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 -- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 msgr2=0x7ff55019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff55019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 -- 172.21.15.139:0/4086756420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440095f0 con 0x7ff550104720 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54ed9d700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff55019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff54f59e700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 0x7ff550195900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff548007f10 tx=0x7ff54800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:36.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548004db0 con 0x7ff550104720 2023-10-08T13:26:36.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550196570 con 0x7ff550104720 2023-10-08T13:26:36.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff54800f040 con 0x7ff550104720 2023-10-08T13:26:36.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548005990 con 0x7ff550104720 2023-10-08T13:26:36.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.548+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5501a27b0 con 0x7ff550104720 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.549+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff550107c60 con 0x7ff550104720 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.550+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff54800db20 con 0x7ff550104720 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.551+0000 7ff537fff700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 0x7ff5380a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.551+0000 7ff54ed9d700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 0x7ff5380a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.551+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff5480ccd30 con 0x7ff550104720 2023-10-08T13:26:36.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.551+0000 7ff54ed9d700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 0x7ff5380a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff540005950 tx=0x7ff54000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:36.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.555+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff548095e40 con 0x7ff550104720 2023-10-08T13:26:36.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.771+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7ff550196dc0 con 0x7ff550104720 2023-10-08T13:26:36.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.772+0000 7ff537fff700 1 -- 172.21.15.139:0/4086756420 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff548099460 con 0x7ff550104720 2023-10-08T13:26:36.774 INFO:teuthology.orchestra.run.smithi139.stdout:249108103205 2023-10-08T13:26:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 msgr2=0x7ff5380a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 0x7ff5380a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff540005950 tx=0x7ff54000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:36.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 msgr2=0x7ff550195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 0x7ff550195900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff548007f10 tx=0x7ff54800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 shutdown_connections 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff5380a1560 0x7ff5380a3a20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff550104720 0x7ff550195900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5501002a0 0x7ff55019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 --2- 172.21.15.139:0/4086756420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff550100c60 0x7ff55019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 >> 172.21.15.139:0/4086756420 conn(0x7ff550074a10 msgr2=0x7ff5500fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 shutdown_connections 2023-10-08T13:26:36.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:36.774+0000 7ff555260700 1 -- 172.21.15.139:0/4086756420 wait complete. 2023-10-08T13:26:36.793 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:36 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/851554181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:26:36.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705730 got 38654705732 for osd.0 2023-10-08T13:26:36.809 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:36.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:36 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/851554181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:26:37.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:36 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/851554181' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T13:26:37.180 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678042 got 304942678044 for osd.10 2023-10-08T13:26:37.180 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:37.283 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:37.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.931+0000 7f9144d51700 1 -- 172.21.15.139:0/2530173306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91400ff750 msgr2=0x7f91400ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:37.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.931+0000 7f9144d51700 1 --2- 172.21.15.139:0/2530173306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91400ff750 0x7f91400ffbd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9128009990 tx=0x7f9128009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.931+0000 7f9144d51700 1 -- 172.21.15.139:0/2530173306 shutdown_connections 2023-10-08T13:26:37.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.931+0000 7f9144d51700 1 --2- 172.21.15.139:0/2530173306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 0x7f914010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.931+0000 7f9144d51700 1 --2- 172.21.15.139:0/2530173306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91401056b0 0x7f9140105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.932+0000 7f9144d51700 1 --2- 172.21.15.139:0/2530173306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91400ff750 0x7f91400ffbd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.932+0000 7f9144d51700 1 -- 172.21.15.139:0/2530173306 >> 172.21.15.139:0/2530173306 conn(0x7f9140075790 msgr2=0x7f9140075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.932+0000 7f9144d51700 1 -- 172.21.15.139:0/2530173306 shutdown_connections 2023-10-08T13:26:37.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.932+0000 7f9144d51700 1 -- 172.21.15.139:0/2530173306 wait complete. 2023-10-08T13:26:37.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 Processor -- start 2023-10-08T13:26:37.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 -- start start 2023-10-08T13:26:37.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 0x7f9140197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 0x7f91401a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9140198840 con 0x7f91401056b0 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401a3000 con 0x7f91400ff750 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f9144d51700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91401a3140 con 0x7f9140100110 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 0x7f91401a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:57572/0 (socket says 172.21.15.139:57572) 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 -- 172.21.15.139:0/1766490915 learned_addr learned my addr 172.21.15.139:0/1766490915 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 0x7f91401a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39056/0 (socket says 172.21.15.139:39056) 2023-10-08T13:26:37.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913dd9b700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 0x7f9140197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 -- 172.21.15.139:0/1766490915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 msgr2=0x7f9140197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 0x7f9140197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 -- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 msgr2=0x7f91401a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 0x7f91401a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.933+0000 7f913e59c700 1 -- 172.21.15.139:0/1766490915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280095f0 con 0x7f91400ff750 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f913e59c700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f913800e9a0 tx=0x7f913800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138009790 con 0x7f91400ff750 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91401a33c0 con 0x7f91400ff750 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f913800cbd0 con 0x7f91400ff750 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138018680 con 0x7f91400ff750 2023-10-08T13:26:37.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.934+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91401a3910 con 0x7f91400ff750 2023-10-08T13:26:37.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.935+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9140107cd0 con 0x7f91400ff750 2023-10-08T13:26:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: pgmap v271: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4086756420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:26:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:37 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.937+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f913800cd40 con 0x7f91400ff750 2023-10-08T13:26:37.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.937+0000 7f91377fe700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 0x7f912c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:37.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.938+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f9138014070 con 0x7f91400ff750 2023-10-08T13:26:37.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.938+0000 7f913dd9b700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 0x7f912c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:37.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.938+0000 7f913dd9b700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 0x7f912c0a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9128005b40 tx=0x7f9128005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:37.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:37.940+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f91380968d0 con 0x7f91400ff750 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: pgmap v271: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4086756420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:37 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:38.022 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:38.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 -- 172.21.15.139:0/1095579979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 msgr2=0x7effcc105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 --2- 172.21.15.139:0/1095579979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc105a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7effbc009990 tx=0x7effbc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 -- 172.21.15.139:0/1095579979 shutdown_connections 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 --2- 172.21.15.139:0/1095579979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 --2- 172.21.15.139:0/1095579979 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc105a50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 --2- 172.21.15.139:0/1095579979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 0x7effcc0692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 -- 172.21.15.139:0/1095579979 >> 172.21.15.139:0/1095579979 conn(0x7effcc0757d0 msgr2=0x7effcc075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 -- 172.21.15.139:0/1095579979 shutdown_connections 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.047+0000 7effd101b700 1 -- 172.21.15.139:0/1095579979 wait complete. 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.048+0000 7effd101b700 1 Processor -- start 2023-10-08T13:26:38.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 -- start start 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 0x7effcc19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc197070 con 0x7effcc105670 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1971e0 con 0x7effcc068e20 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effd101b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1973a0 con 0x7effcc0697e0 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:38784/0 (socket says 172.21.15.139:38784) 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 -- 172.21.15.139:0/525480934 learned_addr learned my addr 172.21.15.139:0/525480934 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effcad9d700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 0x7effcc19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effcb59e700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:38.057 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 -- 172.21.15.139:0/525480934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 msgr2=0x7effcc19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 0x7effcc19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 -- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 msgr2=0x7effcc196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.049+0000 7effca59c700 1 -- 172.21.15.139:0/525480934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0095f0 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effca59c700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7effc000d950 tx=0x7effc000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000f890 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effc0010460 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc197680 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000e610 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.050+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc1a38c0 con 0x7effcc0697e0 2023-10-08T13:26:38.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.051+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc108ce0 con 0x7effcc0697e0 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.052+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7effc00108d0 con 0x7effcc0697e0 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.053+0000 7effb3fff700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 0x7effb40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.053+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7effc00ccff0 con 0x7effcc0697e0 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.053+0000 7effcad9d700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 0x7effb40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.053+0000 7effcad9d700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 0x7effb40a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7effbc006010 tx=0x7effbc005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:38.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.056+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7effc00960e0 con 0x7effcc0697e0 2023-10-08T13:26:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: pgmap v271: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4086756420' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T13:26:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:38.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:38.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:38.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:37 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:38.166 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.166+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9140068750 con 0x7f91400ff750 2023-10-08T13:26:38.167 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.166+0000 7f91377fe700 1 -- 172.21.15.139:0/1766490915 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9138099ef0 con 0x7f91400ff750 2023-10-08T13:26:38.167 INFO:teuthology.orchestra.run.smithi139.stdout:81604378685 2023-10-08T13:26:38.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.168+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 msgr2=0x7f912c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.168+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 0x7f912c0a3a20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9128005b40 tx=0x7f9128005a90 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.168+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 msgr2=0x7f9140197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.168+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f913800e9a0 tx=0x7f913800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 shutdown_connections 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f912c0a1560 0x7f912c0a3a20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91401056b0 0x7f91401a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91400ff750 0x7f9140197a40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 --2- 172.21.15.139:0/1766490915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9140100110 0x7f9140197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 >> 172.21.15.139:0/1766490915 conn(0x7f9140075790 msgr2=0x7f91400fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:38.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 shutdown_connections 2023-10-08T13:26:38.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.169+0000 7f9144d51700 1 -- 172.21.15.139:0/1766490915 wait complete. 2023-10-08T13:26:38.199 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:38.233 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103202 got 249108103205 for osd.8 2023-10-08T13:26:38.233 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:38.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.285+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7effcc04e4c0 con 0x7effcc0697e0 2023-10-08T13:26:38.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.286+0000 7effb3fff700 1 -- 172.21.15.139:0/525480934 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc0020090 con 0x7effcc0697e0 2023-10-08T13:26:38.287 INFO:teuthology.orchestra.run.smithi139.stdout:141733920822 2023-10-08T13:26:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 msgr2=0x7effb40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 0x7effb40a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7effbc006010 tx=0x7effbc005960 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 msgr2=0x7effcc19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7effc000d950 tx=0x7effc000dc60 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 shutdown_connections 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7effb40a15e0 0x7effb40a3aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effcc105670 0x7effcc196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effcc068e20 0x7effcc19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 --2- 172.21.15.139:0/525480934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effcc0697e0 0x7effcc19ce10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.288+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 >> 172.21.15.139:0/525480934 conn(0x7effcc0757d0 msgr2=0x7effcc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.289+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 shutdown_connections 2023-10-08T13:26:38.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:38.289+0000 7effd101b700 1 -- 172.21.15.139:0/525480934 wait complete. 2023-10-08T13:26:38.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:38 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1766490915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:26:38.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:38 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/525480934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:26:38.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:38 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1766490915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:26:38.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:38 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/525480934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:26:39.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:38 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1766490915' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T13:26:39.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:38 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/525480934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T13:26:39.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920819 got 141733920822 for osd.4 2023-10-08T13:26:39.220 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:39.447 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378683 got 81604378685 for osd.2 2023-10-08T13:26:39.447 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:39 smithi187 ceph-mon[104336]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:40.080 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:39 smithi139 ceph-mon[99506]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:39 smithi155 ceph-mon[103467]: pgmap v272: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 -- 172.21.15.139:0/864234024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8380ff750 msgr2=0x7fd8380ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 --2- 172.21.15.139:0/864234024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8380ff750 0x7fd8380ffbd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd828009990 tx=0x7fd828009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 -- 172.21.15.139:0/864234024 shutdown_connections 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 --2- 172.21.15.139:0/864234024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd838100110 0x7fd83810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 --2- 172.21.15.139:0/864234024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 --2- 172.21.15.139:0/864234024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8380ff750 0x7fd8380ffbd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 -- 172.21.15.139:0/864234024 >> 172.21.15.139:0/864234024 conn(0x7fd838075790 msgr2=0x7fd838075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 -- 172.21.15.139:0/864234024 shutdown_connections 2023-10-08T13:26:40.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.508+0000 7fd840062700 1 -- 172.21.15.139:0/864234024 wait complete. 2023-10-08T13:26:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 Processor -- start 2023-10-08T13:26:40.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 -- start start 2023-10-08T13:26:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8380ff750 0x7fd838101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381a4fb0 con 0x7fd838100110 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381a5120 con 0x7fd8381056b0 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd840062700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381a52e0 con 0x7fd8380ff750 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd83d5fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd83d5fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39078/0 (socket says 172.21.15.139:39078) 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd83d5fd700 1 -- 172.21.15.139:0/3484932483 learned_addr learned my addr 172.21.15.139:0/3484932483 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd83e5ff700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.509+0000 7fd83ddfe700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8380ff750 0x7fd838101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 -- 172.21.15.139:0/3484932483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8380ff750 msgr2=0x7fd838101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8380ff750 0x7fd838101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 -- 172.21.15.139:0/3484932483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 msgr2=0x7fd838101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 -- 172.21.15.139:0/3484932483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280095f0 con 0x7fd838100110 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83e5ff700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd83d5fd700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd82800f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82801d070 con 0x7fd838100110 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8381a5560 con 0x7fd838100110 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd82800fde0 con 0x7fd838100110 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828017770 con 0x7fd838100110 2023-10-08T13:26:40.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.510+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8381a5970 con 0x7fd838100110 2023-10-08T13:26:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.511+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd838108ce0 con 0x7fd838100110 2023-10-08T13:26:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.512+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd828022aa0 con 0x7fd838100110 2023-10-08T13:26:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.512+0000 7fd82effd700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 0x7fd8240a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.513+0000 7fd83ddfe700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 0x7fd8240a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.513+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd8280ce760 con 0x7fd838100110 2023-10-08T13:26:40.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.513+0000 7fd83ddfe700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 0x7fd8240a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd834005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:40.518 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.517+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd82805d100 con 0x7fd838100110 2023-10-08T13:26:40.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.723+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd838100df0 con 0x7fd838100110 2023-10-08T13:26:40.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.723+0000 7fd82effd700 1 -- 172.21.15.139:0/3484932483 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd828027090 con 0x7fd838100110 2023-10-08T13:26:40.725 INFO:teuthology.orchestra.run.smithi139.stdout:219043332137 2023-10-08T13:26:40.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 msgr2=0x7fd8240a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 0x7fd8240a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd834005fd0 tx=0x7fd834005db0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 msgr2=0x7fd8381017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd82800f880 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 shutdown_connections 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8240a1560 0x7fd8240a3a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8381056b0 0x7fd838101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8380ff750 0x7fd838101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 --2- 172.21.15.139:0/3484932483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd838100110 0x7fd8381017c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.725+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 >> 172.21.15.139:0/3484932483 conn(0x7fd838075790 msgr2=0x7fd838068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.726+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 shutdown_connections 2023-10-08T13:26:40.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.726+0000 7fd840062700 1 -- 172.21.15.139:0/3484932483 wait complete. 2023-10-08T13:26:40.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 -- 172.21.15.139:0/1106119952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb374105690 msgr2=0x7fb374105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 --2- 172.21.15.139:0/1106119952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb374105690 0x7fb374105a70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb364009990 tx=0x7fb364009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 -- 172.21.15.139:0/1106119952 shutdown_connections 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 --2- 172.21.15.139:0/1106119952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100110 0x7fb37410c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 --2- 172.21.15.139:0/1106119952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb374105690 0x7fb374105a70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 --2- 172.21.15.139:0/1106119952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3740ff750 0x7fb3740ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 -- 172.21.15.139:0/1106119952 >> 172.21.15.139:0/1106119952 conn(0x7fb3740757d0 msgr2=0x7fb374075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 -- 172.21.15.139:0/1106119952 shutdown_connections 2023-10-08T13:26:40.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.863+0000 7fb37a93d700 1 -- 172.21.15.139:0/1106119952 wait complete. 2023-10-08T13:26:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 Processor -- start 2023-10-08T13:26:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 -- start start 2023-10-08T13:26:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 0x7fb37419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374105690 0x7fb374196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374197080 con 0x7fb3740ff750 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3741971f0 con 0x7fb374105690 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb37a93d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3741973b0 con 0x7fb374100110 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb373fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb373fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39090/0 (socket says 172.21.15.139:39090) 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb373fff700 1 -- 172.21.15.139:0/2590088712 learned_addr learned my addr 172.21.15.139:0/2590088712 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.864+0000 7fb3737fe700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 0x7fb37419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 -- 172.21.15.139:0/2590088712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 msgr2=0x7fb37419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 0x7fb37419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 -- 172.21.15.139:0/2590088712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374105690 msgr2=0x7fb374196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374105690 0x7fb374196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:40.868 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 -- 172.21.15.139:0/2590088712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640095f0 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb3737fe700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 0x7fb37419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb373fff700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb364005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36401d070 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb364022470 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb374197630 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364017650 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.865+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3741a38d0 con 0x7fb3740ff750 2023-10-08T13:26:40.869 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.866+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb374108c50 con 0x7fb3740ff750 2023-10-08T13:26:40.870 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.867+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fb3640225e0 con 0x7fb3740ff750 2023-10-08T13:26:40.870 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.867+0000 7fb3717fa700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 0x7fb35c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:40.870 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.868+0000 7fb3737fe700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 0x7fb35c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:40.870 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.868+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fb3640ce9e0 con 0x7fb3740ff750 2023-10-08T13:26:40.870 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.868+0000 7fb3737fe700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 0x7fb35c0a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb374197be0 tx=0x7fb368009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:40.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:40.872+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb364097ca0 con 0x7fb3740ff750 2023-10-08T13:26:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.077+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb374100dd0 con 0x7fb3740ff750 2023-10-08T13:26:41.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.077+0000 7fb3717fa700 1 -- 172.21.15.139:0/2590088712 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb364027070 con 0x7fb3740ff750 2023-10-08T13:26:41.078 INFO:teuthology.orchestra.run.smithi139.stdout:163208757297 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.079+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 msgr2=0x7fb35c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 0x7fb35c0a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb374197be0 tx=0x7fb368009260 comp rx=0 tx=0).stop 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 msgr2=0x7fb37419c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb364000c00 tx=0x7fb364005ef0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 shutdown_connections 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb35c0a1560 0x7fb35c0a3a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374105690 0x7fb374196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3740ff750 0x7fb37419c8e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 --2- 172.21.15.139:0/2590088712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb374100110 0x7fb37419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 >> 172.21.15.139:0/2590088712 conn(0x7fb3740757d0 msgr2=0x7fb374069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:41.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 shutdown_connections 2023-10-08T13:26:41.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.080+0000 7fb37a93d700 1 -- 172.21.15.139:0/2590088712 wait complete. 2023-10-08T13:26:41.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 -- 172.21.15.139:0/991506034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 msgr2=0x7f28d4105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 --2- 172.21.15.139:0/991506034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4105ba0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009990 tx=0x7f28c4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 -- 172.21.15.139:0/991506034 shutdown_connections 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 --2- 172.21.15.139:0/991506034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d4101260 0x7f28d410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 --2- 172.21.15.139:0/991506034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4105ba0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 --2- 172.21.15.139:0/991506034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d41008a0 0x7f28d4100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 -- 172.21.15.139:0/991506034 >> 172.21.15.139:0/991506034 conn(0x7f28d40779e0 msgr2=0x7f28d4077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:41.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 -- 172.21.15.139:0/991506034 shutdown_connections 2023-10-08T13:26:41.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.178+0000 7f28da8bf700 1 -- 172.21.15.139:0/991506034 wait complete. 2023-10-08T13:26:41.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.179+0000 7f28da8bf700 1 Processor -- start 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.179+0000 7f28da8bf700 1 -- start start 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.179+0000 7f28da8bf700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d41008a0 0x7f28d419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.179+0000 7f28da8bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d4101260 0x7f28d419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28da8bf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28da8bf700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41970d0 con 0x7f28d41057c0 2023-10-08T13:26:41.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28da8bf700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4197240 con 0x7f28d41008a0 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28da8bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4197400 con 0x7f28d4101260 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39108/0 (socket says 172.21.15.139:39108) 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 -- 172.21.15.139:0/1600428590 learned_addr learned my addr 172.21.15.139:0/1600428590 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d37fe700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d4101260 0x7f28d419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d3fff700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d41008a0 0x7f28d419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:41.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 -- 172.21.15.139:0/1600428590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d4101260 msgr2=0x7f28d419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d4101260 0x7f28d419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 -- 172.21.15.139:0/1600428590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d41008a0 msgr2=0x7f28d419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d41008a0 0x7f28d419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 -- 172.21.15.139:0/1600428590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40095f0 con 0x7f28d41057c0 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d8e5c700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00efc0 tx=0x7f28cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:41.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc018070 con 0x7f28d41057c0 2023-10-08T13:26:41.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28cc00f040 con 0x7f28d41057c0 2023-10-08T13:26:41.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4197680 con 0x7f28d41057c0 2023-10-08T13:26:41.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.180+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00cc10 con 0x7f28d41057c0 2023-10-08T13:26:41.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.181+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4072bf0 con 0x7f28d41057c0 2023-10-08T13:26:41.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.181+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4108d80 con 0x7f28d41057c0 2023-10-08T13:26:41.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.183+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f28cc00cd90 con 0x7f28d41057c0 2023-10-08T13:26:41.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.183+0000 7f28d17fa700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 0x7f28bc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:41.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.184+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f28cc0cd650 con 0x7f28d41057c0 2023-10-08T13:26:41.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.184+0000 7f28d3fff700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 0x7f28bc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:41.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.184+0000 7f28d3fff700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 0x7f28bc0a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:41.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.189+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f28cc096790 con 0x7f28d41057c0 2023-10-08T13:26:41.303 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332135 got 219043332137 for osd.7 2023-10-08T13:26:41.303 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:41.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.393+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f28d4197ee0 con 0x7f28d41057c0 2023-10-08T13:26:41.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.395+0000 7f28d17fa700 1 -- 172.21.15.139:0/1600428590 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f28cc099db0 con 0x7f28d41057c0 2023-10-08T13:26:41.396 INFO:teuthology.orchestra.run.smithi139.stdout:335007449112 2023-10-08T13:26:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 msgr2=0x7f28bc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 0x7f28bc0a3aa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28c4006010 tx=0x7f28c4005960 comp rx=0 tx=0).stop 2023-10-08T13:26:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 msgr2=0x7f28d4196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00efc0 tx=0x7f28cc00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 shutdown_connections 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f28bc0a15e0 0x7f28bc0a3aa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28d41057c0 0x7f28d4196a70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28d41008a0 0x7f28d419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 --2- 172.21.15.139:0/1600428590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28d4101260 0x7f28d419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 >> 172.21.15.139:0/1600428590 conn(0x7f28d40779e0 msgr2=0x7f28d40fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 shutdown_connections 2023-10-08T13:26:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:41.397+0000 7f28da8bf700 1 -- 172.21.15.139:0/1600428590 wait complete. 2023-10-08T13:26:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:41 smithi139 ceph-mon[99506]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:41 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3484932483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:26:41.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:41 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2590088712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:26:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:41 smithi187 ceph-mon[104336]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:41 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3484932483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:26:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:41 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2590088712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:26:41.777 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757296 got 163208757297 for osd.5 2023-10-08T13:26:41.777 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:41 smithi155 ceph-mon[103467]: pgmap v273: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:41 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3484932483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T13:26:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:41 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2590088712' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T13:26:41.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449110 got 335007449112 for osd.11 2023-10-08T13:26:41.961 DEBUG:teuthology.parallel:result is None 2023-10-08T13:26:41.961 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-08T13:26:41.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T13:26:42.525 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:42 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1600428590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:26:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:42 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:42.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:42 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1600428590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:26:42.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:42.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:42 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:42 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1600428590' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T13:26:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:42 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:43.631 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:43 smithi139 ceph-mon[99506]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:43.631 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:26:43.631 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:26:43.631 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:43 smithi187 ceph-mon[104336]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:26:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:26:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:43.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 -- 172.21.15.139:0/2097112258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 msgr2=0x7f10541008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 --2- 172.21.15.139:0/2097112258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f10541008a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1048009990 tx=0x7f1048009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 -- 172.21.15.139:0/2097112258 shutdown_connections 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 --2- 172.21.15.139:0/2097112258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 0x7f105410c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 --2- 172.21.15.139:0/2097112258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f10541008a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 --2- 172.21.15.139:0/2097112258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 0x7f10541043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.828+0000 7f105aad5700 1 -- 172.21.15.139:0/2097112258 >> 172.21.15.139:0/2097112258 conn(0x7f1054074aa0 msgr2=0x7f1054074eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.829+0000 7f105aad5700 1 -- 172.21.15.139:0/2097112258 shutdown_connections 2023-10-08T13:26:43.830 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.829+0000 7f105aad5700 1 -- 172.21.15.139:0/2097112258 wait complete. 2023-10-08T13:26:43.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.829+0000 7f105aad5700 1 Processor -- start 2023-10-08T13:26:43.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.829+0000 7f105aad5700 1 -- start start 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 0x7f105419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 0x7f10541959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054196020 con 0x7f10541004c0 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054196190 con 0x7f1054100e70 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f105aad5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054196350 con 0x7f1054104ae0 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39116/0 (socket says 172.21.15.139:39116) 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 -- 172.21.15.139:0/1732523530 learned_addr learned my addr 172.21.15.139:0/1732523530 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1059072700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 0x7f10541959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:43.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1053fff700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 0x7f105419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 -- 172.21.15.139:0/1732523530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 msgr2=0x7f10541959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 0x7f10541959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 -- 172.21.15.139:0/1732523530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 msgr2=0x7f105419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 0x7f105419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 -- 172.21.15.139:0/1732523530 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480095f0 con 0x7f10541004c0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1058871700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1048005770 tx=0x7f1048005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801f070 con 0x7f10541004c0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f104801acc0 con 0x7f10541004c0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.830+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800f6c0 con 0x7f10541004c0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.831+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10541965d0 con 0x7f10541004c0 2023-10-08T13:26:43.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.831+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10540ff320 con 0x7f10541004c0 2023-10-08T13:26:43.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.832+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1054068a40 con 0x7f10541004c0 2023-10-08T13:26:43.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.833+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f1048024470 con 0x7f10541004c0 2023-10-08T13:26:43.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.833+0000 7f1051ffb700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 0x7f10440a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:43.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.834+0000 7f1053fff700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 0x7f10440a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:43.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.834+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f10480d0b70 con 0x7f10541004c0 2023-10-08T13:26:43.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.834+0000 7f1053fff700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 0x7f10440a3aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1054196b80 tx=0x7f1040009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:43.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:43.838+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1048099d10 con 0x7f10541004c0 2023-10-08T13:26:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:43 smithi155 ceph-mon[103467]: pgmap v274: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:26:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:26:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:26:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:26:44.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.027+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f105410f6a0 con 0x7f10440a15e0 2023-10-08T13:26:44.041 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.040+0000 7f1051ffb700 1 -- 172.21.15.139:0/1732523530 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427175 (secure 0 0 0) 0x7f105410f6a0 con 0x7f10440a15e0 2023-10-08T13:26:44.046 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:44.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 msgr2=0x7f10440a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 0x7f10440a3aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1054196b80 tx=0x7f1040009260 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 msgr2=0x7f105419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1048005770 tx=0x7f1048005ef0 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 shutdown_connections 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10440a15e0 0x7f10440a3aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1054104ae0 0x7f10541959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10541004c0 0x7f105419b880 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 --2- 172.21.15.139:0/1732523530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1054100e70 0x7f105419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 >> 172.21.15.139:0/1732523530 conn(0x7f1054074aa0 msgr2=0x7f10540fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 shutdown_connections 2023-10-08T13:26:44.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:44.043+0000 7f105aad5700 1 -- 172.21.15.139:0/1732523530 wait complete. 2023-10-08T13:26:44.051 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:26:44.479 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2023-10-08T13:26:42.611107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656009,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":527,"num_read_kb":383,"num_write":417,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336344,"kb_used_data":12092,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605480,"statfs":{"total":1151940427776,"available":1151596011520,"internally_reserved":0,"allocated":12382208,"data_stored":7988652,"data_compressed":353736,"data_compressed_allocated":479232,"data_compressed_original":2457600,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":57,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003501"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716810+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:26:08.716810+0000","last_peered":"2023-10-08T13:26:08.716810+0000","last_clean":"2023-10-08T13:26:08.716810+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:26:08.716810+0000","last_undegraded":"2023-10-08T13:26:08.716810+0000","last_fullsized":"2023-10-08T13:26:08.716810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718276+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:26:08.718276+0000","last_peered":"2023-10-08T13:26:08.718276+0000","last_clean":"2023-10-08T13:26:08.718276+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:26:08.718276+0000","last_undegraded":"2023-10-08T13:26:08.718276+0000","last_fullsized":"2023-10-08T13:26:08.718276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717455+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:26:08.717455+0000","last_peered":"2023-10-08T13:26:08.717455+0000","last_clean":"2023-10-08T13:26:08.717455+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:26:08.717455+0000","last_undegraded":"2023-10-08T13:26:08.717455+0000","last_fullsized":"2023-10-08T13:26:08.717455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724807+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:26:08.724807+0000","last_peered":"2023-10-08T13:26:08.724807+0000","last_clean":"2023-10-08T13:26:08.724807+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:26:08.724807+0000","last_undegraded":"2023-10-08T13:26:08.724807+0000","last_fullsized":"2023-10-08T13:26:08.724807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719221+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:26:08.719221+0000","last_peered":"2023-10-08T13:26:08.719221+0000","last_clean":"2023-10-08T13:26:08.719221+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:26:08.719221+0000","last_undegraded":"2023-10-08T13:26:08.719221+0000","last_fullsized":"2023-10-08T13:26:08.719221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722874+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:26:08.722874+0000","last_peered":"2023-10-08T13:26:08.722874+0000","last_clean":"2023-10-08T13:26:08.722874+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:26:08.722874+0000","last_undegraded":"2023-10-08T13:26:08.722874+0000","last_fullsized":"2023-10-08T13:26:08.722874+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717123+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:26:08.717123+0000","last_peered":"2023-10-08T13:26:08.717123+0000","last_clean":"2023-10-08T13:26:08.717123+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:26:08.717123+0000","last_undegraded":"2023-10-08T13:26:08.717123+0000","last_fullsized":"2023-10-08T13:26:08.717123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722035+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:26:08.722035+0000","last_peered":"2023-10-08T13:26:08.722035+0000","last_clean":"2023-10-08T13:26:08.722035+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:26:08.722035+0000","last_undegraded":"2023-10-08T13:26:08.722035+0000","last_fullsized":"2023-10-08T13:26:08.722035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.727548+0000","last_change":"2023-10-08T13:26:09.727548+0000","last_active":"2023-10-08T13:26:09.727548+0000","last_peered":"2023-10-08T13:26:09.727548+0000","last_clean":"2023-10-08T13:26:09.727548+0000","last_became_active":"2023-10-08T13:26:09.727158+0000","last_became_peered":"2023-10-08T13:26:09.727158+0000","last_unstale":"2023-10-08T13:26:09.727548+0000","last_undegraded":"2023-10-08T13:26:09.727548+0000","last_fullsized":"2023-10-08T13:26:09.727548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:37.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765316+0000","last_change":"2023-10-08T13:26:09.765316+0000","last_active":"2023-10-08T13:26:09.765316+0000","last_peered":"2023-10-08T13:26:09.765316+0000","last_clean":"2023-10-08T13:26:09.765316+0000","last_became_active":"2023-10-08T13:26:09.764968+0000","last_became_peered":"2023-10-08T13:26:09.764968+0000","last_unstale":"2023-10-08T13:26:09.765316+0000","last_undegraded":"2023-10-08T13:26:09.765316+0000","last_fullsized":"2023-10-08T13:26:09.765316+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:40.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717640+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:26:08.717640+0000","last_peered":"2023-10-08T13:26:08.717640+0000","last_clean":"2023-10-08T13:26:08.717640+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:26:08.717640+0000","last_undegraded":"2023-10-08T13:26:08.717640+0000","last_fullsized":"2023-10-08T13:26:08.717640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724715+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:26:08.724715+0000","last_peered":"2023-10-08T13:26:08.724715+0000","last_clean":"2023-10-08T13:26:08.724715+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:26:08.724715+0000","last_undegraded":"2023-10-08T13:26:08.724715+0000","last_fullsized":"2023-10-08T13:26:08.724715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719305+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:26:08.719305+0000","last_peered":"2023-10-08T13:26:08.719305+0000","last_clean":"2023-10-08T13:26:08.719305+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:26:08.719305+0000","last_undegraded":"2023-10-08T13:26:08.719305+0000","last_fullsized":"2023-10-08T13:26:08.719305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717217+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:26:08.717217+0000","last_peered":"2023-10-08T13:26:08.717217+0000","last_clean":"2023-10-08T13:26:08.717217+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:26:08.717217+0000","last_undegraded":"2023-10-08T13:26:08.717217+0000","last_fullsized":"2023-10-08T13:26:08.717217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717312+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:26:08.717312+0000","last_peered":"2023-10-08T13:26:08.717312+0000","last_clean":"2023-10-08T13:26:08.717312+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:26:08.717312+0000","last_undegraded":"2023-10-08T13:26:08.717312+0000","last_fullsized":"2023-10-08T13:26:08.717312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719325+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:26:08.719325+0000","last_peered":"2023-10-08T13:26:08.719325+0000","last_clean":"2023-10-08T13:26:08.719325+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:26:08.719325+0000","last_undegraded":"2023-10-08T13:26:08.719325+0000","last_fullsized":"2023-10-08T13:26:08.719325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716725+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:26:08.716725+0000","last_peered":"2023-10-08T13:26:08.716725+0000","last_clean":"2023-10-08T13:26:08.716725+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:26:08.716725+0000","last_undegraded":"2023-10-08T13:26:08.716725+0000","last_fullsized":"2023-10-08T13:26:08.716725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720992+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:26:08.720992+0000","last_peered":"2023-10-08T13:26:08.720992+0000","last_clean":"2023-10-08T13:26:08.720992+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:26:08.720992+0000","last_undegraded":"2023-10-08T13:26:08.720992+0000","last_fullsized":"2023-10-08T13:26:08.720992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726379+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:26:08.726379+0000","last_peered":"2023-10-08T13:26:08.726379+0000","last_clean":"2023-10-08T13:26:08.726379+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:26:08.726379+0000","last_undegraded":"2023-10-08T13:26:08.726379+0000","last_fullsized":"2023-10-08T13:26:08.726379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725911+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:26:08.725911+0000","last_peered":"2023-10-08T13:26:08.725911+0000","last_clean":"2023-10-08T13:26:08.725911+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:26:08.725911+0000","last_undegraded":"2023-10-08T13:26:08.725911+0000","last_fullsized":"2023-10-08T13:26:08.725911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:40.473571+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:26:40.473571+0000","last_peered":"2023-10-08T13:26:40.473571+0000","last_clean":"2023-10-08T13:26:40.473571+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:26:40.473571+0000","last_undegraded":"2023-10-08T13:26:40.473571+0000","last_fullsized":"2023-10-08T13:26:40.473571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722894+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:26:08.722894+0000","last_peered":"2023-10-08T13:26:08.722894+0000","last_clean":"2023-10-08T13:26:08.722894+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:26:08.722894+0000","last_undegraded":"2023-10-08T13:26:08.722894+0000","last_fullsized":"2023-10-08T13:26:08.722894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721816+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:26:08.721816+0000","last_peered":"2023-10-08T13:26:08.721816+0000","last_clean":"2023-10-08T13:26:08.721816+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:26:08.721816+0000","last_undegraded":"2023-10-08T13:26:08.721816+0000","last_fullsized":"2023-10-08T13:26:08.721816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722952+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:26:08.722952+0000","last_peered":"2023-10-08T13:26:08.722952+0000","last_clean":"2023-10-08T13:26:08.722952+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:26:08.722952+0000","last_undegraded":"2023-10-08T13:26:08.722952+0000","last_fullsized":"2023-10-08T13:26:08.722952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717454+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:26:08.717454+0000","last_peered":"2023-10-08T13:26:08.717454+0000","last_clean":"2023-10-08T13:26:08.717454+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:26:08.717454+0000","last_undegraded":"2023-10-08T13:26:08.717454+0000","last_fullsized":"2023-10-08T13:26:08.717454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765180+0000","last_change":"2023-10-08T13:26:09.765180+0000","last_active":"2023-10-08T13:26:09.765180+0000","last_peered":"2023-10-08T13:26:09.765180+0000","last_clean":"2023-10-08T13:26:09.765180+0000","last_became_active":"2023-10-08T13:26:09.764692+0000","last_became_peered":"2023-10-08T13:26:09.764692+0000","last_unstale":"2023-10-08T13:26:09.765180+0000","last_undegraded":"2023-10-08T13:26:09.765180+0000","last_fullsized":"2023-10-08T13:26:09.765180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:15.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.334782+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:26:09.334782+0000","last_peered":"2023-10-08T13:26:09.334782+0000","last_clean":"2023-10-08T13:26:09.334782+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:26:09.334782+0000","last_undegraded":"2023-10-08T13:26:09.334782+0000","last_fullsized":"2023-10-08T13:26:09.334782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719600+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:26:08.719600+0000","last_peered":"2023-10-08T13:26:08.719600+0000","last_clean":"2023-10-08T13:26:08.719600+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:26:08.719600+0000","last_undegraded":"2023-10-08T13:26:08.719600+0000","last_fullsized":"2023-10-08T13:26:08.719600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765527+0000","last_change":"2023-10-08T13:26:09.765527+0000","last_active":"2023-10-08T13:26:09.765527+0000","last_peered":"2023-10-08T13:26:09.765527+0000","last_clean":"2023-10-08T13:26:09.765527+0000","last_became_active":"2023-10-08T13:26:09.764823+0000","last_became_peered":"2023-10-08T13:26:09.764823+0000","last_unstale":"2023-10-08T13:26:09.765527+0000","last_undegraded":"2023-10-08T13:26:09.765527+0000","last_fullsized":"2023-10-08T13:26:09.765527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:28:41.632170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719923+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:26:08.719923+0000","last_peered":"2023-10-08T13:26:08.719923+0000","last_clean":"2023-10-08T13:26:08.719923+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:26:08.719923+0000","last_undegraded":"2023-10-08T13:26:08.719923+0000","last_fullsized":"2023-10-08T13:26:08.719923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721308+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:26:08.721308+0000","last_peered":"2023-10-08T13:26:08.721308+0000","last_clean":"2023-10-08T13:26:08.721308+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:26:08.721308+0000","last_undegraded":"2023-10-08T13:26:08.721308+0000","last_fullsized":"2023-10-08T13:26:08.721308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726074+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:26:08.726074+0000","last_peered":"2023-10-08T13:26:08.726074+0000","last_clean":"2023-10-08T13:26:08.726074+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:26:08.726074+0000","last_undegraded":"2023-10-08T13:26:08.726074+0000","last_fullsized":"2023-10-08T13:26:08.726074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:39.472908+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:26:39.472908+0000","last_peered":"2023-10-08T13:26:39.472908+0000","last_clean":"2023-10-08T13:26:39.472908+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:26:39.472908+0000","last_undegraded":"2023-10-08T13:26:39.472908+0000","last_fullsized":"2023-10-08T13:26:39.472908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719390+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:26:08.719390+0000","last_peered":"2023-10-08T13:26:08.719390+0000","last_clean":"2023-10-08T13:26:08.719390+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:26:08.719390+0000","last_undegraded":"2023-10-08T13:26:08.719390+0000","last_fullsized":"2023-10-08T13:26:08.719390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726034+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:26:08.726034+0000","last_peered":"2023-10-08T13:26:08.726034+0000","last_clean":"2023-10-08T13:26:08.726034+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:26:08.726034+0000","last_undegraded":"2023-10-08T13:26:08.726034+0000","last_fullsized":"2023-10-08T13:26:08.726034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722823+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:26:08.722823+0000","last_peered":"2023-10-08T13:26:08.722823+0000","last_clean":"2023-10-08T13:26:08.722823+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:26:08.722823+0000","last_undegraded":"2023-10-08T13:26:08.722823+0000","last_fullsized":"2023-10-08T13:26:08.722823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721218+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:26:08.721218+0000","last_peered":"2023-10-08T13:26:08.721218+0000","last_clean":"2023-10-08T13:26:08.721218+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:26:08.721218+0000","last_undegraded":"2023-10-08T13:26:08.721218+0000","last_fullsized":"2023-10-08T13:26:08.721218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716581+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:26:08.716581+0000","last_peered":"2023-10-08T13:26:08.716581+0000","last_clean":"2023-10-08T13:26:08.716581+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:26:08.716581+0000","last_undegraded":"2023-10-08T13:26:08.716581+0000","last_fullsized":"2023-10-08T13:26:08.716581+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720715+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:26:08.720715+0000","last_peered":"2023-10-08T13:26:08.720715+0000","last_clean":"2023-10-08T13:26:08.720715+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:26:08.720715+0000","last_undegraded":"2023-10-08T13:26:08.720715+0000","last_fullsized":"2023-10-08T13:26:08.720715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722027+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:26:08.722027+0000","last_peered":"2023-10-08T13:26:08.722027+0000","last_clean":"2023-10-08T13:26:08.722027+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:26:08.722027+0000","last_undegraded":"2023-10-08T13:26:08.722027+0000","last_fullsized":"2023-10-08T13:26:08.722027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718232+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:26:08.718232+0000","last_peered":"2023-10-08T13:26:08.718232+0000","last_clean":"2023-10-08T13:26:08.718232+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:26:08.718232+0000","last_undegraded":"2023-10-08T13:26:08.718232+0000","last_fullsized":"2023-10-08T13:26:08.718232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720093+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:26:08.720093+0000","last_peered":"2023-10-08T13:26:08.720093+0000","last_clean":"2023-10-08T13:26:08.720093+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:26:08.720093+0000","last_undegraded":"2023-10-08T13:26:08.720093+0000","last_fullsized":"2023-10-08T13:26:08.720093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720474+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:26:08.720474+0000","last_peered":"2023-10-08T13:26:08.720474+0000","last_clean":"2023-10-08T13:26:08.720474+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:26:08.720474+0000","last_undegraded":"2023-10-08T13:26:08.720474+0000","last_fullsized":"2023-10-08T13:26:08.720474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722165+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:26:08.722165+0000","last_peered":"2023-10-08T13:26:08.722165+0000","last_clean":"2023-10-08T13:26:08.722165+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:26:08.722165+0000","last_undegraded":"2023-10-08T13:26:08.722165+0000","last_fullsized":"2023-10-08T13:26:08.722165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:37.469773+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:26:37.469773+0000","last_peered":"2023-10-08T13:26:37.469773+0000","last_clean":"2023-10-08T13:26:37.469773+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:26:37.469773+0000","last_undegraded":"2023-10-08T13:26:37.469773+0000","last_fullsized":"2023-10-08T13:26:37.469773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720424+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:26:08.720424+0000","last_peered":"2023-10-08T13:26:08.720424+0000","last_clean":"2023-10-08T13:26:08.720424+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:26:08.720424+0000","last_undegraded":"2023-10-08T13:26:08.720424+0000","last_fullsized":"2023-10-08T13:26:08.720424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720152+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:26:08.720152+0000","last_peered":"2023-10-08T13:26:08.720152+0000","last_clean":"2023-10-08T13:26:08.720152+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:26:08.720152+0000","last_undegraded":"2023-10-08T13:26:08.720152+0000","last_fullsized":"2023-10-08T13:26:08.720152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717505+0000","last_change":"2023-10-08T13:25:33.439513+0000","last_active":"2023-10-08T13:26:08.717505+0000","last_peered":"2023-10-08T13:26:08.717505+0000","last_clean":"2023-10-08T13:26:08.717505+0000","last_became_active":"2023-10-08T13:25:33.439118+0000","last_became_peered":"2023-10-08T13:25:33.439118+0000","last_unstale":"2023-10-08T13:26:08.717505+0000","last_undegraded":"2023-10-08T13:26:08.717505+0000","last_fullsized":"2023-10-08T13:26:08.717505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:05.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.730654+0000","last_change":"2023-10-08T13:26:09.730654+0000","last_active":"2023-10-08T13:26:09.730654+0000","last_peered":"2023-10-08T13:26:09.730654+0000","last_clean":"2023-10-08T13:26:09.730654+0000","last_became_active":"2023-10-08T13:26:09.730372+0000","last_became_peered":"2023-10-08T13:26:09.730372+0000","last_unstale":"2023-10-08T13:26:09.730654+0000","last_undegraded":"2023-10-08T13:26:09.730654+0000","last_fullsized":"2023-10-08T13:26:09.730654+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:10:09.821192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722316+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:26:08.722316+0000","last_peered":"2023-10-08T13:26:08.722316+0000","last_clean":"2023-10-08T13:26:08.722316+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:26:08.722316+0000","last_undegraded":"2023-10-08T13:26:08.722316+0000","last_fullsized":"2023-10-08T13:26:08.722316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721261+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:26:08.721261+0000","last_peered":"2023-10-08T13:26:08.721261+0000","last_clean":"2023-10-08T13:26:08.721261+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:26:08.721261+0000","last_undegraded":"2023-10-08T13:26:08.721261+0000","last_fullsized":"2023-10-08T13:26:08.721261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.724775+0000","last_change":"2023-10-08T13:26:09.724775+0000","last_active":"2023-10-08T13:26:09.724775+0000","last_peered":"2023-10-08T13:26:09.724775+0000","last_clean":"2023-10-08T13:26:09.724775+0000","last_became_active":"2023-10-08T13:26:09.724388+0000","last_became_peered":"2023-10-08T13:26:09.724388+0000","last_unstale":"2023-10-08T13:26:09.724775+0000","last_undegraded":"2023-10-08T13:26:09.724775+0000","last_fullsized":"2023-10-08T13:26:09.724775+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:17.186799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719197+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:26:08.719197+0000","last_peered":"2023-10-08T13:26:08.719197+0000","last_clean":"2023-10-08T13:26:08.719197+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:26:08.719197+0000","last_undegraded":"2023-10-08T13:26:08.719197+0000","last_fullsized":"2023-10-08T13:26:08.719197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":126,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:37.469785+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:26:37.469785+0000","last_peered":"2023-10-08T13:26:37.469785+0000","last_clean":"2023-10-08T13:26:37.469785+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:26:37.469785+0000","last_undegraded":"2023-10-08T13:26:37.469785+0000","last_fullsized":"2023-10-08T13:26:37.469785+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":74,"num_read_kb":93,"num_write":36,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720763+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:26:08.720763+0000","last_peered":"2023-10-08T13:26:08.720763+0000","last_clean":"2023-10-08T13:26:08.720763+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:26:08.720763+0000","last_undegraded":"2023-10-08T13:26:08.720763+0000","last_fullsized":"2023-10-08T13:26:08.720763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721456+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:26:08.721456+0000","last_peered":"2023-10-08T13:26:08.721456+0000","last_clean":"2023-10-08T13:26:08.721456+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:26:08.721456+0000","last_undegraded":"2023-10-08T13:26:08.721456+0000","last_fullsized":"2023-10-08T13:26:08.721456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726335+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:26:08.726335+0000","last_peered":"2023-10-08T13:26:08.726335+0000","last_clean":"2023-10-08T13:26:08.726335+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:26:08.726335+0000","last_undegraded":"2023-10-08T13:26:08.726335+0000","last_fullsized":"2023-10-08T13:26:08.726335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719826+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:26:08.719826+0000","last_peered":"2023-10-08T13:26:08.719826+0000","last_clean":"2023-10-08T13:26:08.719826+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:26:08.719826+0000","last_undegraded":"2023-10-08T13:26:08.719826+0000","last_fullsized":"2023-10-08T13:26:08.719826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716429+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:26:08.716429+0000","last_peered":"2023-10-08T13:26:08.716429+0000","last_clean":"2023-10-08T13:26:08.716429+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:26:08.716429+0000","last_undegraded":"2023-10-08T13:26:08.716429+0000","last_fullsized":"2023-10-08T13:26:08.716429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721168+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:26:08.721168+0000","last_peered":"2023-10-08T13:26:08.721168+0000","last_clean":"2023-10-08T13:26:08.721168+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:26:08.721168+0000","last_undegraded":"2023-10-08T13:26:08.721168+0000","last_fullsized":"2023-10-08T13:26:08.721168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717331+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:26:08.717331+0000","last_peered":"2023-10-08T13:26:08.717331+0000","last_clean":"2023-10-08T13:26:08.717331+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:26:08.717331+0000","last_undegraded":"2023-10-08T13:26:08.717331+0000","last_fullsized":"2023-10-08T13:26:08.717331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720566+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:26:08.720566+0000","last_peered":"2023-10-08T13:26:08.720566+0000","last_clean":"2023-10-08T13:26:08.720566+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:26:08.720566+0000","last_undegraded":"2023-10-08T13:26:08.720566+0000","last_fullsized":"2023-10-08T13:26:08.720566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:39.472982+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:26:39.472982+0000","last_peered":"2023-10-08T13:26:39.472982+0000","last_clean":"2023-10-08T13:26:39.472982+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:26:39.472982+0000","last_undegraded":"2023-10-08T13:26:39.472982+0000","last_fullsized":"2023-10-08T13:26:39.472982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717148+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:26:08.717148+0000","last_peered":"2023-10-08T13:26:08.717148+0000","last_clean":"2023-10-08T13:26:08.717148+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:26:08.717148+0000","last_undegraded":"2023-10-08T13:26:08.717148+0000","last_fullsized":"2023-10-08T13:26:08.717148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765328+0000","last_change":"2023-10-08T13:26:09.765328+0000","last_active":"2023-10-08T13:26:09.765328+0000","last_peered":"2023-10-08T13:26:09.765328+0000","last_clean":"2023-10-08T13:26:09.765328+0000","last_became_active":"2023-10-08T13:26:09.764889+0000","last_became_peered":"2023-10-08T13:26:09.764889+0000","last_unstale":"2023-10-08T13:26:09.765328+0000","last_undegraded":"2023-10-08T13:26:09.765328+0000","last_fullsized":"2023-10-08T13:26:09.765328+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:54.280258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719172+0000","last_change":"2023-10-08T13:25:33.440499+0000","last_active":"2023-10-08T13:26:08.719172+0000","last_peered":"2023-10-08T13:26:08.719172+0000","last_clean":"2023-10-08T13:26:08.719172+0000","last_became_active":"2023-10-08T13:25:33.440191+0000","last_became_peered":"2023-10-08T13:25:33.440191+0000","last_unstale":"2023-10-08T13:26:08.719172+0000","last_undegraded":"2023-10-08T13:26:08.719172+0000","last_fullsized":"2023-10-08T13:26:08.719172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:47.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720598+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:26:08.720598+0000","last_peered":"2023-10-08T13:26:08.720598+0000","last_clean":"2023-10-08T13:26:08.720598+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:26:08.720598+0000","last_undegraded":"2023-10-08T13:26:08.720598+0000","last_fullsized":"2023-10-08T13:26:08.720598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720502+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:26:08.720502+0000","last_peered":"2023-10-08T13:26:08.720502+0000","last_clean":"2023-10-08T13:26:08.720502+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:26:08.720502+0000","last_undegraded":"2023-10-08T13:26:08.720502+0000","last_fullsized":"2023-10-08T13:26:08.720502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720617+0000","last_change":"2023-10-08T13:25:33.435437+0000","last_active":"2023-10-08T13:26:08.720617+0000","last_peered":"2023-10-08T13:26:08.720617+0000","last_clean":"2023-10-08T13:26:08.720617+0000","last_became_active":"2023-10-08T13:25:33.435097+0000","last_became_peered":"2023-10-08T13:25:33.435097+0000","last_unstale":"2023-10-08T13:26:08.720617+0000","last_undegraded":"2023-10-08T13:26:08.720617+0000","last_fullsized":"2023-10-08T13:26:08.720617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:15.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716645+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:26:08.716645+0000","last_peered":"2023-10-08T13:26:08.716645+0000","last_clean":"2023-10-08T13:26:08.716645+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:26:08.716645+0000","last_undegraded":"2023-10-08T13:26:08.716645+0000","last_fullsized":"2023-10-08T13:26:08.716645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719287+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:26:08.719287+0000","last_peered":"2023-10-08T13:26:08.719287+0000","last_clean":"2023-10-08T13:26:08.719287+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:26:08.719287+0000","last_undegraded":"2023-10-08T13:26:08.719287+0000","last_fullsized":"2023-10-08T13:26:08.719287+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720222+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:26:08.720222+0000","last_peered":"2023-10-08T13:26:08.720222+0000","last_clean":"2023-10-08T13:26:08.720222+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:26:08.720222+0000","last_undegraded":"2023-10-08T13:26:08.720222+0000","last_fullsized":"2023-10-08T13:26:08.720222+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724146+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:26:08.724146+0000","last_peered":"2023-10-08T13:26:08.724146+0000","last_clean":"2023-10-08T13:26:08.724146+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:26:08.724146+0000","last_undegraded":"2023-10-08T13:26:08.724146+0000","last_fullsized":"2023-10-08T13:26:08.724146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720040+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:26:08.720040+0000","last_peered":"2023-10-08T13:26:08.720040+0000","last_clean":"2023-10-08T13:26:08.720040+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:26:08.720040+0000","last_undegraded":"2023-10-08T13:26:08.720040+0000","last_fullsized":"2023-10-08T13:26:08.720040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:38.471870+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:26:38.471870+0000","last_peered":"2023-10-08T13:26:38.471870+0000","last_clean":"2023-10-08T13:26:38.471870+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:26:38.471870+0000","last_undegraded":"2023-10-08T13:26:38.471870+0000","last_fullsized":"2023-10-08T13:26:38.471870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.723269+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:26:08.723269+0000","last_peered":"2023-10-08T13:26:08.723269+0000","last_clean":"2023-10-08T13:26:08.723269+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:26:08.723269+0000","last_undegraded":"2023-10-08T13:26:08.723269+0000","last_fullsized":"2023-10-08T13:26:08.723269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719904+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:26:08.719904+0000","last_peered":"2023-10-08T13:26:08.719904+0000","last_clean":"2023-10-08T13:26:08.719904+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:26:08.719904+0000","last_undegraded":"2023-10-08T13:26:08.719904+0000","last_fullsized":"2023-10-08T13:26:08.719904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720200+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:26:08.720200+0000","last_peered":"2023-10-08T13:26:08.720200+0000","last_clean":"2023-10-08T13:26:08.720200+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:26:08.720200+0000","last_undegraded":"2023-10-08T13:26:08.720200+0000","last_fullsized":"2023-10-08T13:26:08.720200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":59,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:37.470854+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:26:37.470854+0000","last_peered":"2023-10-08T13:26:37.470854+0000","last_clean":"2023-10-08T13:26:37.470854+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:26:37.470854+0000","last_undegraded":"2023-10-08T13:26:37.470854+0000","last_fullsized":"2023-10-08T13:26:37.470854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.734878+0000","last_change":"2023-10-08T13:26:09.734878+0000","last_active":"2023-10-08T13:26:09.734878+0000","last_peered":"2023-10-08T13:26:09.734878+0000","last_clean":"2023-10-08T13:26:09.734878+0000","last_became_active":"2023-10-08T13:26:09.730200+0000","last_became_peered":"2023-10-08T13:26:09.730200+0000","last_unstale":"2023-10-08T13:26:09.734878+0000","last_undegraded":"2023-10-08T13:26:09.734878+0000","last_fullsized":"2023-10-08T13:26:09.734878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:33.060346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.723078+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:26:08.723078+0000","last_peered":"2023-10-08T13:26:08.723078+0000","last_clean":"2023-10-08T13:26:08.723078+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:26:08.723078+0000","last_undegraded":"2023-10-08T13:26:08.723078+0000","last_fullsized":"2023-10-08T13:26:08.723078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722217+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:26:08.722217+0000","last_peered":"2023-10-08T13:26:08.722217+0000","last_clean":"2023-10-08T13:26:08.722217+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:26:08.722217+0000","last_undegraded":"2023-10-08T13:26:08.722217+0000","last_fullsized":"2023-10-08T13:26:08.722217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716997+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:26:08.716997+0000","last_peered":"2023-10-08T13:26:08.716997+0000","last_clean":"2023-10-08T13:26:08.716997+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:26:08.716997+0000","last_undegraded":"2023-10-08T13:26:08.716997+0000","last_fullsized":"2023-10-08T13:26:08.716997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720806+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:26:08.720806+0000","last_peered":"2023-10-08T13:26:08.720806+0000","last_clean":"2023-10-08T13:26:08.720806+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:26:08.720806+0000","last_undegraded":"2023-10-08T13:26:08.720806+0000","last_fullsized":"2023-10-08T13:26:08.720806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720542+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:26:08.720542+0000","last_peered":"2023-10-08T13:26:08.720542+0000","last_clean":"2023-10-08T13:26:08.720542+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:26:08.720542+0000","last_undegraded":"2023-10-08T13:26:08.720542+0000","last_fullsized":"2023-10-08T13:26:08.720542+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717119+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:26:08.717119+0000","last_peered":"2023-10-08T13:26:08.717119+0000","last_clean":"2023-10-08T13:26:08.717119+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:26:08.717119+0000","last_undegraded":"2023-10-08T13:26:08.717119+0000","last_fullsized":"2023-10-08T13:26:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716377+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:26:08.716377+0000","last_peered":"2023-10-08T13:26:08.716377+0000","last_clean":"2023-10-08T13:26:08.716377+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:26:08.716377+0000","last_undegraded":"2023-10-08T13:26:08.716377+0000","last_fullsized":"2023-10-08T13:26:08.716377+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720866+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:26:08.720866+0000","last_peered":"2023-10-08T13:26:08.720866+0000","last_clean":"2023-10-08T13:26:08.720866+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:26:08.720866+0000","last_undegraded":"2023-10-08T13:26:08.720866+0000","last_fullsized":"2023-10-08T13:26:08.720866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720175+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:26:08.720175+0000","last_peered":"2023-10-08T13:26:08.720175+0000","last_clean":"2023-10-08T13:26:08.720175+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:26:08.720175+0000","last_undegraded":"2023-10-08T13:26:08.720175+0000","last_fullsized":"2023-10-08T13:26:08.720175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721916+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:26:08.721916+0000","last_peered":"2023-10-08T13:26:08.721916+0000","last_clean":"2023-10-08T13:26:08.721916+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:26:08.721916+0000","last_undegraded":"2023-10-08T13:26:08.721916+0000","last_fullsized":"2023-10-08T13:26:08.721916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.727891+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:26:09.727891+0000","last_peered":"2023-10-08T13:26:09.727891+0000","last_clean":"2023-10-08T13:26:09.727891+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:26:09.727891+0000","last_undegraded":"2023-10-08T13:26:09.727891+0000","last_fullsized":"2023-10-08T13:26:09.727891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722295+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:26:08.722295+0000","last_peered":"2023-10-08T13:26:08.722295+0000","last_clean":"2023-10-08T13:26:08.722295+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:26:08.722295+0000","last_undegraded":"2023-10-08T13:26:08.722295+0000","last_fullsized":"2023-10-08T13:26:08.722295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725710+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:26:08.725710+0000","last_peered":"2023-10-08T13:26:08.725710+0000","last_clean":"2023-10-08T13:26:08.725710+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:26:08.725710+0000","last_undegraded":"2023-10-08T13:26:08.725710+0000","last_fullsized":"2023-10-08T13:26:08.725710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722906+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:26:08.722906+0000","last_peered":"2023-10-08T13:26:08.722906+0000","last_clean":"2023-10-08T13:26:08.722906+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:26:08.722906+0000","last_undegraded":"2023-10-08T13:26:08.722906+0000","last_fullsized":"2023-10-08T13:26:08.722906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718308+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:26:08.718308+0000","last_peered":"2023-10-08T13:26:08.718308+0000","last_clean":"2023-10-08T13:26:08.718308+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:26:08.718308+0000","last_undegraded":"2023-10-08T13:26:08.718308+0000","last_fullsized":"2023-10-08T13:26:08.718308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721965+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:26:08.721965+0000","last_peered":"2023-10-08T13:26:08.721965+0000","last_clean":"2023-10-08T13:26:08.721965+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:26:08.721965+0000","last_undegraded":"2023-10-08T13:26:08.721965+0000","last_fullsized":"2023-10-08T13:26:08.721965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719407+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:26:08.719407+0000","last_peered":"2023-10-08T13:26:08.719407+0000","last_clean":"2023-10-08T13:26:08.719407+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:26:08.719407+0000","last_undegraded":"2023-10-08T13:26:08.719407+0000","last_fullsized":"2023-10-08T13:26:08.719407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719203+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:26:08.719203+0000","last_peered":"2023-10-08T13:26:08.719203+0000","last_clean":"2023-10-08T13:26:08.719203+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:26:08.719203+0000","last_undegraded":"2023-10-08T13:26:08.719203+0000","last_fullsized":"2023-10-08T13:26:08.719203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720107+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:26:08.720107+0000","last_peered":"2023-10-08T13:26:08.720107+0000","last_clean":"2023-10-08T13:26:08.720107+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:26:08.720107+0000","last_undegraded":"2023-10-08T13:26:08.720107+0000","last_fullsized":"2023-10-08T13:26:08.720107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722029+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:26:08.722029+0000","last_peered":"2023-10-08T13:26:08.722029+0000","last_clean":"2023-10-08T13:26:08.722029+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:26:08.722029+0000","last_undegraded":"2023-10-08T13:26:08.722029+0000","last_fullsized":"2023-10-08T13:26:08.722029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716250+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:26:08.716250+0000","last_peered":"2023-10-08T13:26:08.716250+0000","last_clean":"2023-10-08T13:26:08.716250+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:26:08.716250+0000","last_undegraded":"2023-10-08T13:26:08.716250+0000","last_fullsized":"2023-10-08T13:26:08.716250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724464+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:26:08.724464+0000","last_peered":"2023-10-08T13:26:08.724464+0000","last_clean":"2023-10-08T13:26:08.724464+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:26:08.724464+0000","last_undegraded":"2023-10-08T13:26:08.724464+0000","last_fullsized":"2023-10-08T13:26:08.724464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726316+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:26:08.726316+0000","last_peered":"2023-10-08T13:26:08.726316+0000","last_clean":"2023-10-08T13:26:08.726316+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:26:08.726316+0000","last_undegraded":"2023-10-08T13:26:08.726316+0000","last_fullsized":"2023-10-08T13:26:08.726316+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722772+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:26:08.722772+0000","last_peered":"2023-10-08T13:26:08.722772+0000","last_clean":"2023-10-08T13:26:08.722772+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:26:08.722772+0000","last_undegraded":"2023-10-08T13:26:08.722772+0000","last_fullsized":"2023-10-08T13:26:08.722772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722556+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:26:08.722556+0000","last_peered":"2023-10-08T13:26:08.722556+0000","last_clean":"2023-10-08T13:26:08.722556+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:26:08.722556+0000","last_undegraded":"2023-10-08T13:26:08.722556+0000","last_fullsized":"2023-10-08T13:26:08.722556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719375+0000","last_change":"2023-10-08T13:25:33.439503+0000","last_active":"2023-10-08T13:26:08.719375+0000","last_peered":"2023-10-08T13:26:08.719375+0000","last_clean":"2023-10-08T13:26:08.719375+0000","last_became_active":"2023-10-08T13:25:33.439197+0000","last_became_peered":"2023-10-08T13:25:33.439197+0000","last_unstale":"2023-10-08T13:26:08.719375+0000","last_undegraded":"2023-10-08T13:26:08.719375+0000","last_fullsized":"2023-10-08T13:26:08.719375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:19.983872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717438+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:26:08.717438+0000","last_peered":"2023-10-08T13:26:08.717438+0000","last_clean":"2023-10-08T13:26:08.717438+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:26:08.717438+0000","last_undegraded":"2023-10-08T13:26:08.717438+0000","last_fullsized":"2023-10-08T13:26:08.717438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719762+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:26:08.719762+0000","last_peered":"2023-10-08T13:26:08.719762+0000","last_clean":"2023-10-08T13:26:08.719762+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:26:08.719762+0000","last_undegraded":"2023-10-08T13:26:08.719762+0000","last_fullsized":"2023-10-08T13:26:08.719762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:38.471776+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:26:38.471776+0000","last_peered":"2023-10-08T13:26:38.471776+0000","last_clean":"2023-10-08T13:26:38.471776+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:26:38.471776+0000","last_undegraded":"2023-10-08T13:26:38.471776+0000","last_fullsized":"2023-10-08T13:26:38.471776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717804+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:26:08.717804+0000","last_peered":"2023-10-08T13:26:08.717804+0000","last_clean":"2023-10-08T13:26:08.717804+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:26:08.717804+0000","last_undegraded":"2023-10-08T13:26:08.717804+0000","last_fullsized":"2023-10-08T13:26:08.717804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717213+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:26:08.717213+0000","last_peered":"2023-10-08T13:26:08.717213+0000","last_clean":"2023-10-08T13:26:08.717213+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:26:08.717213+0000","last_undegraded":"2023-10-08T13:26:08.717213+0000","last_fullsized":"2023-10-08T13:26:08.717213+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721375+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:26:08.721375+0000","last_peered":"2023-10-08T13:26:08.721375+0000","last_clean":"2023-10-08T13:26:08.721375+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:26:08.721375+0000","last_undegraded":"2023-10-08T13:26:08.721375+0000","last_fullsized":"2023-10-08T13:26:08.721375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.729493+0000","last_change":"2023-10-08T13:26:09.729493+0000","last_active":"2023-10-08T13:26:09.729493+0000","last_peered":"2023-10-08T13:26:09.729493+0000","last_clean":"2023-10-08T13:26:09.729493+0000","last_became_active":"2023-10-08T13:26:09.729238+0000","last_became_peered":"2023-10-08T13:26:09.729238+0000","last_unstale":"2023-10-08T13:26:09.729493+0000","last_undegraded":"2023-10-08T13:26:09.729493+0000","last_fullsized":"2023-10-08T13:26:09.729493+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.262086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719417+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:26:08.719417+0000","last_peered":"2023-10-08T13:26:08.719417+0000","last_clean":"2023-10-08T13:26:08.719417+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:26:08.719417+0000","last_undegraded":"2023-10-08T13:26:08.719417+0000","last_fullsized":"2023-10-08T13:26:08.719417+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719802+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:26:08.719802+0000","last_peered":"2023-10-08T13:26:08.719802+0000","last_clean":"2023-10-08T13:26:08.719802+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:26:08.719802+0000","last_undegraded":"2023-10-08T13:26:08.719802+0000","last_fullsized":"2023-10-08T13:26:08.719802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717658+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:26:08.717658+0000","last_peered":"2023-10-08T13:26:08.717658+0000","last_clean":"2023-10-08T13:26:08.717658+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:26:08.717658+0000","last_undegraded":"2023-10-08T13:26:08.717658+0000","last_fullsized":"2023-10-08T13:26:08.717658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716332+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:26:08.716332+0000","last_peered":"2023-10-08T13:26:08.716332+0000","last_clean":"2023-10-08T13:26:08.716332+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:26:08.716332+0000","last_undegraded":"2023-10-08T13:26:08.716332+0000","last_fullsized":"2023-10-08T13:26:08.716332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725961+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:26:08.725961+0000","last_peered":"2023-10-08T13:26:08.725961+0000","last_clean":"2023-10-08T13:26:08.725961+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:26:08.725961+0000","last_undegraded":"2023-10-08T13:26:08.725961+0000","last_fullsized":"2023-10-08T13:26:08.725961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725819+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:26:08.725819+0000","last_peered":"2023-10-08T13:26:08.725819+0000","last_clean":"2023-10-08T13:26:08.725819+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:26:08.725819+0000","last_undegraded":"2023-10-08T13:26:08.725819+0000","last_fullsized":"2023-10-08T13:26:08.725819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717410+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:26:08.717410+0000","last_peered":"2023-10-08T13:26:08.717410+0000","last_clean":"2023-10-08T13:26:08.717410+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:26:08.717410+0000","last_undegraded":"2023-10-08T13:26:08.717410+0000","last_fullsized":"2023-10-08T13:26:08.717410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720252+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:26:08.720252+0000","last_peered":"2023-10-08T13:26:08.720252+0000","last_clean":"2023-10-08T13:26:08.720252+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:26:08.720252+0000","last_undegraded":"2023-10-08T13:26:08.720252+0000","last_fullsized":"2023-10-08T13:26:08.720252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.729602+0000","last_change":"2023-10-08T13:26:09.729602+0000","last_active":"2023-10-08T13:26:09.729602+0000","last_peered":"2023-10-08T13:26:09.729602+0000","last_clean":"2023-10-08T13:26:09.729602+0000","last_became_active":"2023-10-08T13:26:09.729112+0000","last_became_peered":"2023-10-08T13:26:09.729112+0000","last_unstale":"2023-10-08T13:26:09.729602+0000","last_undegraded":"2023-10-08T13:26:09.729602+0000","last_fullsized":"2023-10-08T13:26:09.729602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:29.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726356+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:26:08.726356+0000","last_peered":"2023-10-08T13:26:08.726356+0000","last_clean":"2023-10-08T13:26:08.726356+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:26:08.726356+0000","last_undegraded":"2023-10-08T13:26:08.726356+0000","last_fullsized":"2023-10-08T13:26:08.726356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722449+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:26:08.722449+0000","last_peered":"2023-10-08T13:26:08.722449+0000","last_clean":"2023-10-08T13:26:08.722449+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:26:08.722449+0000","last_undegraded":"2023-10-08T13:26:08.722449+0000","last_fullsized":"2023-10-08T13:26:08.722449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720999+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:26:08.720999+0000","last_peered":"2023-10-08T13:26:08.720999+0000","last_clean":"2023-10-08T13:26:08.720999+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:26:08.720999+0000","last_undegraded":"2023-10-08T13:26:08.720999+0000","last_fullsized":"2023-10-08T13:26:08.720999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722011+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:26:08.722011+0000","last_peered":"2023-10-08T13:26:08.722011+0000","last_clean":"2023-10-08T13:26:08.722011+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:26:08.722011+0000","last_undegraded":"2023-10-08T13:26:08.722011+0000","last_fullsized":"2023-10-08T13:26:08.722011+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720130+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:26:08.720130+0000","last_peered":"2023-10-08T13:26:08.720130+0000","last_clean":"2023-10-08T13:26:08.720130+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:26:08.720130+0000","last_undegraded":"2023-10-08T13:26:08.720130+0000","last_fullsized":"2023-10-08T13:26:08.720130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719160+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:26:08.719160+0000","last_peered":"2023-10-08T13:26:08.719160+0000","last_clean":"2023-10-08T13:26:08.719160+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:26:08.719160+0000","last_undegraded":"2023-10-08T13:26:08.719160+0000","last_fullsized":"2023-10-08T13:26:08.719160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716507+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:26:08.716507+0000","last_peered":"2023-10-08T13:26:08.716507+0000","last_clean":"2023-10-08T13:26:08.716507+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:26:08.716507+0000","last_undegraded":"2023-10-08T13:26:08.716507+0000","last_fullsized":"2023-10-08T13:26:08.716507+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65395,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":391,"num_read_kb":264,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":196185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":504412,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.498},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63600000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65400000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.68899999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":1153576,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":9.8559999999999999,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.8759999999999994,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.69399999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.6539999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51900000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.38400000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.609},{"interface":"front","average":{"1min":1.075,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":1.639}]},{"osd":9,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.86199999999999999,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.7279999999999998,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2539999999999996,"5min":4.2539999999999996,"15min":4.2539999999999996},"last":0.64600000000000002}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.6279999999999999}]}]},{"osd":9,"up_from":66,"seq":283467841570,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":504342,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76000000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.63800000000000001,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82599999999999996,"5min":0.997,"15min":0.997},"last":0.746}]},{"osd":2,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60099999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72399999999999998,"5min":1.04,"15min":1.04},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.755,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.876}]},{"osd":5,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88400000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85599999999999998,"5min":1.462,"15min":1.462},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.85699999999999998,"15min":0.88900000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":2.484,"15min":2.484},"last":0.93100000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84599999999999997,"5min":1.03,"15min":1.03},"last":0.79800000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.90600000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":11.278,"5min":11.278,"15min":11.278},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85799999999999998,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.83599999999999997}]},{"osd":11,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.96399999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103206,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":500343,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.62,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65100000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.497,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.59599999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.313,"5min":0.311,"15min":0.311},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.319,"5min":4.319,"15min":4.319},"last":0.80600000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Sun Oct 8 13:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68000000000000005,"15min":0.66900000000000004},"min":{"1min":0.55600000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.88900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.63,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.98099999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.87},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84399999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1097120,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88300000000000001,"5min":0.995,"15min":0.995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.607}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.497}]},{"osd":5,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.53800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.585}]},{"osd":6,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85999999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65800000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.002,"5min":1.05,"15min":1.05},"last":0.748}]},{"osd":9,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58599999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.036,"15min":1.036},"last":1.488}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495661,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":499846,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.26800000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.495,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.314}]},{"osd":1,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74399999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40799999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":1.085,"15min":1.085},"last":0.434},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.65700000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65400000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":1.131,"15min":1.131},"last":0.497},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.624},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":1.179,"15min":1.179},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47099999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79900000000000004,"5min":1.206,"15min":1.206},"last":0.53400000000000003}]},{"osd":7,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58399999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85399999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64900000000000002}]},{"osd":9,"last update":"Sun Oct 8 13:26:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.60699999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66200000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542210,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":563555,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.70999999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42199999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.42299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.35699999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.437},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.755,"15min":0.80300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.48599999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.46700000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47499999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.40100000000000002}]},{"osd":9,"last update":"Sun Oct 8 13:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.58199999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56899999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.496},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.53800000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.55900000000000005}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":501302,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79300000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.434}]},{"osd":4,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":0.996,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":45.225000000000001,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":2.7130000000000001,"5min":0.98499999999999999,"15min":0.68300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":45.244,"5min":45.244,"15min":45.244},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47199999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53500000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92700000000000005,"5min":3.403,"15min":3.403},"last":0.67600000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:26:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":1.026,"15min":1.026},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.625}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97099999999999997,"5min":1.008,"15min":1.008},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69499999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70599999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":564165,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68600000000000005,"5min":0.872,"15min":0.872},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.442,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.97599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.44400000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59299999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66600000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64500000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.58899999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.75700000000000001,"15min":0.73399999999999999},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.054,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.627}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":1.002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":499273,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32100000000000001},"min":{"1min":0.27000000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.32500000000000001},"min":{"1min":0.28499999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.62,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32000000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.499},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":1.806,"15min":1.806},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.439}]},{"osd":2,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.51700000000000002},"min":{"1min":0.49099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.5},"min":{"1min":0.432,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46000000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.48999999999999999},"min":{"1min":0.375,"5min":0.246,"15min":0.246},"max":{"1min":0.76900000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.47699999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.60099999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.42099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84599999999999997,"5min":1.05,"15min":1.05},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80400000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57399999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.88800000000000001,"5min":1.583,"15min":1.583},"last":0.621}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.629},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60899999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":503920,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.504,"5min":0.436,"15min":0.39400000000000002},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.55500000000000005},"min":{"1min":0.50900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.90800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56399999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.004,"15min":1.004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.93999999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.96999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.04,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.90600000000000003,"5min":1,"15min":1},"last":0.63300000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.131,"15min":1.131},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68799999999999994}]},{"osd":11,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.996}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1096798,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.75700000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.71199999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78300000000000003,"5min":1.032,"15min":1.032},"last":0.95099999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0389999999999999,"5min":1.615,"15min":1.615},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.57099999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.012},{"interface":"front","average":{"1min":0.754,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.57299999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.998}]},{"osd":8,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":1.069,"15min":1.069},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.82799999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94499999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1080000000000001,"5min":1.353,"15min":1.353},"last":0.92300000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.59899999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:26:44.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T13:26:45.053 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:45 smithi139 ceph-mon[99506]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:45 smithi139 ceph-mon[99506]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:26:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:45 smithi187 ceph-mon[104336]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:45 smithi187 ceph-mon[104336]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:26:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:45 smithi155 ceph-mon[103467]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:45 smithi155 ceph-mon[103467]: pgmap v275: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:26:46.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.259+0000 7ffbc95aa700 1 -- 172.21.15.139:0/1244418307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc4104570 msgr2=0x7ffbc4104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/1244418307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc4104570 0x7ffbc4104950 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40099c0 tx=0x7ffbb4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 -- 172.21.15.139:0/1244418307 shutdown_connections 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/1244418307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc41000e0 0x7ffbc410c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/1244418307 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc4104570 0x7ffbc4104950 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/1244418307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc40ff720 0x7ffbc40ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 -- 172.21.15.139:0/1244418307 >> 172.21.15.139:0/1244418307 conn(0x7ffbc4075790 msgr2=0x7ffbc4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 -- 172.21.15.139:0/1244418307 shutdown_connections 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 -- 172.21.15.139:0/1244418307 wait complete. 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 Processor -- start 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.260+0000 7ffbc95aa700 1 -- start start 2023-10-08T13:26:46.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc40ff720 0x7ffbc4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 0x7ffbc4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41a5050 con 0x7ffbc41000e0 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41a51c0 con 0x7ffbc40ff720 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc95aa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41a5380 con 0x7ffbc4104570 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39130/0 (socket says 172.21.15.139:39130) 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 -- 172.21.15.139:0/585191109 learned_addr learned my addr 172.21.15.139:0/585191109 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc2ffd700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc40ff720 0x7ffbc4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc37fe700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 0x7ffbc4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:46.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 -- 172.21.15.139:0/585191109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 msgr2=0x7ffbc4101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 0x7ffbc4101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 -- 172.21.15.139:0/585191109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc40ff720 msgr2=0x7ffbc4101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc40ff720 0x7ffbc4101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 -- 172.21.15.139:0/585191109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb40095f0 con 0x7ffbc41000e0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc37fe700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 0x7ffbc4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbc27fc700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b530 tx=0x7ffbb800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.261+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8011830 con 0x7ffbc41000e0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.262+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbb8011e50 con 0x7ffbc41000e0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.262+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc41a5660 con 0x7ffbc41000e0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.262+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800f2e0 con 0x7ffbc41000e0 2023-10-08T13:26:46.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.262+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc41a5b60 con 0x7ffbc41000e0 2023-10-08T13:26:46.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.262+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc4108c40 con 0x7ffbc41000e0 2023-10-08T13:26:46.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.264+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ffbb8010380 con 0x7ffbc41000e0 2023-10-08T13:26:46.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.265+0000 7ffbabfff700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 0x7ffbac0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:46.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.265+0000 7ffbc2ffd700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 0x7ffbac0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:46.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.265+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ffbb80cd2a0 con 0x7ffbc41000e0 2023-10-08T13:26:46.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.265+0000 7ffbc2ffd700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 0x7ffbac0a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009990 tx=0x7ffbb4005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:46.269 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.269+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ffbb80964c0 con 0x7ffbc41000e0 2023-10-08T13:26:46.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.457+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffbc4102750 con 0x7ffbac0a1560 2023-10-08T13:26:46.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.469+0000 7ffbabfff700 1 -- 172.21.15.139:0/585191109 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427233 (secure 0 0 0) 0x7ffbc4102750 con 0x7ffbac0a1560 2023-10-08T13:26:46.475 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 msgr2=0x7ffbac0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 0x7ffbac0a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009990 tx=0x7ffbb4005c60 comp rx=0 tx=0).stop 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 msgr2=0x7ffbc41017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b530 tx=0x7ffbb800b840 comp rx=0 tx=0).stop 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 shutdown_connections 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffbac0a1560 0x7ffbac0a3a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffbc4104570 0x7ffbc4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbc40ff720 0x7ffbc4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 --2- 172.21.15.139:0/585191109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffbc41000e0 0x7ffbc41017b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:46.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 >> 172.21.15.139:0/585191109 conn(0x7ffbc4075790 msgr2=0x7ffbc4069260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:46.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 shutdown_connections 2023-10-08T13:26:46.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:46.472+0000 7ffbc95aa700 1 -- 172.21.15.139:0/585191109 wait complete. 2023-10-08T13:26:46.479 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:26:46.804 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2023-10-08T13:26:44.611622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656009,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":552,"num_read_kb":403,"num_write":417,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180859,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336344,"kb_used_data":12092,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605480,"statfs":{"total":1151940427776,"available":1151596011520,"internally_reserved":0,"allocated":12382208,"data_stored":7988652,"data_compressed":353736,"data_compressed_allocated":479232,"data_compressed_original":2457600,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":72,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003398"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716810+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:26:08.716810+0000","last_peered":"2023-10-08T13:26:08.716810+0000","last_clean":"2023-10-08T13:26:08.716810+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:26:08.716810+0000","last_undegraded":"2023-10-08T13:26:08.716810+0000","last_fullsized":"2023-10-08T13:26:08.716810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718276+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:26:08.718276+0000","last_peered":"2023-10-08T13:26:08.718276+0000","last_clean":"2023-10-08T13:26:08.718276+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:26:08.718276+0000","last_undegraded":"2023-10-08T13:26:08.718276+0000","last_fullsized":"2023-10-08T13:26:08.718276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717455+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:26:08.717455+0000","last_peered":"2023-10-08T13:26:08.717455+0000","last_clean":"2023-10-08T13:26:08.717455+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:26:08.717455+0000","last_undegraded":"2023-10-08T13:26:08.717455+0000","last_fullsized":"2023-10-08T13:26:08.717455+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724807+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:26:08.724807+0000","last_peered":"2023-10-08T13:26:08.724807+0000","last_clean":"2023-10-08T13:26:08.724807+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:26:08.724807+0000","last_undegraded":"2023-10-08T13:26:08.724807+0000","last_fullsized":"2023-10-08T13:26:08.724807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719221+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:26:08.719221+0000","last_peered":"2023-10-08T13:26:08.719221+0000","last_clean":"2023-10-08T13:26:08.719221+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:26:08.719221+0000","last_undegraded":"2023-10-08T13:26:08.719221+0000","last_fullsized":"2023-10-08T13:26:08.719221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722874+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:26:08.722874+0000","last_peered":"2023-10-08T13:26:08.722874+0000","last_clean":"2023-10-08T13:26:08.722874+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:26:08.722874+0000","last_undegraded":"2023-10-08T13:26:08.722874+0000","last_fullsized":"2023-10-08T13:26:08.722874+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717123+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:26:08.717123+0000","last_peered":"2023-10-08T13:26:08.717123+0000","last_clean":"2023-10-08T13:26:08.717123+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:26:08.717123+0000","last_undegraded":"2023-10-08T13:26:08.717123+0000","last_fullsized":"2023-10-08T13:26:08.717123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722035+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:26:08.722035+0000","last_peered":"2023-10-08T13:26:08.722035+0000","last_clean":"2023-10-08T13:26:08.722035+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:26:08.722035+0000","last_undegraded":"2023-10-08T13:26:08.722035+0000","last_fullsized":"2023-10-08T13:26:08.722035+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.727548+0000","last_change":"2023-10-08T13:26:09.727548+0000","last_active":"2023-10-08T13:26:09.727548+0000","last_peered":"2023-10-08T13:26:09.727548+0000","last_clean":"2023-10-08T13:26:09.727548+0000","last_became_active":"2023-10-08T13:26:09.727158+0000","last_became_peered":"2023-10-08T13:26:09.727158+0000","last_unstale":"2023-10-08T13:26:09.727548+0000","last_undegraded":"2023-10-08T13:26:09.727548+0000","last_fullsized":"2023-10-08T13:26:09.727548+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:37.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765316+0000","last_change":"2023-10-08T13:26:09.765316+0000","last_active":"2023-10-08T13:26:09.765316+0000","last_peered":"2023-10-08T13:26:09.765316+0000","last_clean":"2023-10-08T13:26:09.765316+0000","last_became_active":"2023-10-08T13:26:09.764968+0000","last_became_peered":"2023-10-08T13:26:09.764968+0000","last_unstale":"2023-10-08T13:26:09.765316+0000","last_undegraded":"2023-10-08T13:26:09.765316+0000","last_fullsized":"2023-10-08T13:26:09.765316+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:40.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717640+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:26:08.717640+0000","last_peered":"2023-10-08T13:26:08.717640+0000","last_clean":"2023-10-08T13:26:08.717640+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:26:08.717640+0000","last_undegraded":"2023-10-08T13:26:08.717640+0000","last_fullsized":"2023-10-08T13:26:08.717640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724715+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:26:08.724715+0000","last_peered":"2023-10-08T13:26:08.724715+0000","last_clean":"2023-10-08T13:26:08.724715+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:26:08.724715+0000","last_undegraded":"2023-10-08T13:26:08.724715+0000","last_fullsized":"2023-10-08T13:26:08.724715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719305+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:26:08.719305+0000","last_peered":"2023-10-08T13:26:08.719305+0000","last_clean":"2023-10-08T13:26:08.719305+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:26:08.719305+0000","last_undegraded":"2023-10-08T13:26:08.719305+0000","last_fullsized":"2023-10-08T13:26:08.719305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717217+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:26:08.717217+0000","last_peered":"2023-10-08T13:26:08.717217+0000","last_clean":"2023-10-08T13:26:08.717217+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:26:08.717217+0000","last_undegraded":"2023-10-08T13:26:08.717217+0000","last_fullsized":"2023-10-08T13:26:08.717217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717312+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:26:08.717312+0000","last_peered":"2023-10-08T13:26:08.717312+0000","last_clean":"2023-10-08T13:26:08.717312+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:26:08.717312+0000","last_undegraded":"2023-10-08T13:26:08.717312+0000","last_fullsized":"2023-10-08T13:26:08.717312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719325+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:26:08.719325+0000","last_peered":"2023-10-08T13:26:08.719325+0000","last_clean":"2023-10-08T13:26:08.719325+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:26:08.719325+0000","last_undegraded":"2023-10-08T13:26:08.719325+0000","last_fullsized":"2023-10-08T13:26:08.719325+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716725+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:26:08.716725+0000","last_peered":"2023-10-08T13:26:08.716725+0000","last_clean":"2023-10-08T13:26:08.716725+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:26:08.716725+0000","last_undegraded":"2023-10-08T13:26:08.716725+0000","last_fullsized":"2023-10-08T13:26:08.716725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720992+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:26:08.720992+0000","last_peered":"2023-10-08T13:26:08.720992+0000","last_clean":"2023-10-08T13:26:08.720992+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:26:08.720992+0000","last_undegraded":"2023-10-08T13:26:08.720992+0000","last_fullsized":"2023-10-08T13:26:08.720992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726379+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:26:08.726379+0000","last_peered":"2023-10-08T13:26:08.726379+0000","last_clean":"2023-10-08T13:26:08.726379+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:26:08.726379+0000","last_undegraded":"2023-10-08T13:26:08.726379+0000","last_fullsized":"2023-10-08T13:26:08.726379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725911+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:26:08.725911+0000","last_peered":"2023-10-08T13:26:08.725911+0000","last_clean":"2023-10-08T13:26:08.725911+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:26:08.725911+0000","last_undegraded":"2023-10-08T13:26:08.725911+0000","last_fullsized":"2023-10-08T13:26:08.725911+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:40.473571+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:26:40.473571+0000","last_peered":"2023-10-08T13:26:40.473571+0000","last_clean":"2023-10-08T13:26:40.473571+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:26:40.473571+0000","last_undegraded":"2023-10-08T13:26:40.473571+0000","last_fullsized":"2023-10-08T13:26:40.473571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722894+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:26:08.722894+0000","last_peered":"2023-10-08T13:26:08.722894+0000","last_clean":"2023-10-08T13:26:08.722894+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:26:08.722894+0000","last_undegraded":"2023-10-08T13:26:08.722894+0000","last_fullsized":"2023-10-08T13:26:08.722894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721816+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:26:08.721816+0000","last_peered":"2023-10-08T13:26:08.721816+0000","last_clean":"2023-10-08T13:26:08.721816+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:26:08.721816+0000","last_undegraded":"2023-10-08T13:26:08.721816+0000","last_fullsized":"2023-10-08T13:26:08.721816+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722952+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:26:08.722952+0000","last_peered":"2023-10-08T13:26:08.722952+0000","last_clean":"2023-10-08T13:26:08.722952+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:26:08.722952+0000","last_undegraded":"2023-10-08T13:26:08.722952+0000","last_fullsized":"2023-10-08T13:26:08.722952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717454+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:26:08.717454+0000","last_peered":"2023-10-08T13:26:08.717454+0000","last_clean":"2023-10-08T13:26:08.717454+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:26:08.717454+0000","last_undegraded":"2023-10-08T13:26:08.717454+0000","last_fullsized":"2023-10-08T13:26:08.717454+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765180+0000","last_change":"2023-10-08T13:26:09.765180+0000","last_active":"2023-10-08T13:26:09.765180+0000","last_peered":"2023-10-08T13:26:09.765180+0000","last_clean":"2023-10-08T13:26:09.765180+0000","last_became_active":"2023-10-08T13:26:09.764692+0000","last_became_peered":"2023-10-08T13:26:09.764692+0000","last_unstale":"2023-10-08T13:26:09.765180+0000","last_undegraded":"2023-10-08T13:26:09.765180+0000","last_fullsized":"2023-10-08T13:26:09.765180+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:15.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.334782+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:26:09.334782+0000","last_peered":"2023-10-08T13:26:09.334782+0000","last_clean":"2023-10-08T13:26:09.334782+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:26:09.334782+0000","last_undegraded":"2023-10-08T13:26:09.334782+0000","last_fullsized":"2023-10-08T13:26:09.334782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719600+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:26:08.719600+0000","last_peered":"2023-10-08T13:26:08.719600+0000","last_clean":"2023-10-08T13:26:08.719600+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:26:08.719600+0000","last_undegraded":"2023-10-08T13:26:08.719600+0000","last_fullsized":"2023-10-08T13:26:08.719600+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765527+0000","last_change":"2023-10-08T13:26:09.765527+0000","last_active":"2023-10-08T13:26:09.765527+0000","last_peered":"2023-10-08T13:26:09.765527+0000","last_clean":"2023-10-08T13:26:09.765527+0000","last_became_active":"2023-10-08T13:26:09.764823+0000","last_became_peered":"2023-10-08T13:26:09.764823+0000","last_unstale":"2023-10-08T13:26:09.765527+0000","last_undegraded":"2023-10-08T13:26:09.765527+0000","last_fullsized":"2023-10-08T13:26:09.765527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:28:41.632170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719923+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:26:08.719923+0000","last_peered":"2023-10-08T13:26:08.719923+0000","last_clean":"2023-10-08T13:26:08.719923+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:26:08.719923+0000","last_undegraded":"2023-10-08T13:26:08.719923+0000","last_fullsized":"2023-10-08T13:26:08.719923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721308+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:26:08.721308+0000","last_peered":"2023-10-08T13:26:08.721308+0000","last_clean":"2023-10-08T13:26:08.721308+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:26:08.721308+0000","last_undegraded":"2023-10-08T13:26:08.721308+0000","last_fullsized":"2023-10-08T13:26:08.721308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726074+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:26:08.726074+0000","last_peered":"2023-10-08T13:26:08.726074+0000","last_clean":"2023-10-08T13:26:08.726074+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:26:08.726074+0000","last_undegraded":"2023-10-08T13:26:08.726074+0000","last_fullsized":"2023-10-08T13:26:08.726074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:39.472908+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:26:39.472908+0000","last_peered":"2023-10-08T13:26:39.472908+0000","last_clean":"2023-10-08T13:26:39.472908+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:26:39.472908+0000","last_undegraded":"2023-10-08T13:26:39.472908+0000","last_fullsized":"2023-10-08T13:26:39.472908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719390+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:26:08.719390+0000","last_peered":"2023-10-08T13:26:08.719390+0000","last_clean":"2023-10-08T13:26:08.719390+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:26:08.719390+0000","last_undegraded":"2023-10-08T13:26:08.719390+0000","last_fullsized":"2023-10-08T13:26:08.719390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726034+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:26:08.726034+0000","last_peered":"2023-10-08T13:26:08.726034+0000","last_clean":"2023-10-08T13:26:08.726034+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:26:08.726034+0000","last_undegraded":"2023-10-08T13:26:08.726034+0000","last_fullsized":"2023-10-08T13:26:08.726034+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722823+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:26:08.722823+0000","last_peered":"2023-10-08T13:26:08.722823+0000","last_clean":"2023-10-08T13:26:08.722823+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:26:08.722823+0000","last_undegraded":"2023-10-08T13:26:08.722823+0000","last_fullsized":"2023-10-08T13:26:08.722823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721218+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:26:08.721218+0000","last_peered":"2023-10-08T13:26:08.721218+0000","last_clean":"2023-10-08T13:26:08.721218+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:26:08.721218+0000","last_undegraded":"2023-10-08T13:26:08.721218+0000","last_fullsized":"2023-10-08T13:26:08.721218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716581+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:26:08.716581+0000","last_peered":"2023-10-08T13:26:08.716581+0000","last_clean":"2023-10-08T13:26:08.716581+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:26:08.716581+0000","last_undegraded":"2023-10-08T13:26:08.716581+0000","last_fullsized":"2023-10-08T13:26:08.716581+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720715+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:26:08.720715+0000","last_peered":"2023-10-08T13:26:08.720715+0000","last_clean":"2023-10-08T13:26:08.720715+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:26:08.720715+0000","last_undegraded":"2023-10-08T13:26:08.720715+0000","last_fullsized":"2023-10-08T13:26:08.720715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722027+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:26:08.722027+0000","last_peered":"2023-10-08T13:26:08.722027+0000","last_clean":"2023-10-08T13:26:08.722027+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:26:08.722027+0000","last_undegraded":"2023-10-08T13:26:08.722027+0000","last_fullsized":"2023-10-08T13:26:08.722027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718232+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:26:08.718232+0000","last_peered":"2023-10-08T13:26:08.718232+0000","last_clean":"2023-10-08T13:26:08.718232+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:26:08.718232+0000","last_undegraded":"2023-10-08T13:26:08.718232+0000","last_fullsized":"2023-10-08T13:26:08.718232+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720093+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:26:08.720093+0000","last_peered":"2023-10-08T13:26:08.720093+0000","last_clean":"2023-10-08T13:26:08.720093+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:26:08.720093+0000","last_undegraded":"2023-10-08T13:26:08.720093+0000","last_fullsized":"2023-10-08T13:26:08.720093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720474+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:26:08.720474+0000","last_peered":"2023-10-08T13:26:08.720474+0000","last_clean":"2023-10-08T13:26:08.720474+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:26:08.720474+0000","last_undegraded":"2023-10-08T13:26:08.720474+0000","last_fullsized":"2023-10-08T13:26:08.720474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722165+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:26:08.722165+0000","last_peered":"2023-10-08T13:26:08.722165+0000","last_clean":"2023-10-08T13:26:08.722165+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:26:08.722165+0000","last_undegraded":"2023-10-08T13:26:08.722165+0000","last_fullsized":"2023-10-08T13:26:08.722165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":100,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:42.476815+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:26:42.476815+0000","last_peered":"2023-10-08T13:26:42.476815+0000","last_clean":"2023-10-08T13:26:42.476815+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:26:42.476815+0000","last_undegraded":"2023-10-08T13:26:42.476815+0000","last_fullsized":"2023-10-08T13:26:42.476815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720424+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:26:08.720424+0000","last_peered":"2023-10-08T13:26:08.720424+0000","last_clean":"2023-10-08T13:26:08.720424+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:26:08.720424+0000","last_undegraded":"2023-10-08T13:26:08.720424+0000","last_fullsized":"2023-10-08T13:26:08.720424+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720152+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:26:08.720152+0000","last_peered":"2023-10-08T13:26:08.720152+0000","last_clean":"2023-10-08T13:26:08.720152+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:26:08.720152+0000","last_undegraded":"2023-10-08T13:26:08.720152+0000","last_fullsized":"2023-10-08T13:26:08.720152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717505+0000","last_change":"2023-10-08T13:25:33.439513+0000","last_active":"2023-10-08T13:26:08.717505+0000","last_peered":"2023-10-08T13:26:08.717505+0000","last_clean":"2023-10-08T13:26:08.717505+0000","last_became_active":"2023-10-08T13:25:33.439118+0000","last_became_peered":"2023-10-08T13:25:33.439118+0000","last_unstale":"2023-10-08T13:26:08.717505+0000","last_undegraded":"2023-10-08T13:26:08.717505+0000","last_fullsized":"2023-10-08T13:26:08.717505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:36:05.986749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.730654+0000","last_change":"2023-10-08T13:26:09.730654+0000","last_active":"2023-10-08T13:26:09.730654+0000","last_peered":"2023-10-08T13:26:09.730654+0000","last_clean":"2023-10-08T13:26:09.730654+0000","last_became_active":"2023-10-08T13:26:09.730372+0000","last_became_peered":"2023-10-08T13:26:09.730372+0000","last_unstale":"2023-10-08T13:26:09.730654+0000","last_undegraded":"2023-10-08T13:26:09.730654+0000","last_fullsized":"2023-10-08T13:26:09.730654+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:10:09.821192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722316+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:26:08.722316+0000","last_peered":"2023-10-08T13:26:08.722316+0000","last_clean":"2023-10-08T13:26:08.722316+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:26:08.722316+0000","last_undegraded":"2023-10-08T13:26:08.722316+0000","last_fullsized":"2023-10-08T13:26:08.722316+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721261+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:26:08.721261+0000","last_peered":"2023-10-08T13:26:08.721261+0000","last_clean":"2023-10-08T13:26:08.721261+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:26:08.721261+0000","last_undegraded":"2023-10-08T13:26:08.721261+0000","last_fullsized":"2023-10-08T13:26:08.721261+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.724775+0000","last_change":"2023-10-08T13:26:09.724775+0000","last_active":"2023-10-08T13:26:09.724775+0000","last_peered":"2023-10-08T13:26:09.724775+0000","last_clean":"2023-10-08T13:26:09.724775+0000","last_became_active":"2023-10-08T13:26:09.724388+0000","last_became_peered":"2023-10-08T13:26:09.724388+0000","last_unstale":"2023-10-08T13:26:09.724775+0000","last_undegraded":"2023-10-08T13:26:09.724775+0000","last_fullsized":"2023-10-08T13:26:09.724775+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:17.186799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719197+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:26:08.719197+0000","last_peered":"2023-10-08T13:26:08.719197+0000","last_clean":"2023-10-08T13:26:08.719197+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:26:08.719197+0000","last_undegraded":"2023-10-08T13:26:08.719197+0000","last_fullsized":"2023-10-08T13:26:08.719197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'34","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:42.476815+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:26:42.476815+0000","last_peered":"2023-10-08T13:26:42.476815+0000","last_clean":"2023-10-08T13:26:42.476815+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:26:42.476815+0000","last_undegraded":"2023-10-08T13:26:42.476815+0000","last_fullsized":"2023-10-08T13:26:42.476815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58583,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":84,"num_read_kb":98,"num_write":36,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720763+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:26:08.720763+0000","last_peered":"2023-10-08T13:26:08.720763+0000","last_clean":"2023-10-08T13:26:08.720763+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:26:08.720763+0000","last_undegraded":"2023-10-08T13:26:08.720763+0000","last_fullsized":"2023-10-08T13:26:08.720763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721456+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:26:08.721456+0000","last_peered":"2023-10-08T13:26:08.721456+0000","last_clean":"2023-10-08T13:26:08.721456+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:26:08.721456+0000","last_undegraded":"2023-10-08T13:26:08.721456+0000","last_fullsized":"2023-10-08T13:26:08.721456+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726335+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:26:08.726335+0000","last_peered":"2023-10-08T13:26:08.726335+0000","last_clean":"2023-10-08T13:26:08.726335+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:26:08.726335+0000","last_undegraded":"2023-10-08T13:26:08.726335+0000","last_fullsized":"2023-10-08T13:26:08.726335+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719826+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:26:08.719826+0000","last_peered":"2023-10-08T13:26:08.719826+0000","last_clean":"2023-10-08T13:26:08.719826+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:26:08.719826+0000","last_undegraded":"2023-10-08T13:26:08.719826+0000","last_fullsized":"2023-10-08T13:26:08.719826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716429+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:26:08.716429+0000","last_peered":"2023-10-08T13:26:08.716429+0000","last_clean":"2023-10-08T13:26:08.716429+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:26:08.716429+0000","last_undegraded":"2023-10-08T13:26:08.716429+0000","last_fullsized":"2023-10-08T13:26:08.716429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721168+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:26:08.721168+0000","last_peered":"2023-10-08T13:26:08.721168+0000","last_clean":"2023-10-08T13:26:08.721168+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:26:08.721168+0000","last_undegraded":"2023-10-08T13:26:08.721168+0000","last_fullsized":"2023-10-08T13:26:08.721168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717331+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:26:08.717331+0000","last_peered":"2023-10-08T13:26:08.717331+0000","last_clean":"2023-10-08T13:26:08.717331+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:26:08.717331+0000","last_undegraded":"2023-10-08T13:26:08.717331+0000","last_fullsized":"2023-10-08T13:26:08.717331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720566+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:26:08.720566+0000","last_peered":"2023-10-08T13:26:08.720566+0000","last_clean":"2023-10-08T13:26:08.720566+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:26:08.720566+0000","last_undegraded":"2023-10-08T13:26:08.720566+0000","last_fullsized":"2023-10-08T13:26:08.720566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:39.472982+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:26:39.472982+0000","last_peered":"2023-10-08T13:26:39.472982+0000","last_clean":"2023-10-08T13:26:39.472982+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:26:39.472982+0000","last_undegraded":"2023-10-08T13:26:39.472982+0000","last_fullsized":"2023-10-08T13:26:39.472982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717148+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:26:08.717148+0000","last_peered":"2023-10-08T13:26:08.717148+0000","last_clean":"2023-10-08T13:26:08.717148+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:26:08.717148+0000","last_undegraded":"2023-10-08T13:26:08.717148+0000","last_fullsized":"2023-10-08T13:26:08.717148+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.765328+0000","last_change":"2023-10-08T13:26:09.765328+0000","last_active":"2023-10-08T13:26:09.765328+0000","last_peered":"2023-10-08T13:26:09.765328+0000","last_clean":"2023-10-08T13:26:09.765328+0000","last_became_active":"2023-10-08T13:26:09.764889+0000","last_became_peered":"2023-10-08T13:26:09.764889+0000","last_unstale":"2023-10-08T13:26:09.765328+0000","last_undegraded":"2023-10-08T13:26:09.765328+0000","last_fullsized":"2023-10-08T13:26:09.765328+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:54.280258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719172+0000","last_change":"2023-10-08T13:25:33.440499+0000","last_active":"2023-10-08T13:26:08.719172+0000","last_peered":"2023-10-08T13:26:08.719172+0000","last_clean":"2023-10-08T13:26:08.719172+0000","last_became_active":"2023-10-08T13:25:33.440191+0000","last_became_peered":"2023-10-08T13:25:33.440191+0000","last_unstale":"2023-10-08T13:26:08.719172+0000","last_undegraded":"2023-10-08T13:26:08.719172+0000","last_fullsized":"2023-10-08T13:26:08.719172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:00:47.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720598+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:26:08.720598+0000","last_peered":"2023-10-08T13:26:08.720598+0000","last_clean":"2023-10-08T13:26:08.720598+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:26:08.720598+0000","last_undegraded":"2023-10-08T13:26:08.720598+0000","last_fullsized":"2023-10-08T13:26:08.720598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720502+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:26:08.720502+0000","last_peered":"2023-10-08T13:26:08.720502+0000","last_clean":"2023-10-08T13:26:08.720502+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:26:08.720502+0000","last_undegraded":"2023-10-08T13:26:08.720502+0000","last_fullsized":"2023-10-08T13:26:08.720502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720617+0000","last_change":"2023-10-08T13:25:33.435437+0000","last_active":"2023-10-08T13:26:08.720617+0000","last_peered":"2023-10-08T13:26:08.720617+0000","last_clean":"2023-10-08T13:26:08.720617+0000","last_became_active":"2023-10-08T13:25:33.435097+0000","last_became_peered":"2023-10-08T13:25:33.435097+0000","last_unstale":"2023-10-08T13:26:08.720617+0000","last_undegraded":"2023-10-08T13:26:08.720617+0000","last_fullsized":"2023-10-08T13:26:08.720617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:15.564306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716645+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:26:08.716645+0000","last_peered":"2023-10-08T13:26:08.716645+0000","last_clean":"2023-10-08T13:26:08.716645+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:26:08.716645+0000","last_undegraded":"2023-10-08T13:26:08.716645+0000","last_fullsized":"2023-10-08T13:26:08.716645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719287+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:26:08.719287+0000","last_peered":"2023-10-08T13:26:08.719287+0000","last_clean":"2023-10-08T13:26:08.719287+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:26:08.719287+0000","last_undegraded":"2023-10-08T13:26:08.719287+0000","last_fullsized":"2023-10-08T13:26:08.719287+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720222+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:26:08.720222+0000","last_peered":"2023-10-08T13:26:08.720222+0000","last_clean":"2023-10-08T13:26:08.720222+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:26:08.720222+0000","last_undegraded":"2023-10-08T13:26:08.720222+0000","last_fullsized":"2023-10-08T13:26:08.720222+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724146+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:26:08.724146+0000","last_peered":"2023-10-08T13:26:08.724146+0000","last_clean":"2023-10-08T13:26:08.724146+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:26:08.724146+0000","last_undegraded":"2023-10-08T13:26:08.724146+0000","last_fullsized":"2023-10-08T13:26:08.724146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720040+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:26:08.720040+0000","last_peered":"2023-10-08T13:26:08.720040+0000","last_clean":"2023-10-08T13:26:08.720040+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:26:08.720040+0000","last_undegraded":"2023-10-08T13:26:08.720040+0000","last_fullsized":"2023-10-08T13:26:08.720040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:38.471870+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:26:38.471870+0000","last_peered":"2023-10-08T13:26:38.471870+0000","last_clean":"2023-10-08T13:26:38.471870+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:26:38.471870+0000","last_undegraded":"2023-10-08T13:26:38.471870+0000","last_fullsized":"2023-10-08T13:26:38.471870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.723269+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:26:08.723269+0000","last_peered":"2023-10-08T13:26:08.723269+0000","last_clean":"2023-10-08T13:26:08.723269+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:26:08.723269+0000","last_undegraded":"2023-10-08T13:26:08.723269+0000","last_fullsized":"2023-10-08T13:26:08.723269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719904+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:26:08.719904+0000","last_peered":"2023-10-08T13:26:08.719904+0000","last_clean":"2023-10-08T13:26:08.719904+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:26:08.719904+0000","last_undegraded":"2023-10-08T13:26:08.719904+0000","last_fullsized":"2023-10-08T13:26:08.719904+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720200+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:26:08.720200+0000","last_peered":"2023-10-08T13:26:08.720200+0000","last_clean":"2023-10-08T13:26:08.720200+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:26:08.720200+0000","last_undegraded":"2023-10-08T13:26:08.720200+0000","last_fullsized":"2023-10-08T13:26:08.720200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":64,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:42.476090+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:26:42.476090+0000","last_peered":"2023-10-08T13:26:42.476090+0000","last_clean":"2023-10-08T13:26:42.476090+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:26:42.476090+0000","last_undegraded":"2023-10-08T13:26:42.476090+0000","last_fullsized":"2023-10-08T13:26:42.476090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.734878+0000","last_change":"2023-10-08T13:26:09.734878+0000","last_active":"2023-10-08T13:26:09.734878+0000","last_peered":"2023-10-08T13:26:09.734878+0000","last_clean":"2023-10-08T13:26:09.734878+0000","last_became_active":"2023-10-08T13:26:09.730200+0000","last_became_peered":"2023-10-08T13:26:09.730200+0000","last_unstale":"2023-10-08T13:26:09.734878+0000","last_undegraded":"2023-10-08T13:26:09.734878+0000","last_fullsized":"2023-10-08T13:26:09.734878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:33.060346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.723078+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:26:08.723078+0000","last_peered":"2023-10-08T13:26:08.723078+0000","last_clean":"2023-10-08T13:26:08.723078+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:26:08.723078+0000","last_undegraded":"2023-10-08T13:26:08.723078+0000","last_fullsized":"2023-10-08T13:26:08.723078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722217+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:26:08.722217+0000","last_peered":"2023-10-08T13:26:08.722217+0000","last_clean":"2023-10-08T13:26:08.722217+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:26:08.722217+0000","last_undegraded":"2023-10-08T13:26:08.722217+0000","last_fullsized":"2023-10-08T13:26:08.722217+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":322,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716997+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:26:08.716997+0000","last_peered":"2023-10-08T13:26:08.716997+0000","last_clean":"2023-10-08T13:26:08.716997+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:26:08.716997+0000","last_undegraded":"2023-10-08T13:26:08.716997+0000","last_fullsized":"2023-10-08T13:26:08.716997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720806+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:26:08.720806+0000","last_peered":"2023-10-08T13:26:08.720806+0000","last_clean":"2023-10-08T13:26:08.720806+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:26:08.720806+0000","last_undegraded":"2023-10-08T13:26:08.720806+0000","last_fullsized":"2023-10-08T13:26:08.720806+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720542+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:26:08.720542+0000","last_peered":"2023-10-08T13:26:08.720542+0000","last_clean":"2023-10-08T13:26:08.720542+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:26:08.720542+0000","last_undegraded":"2023-10-08T13:26:08.720542+0000","last_fullsized":"2023-10-08T13:26:08.720542+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717119+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:26:08.717119+0000","last_peered":"2023-10-08T13:26:08.717119+0000","last_clean":"2023-10-08T13:26:08.717119+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:26:08.717119+0000","last_undegraded":"2023-10-08T13:26:08.717119+0000","last_fullsized":"2023-10-08T13:26:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716377+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:26:08.716377+0000","last_peered":"2023-10-08T13:26:08.716377+0000","last_clean":"2023-10-08T13:26:08.716377+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:26:08.716377+0000","last_undegraded":"2023-10-08T13:26:08.716377+0000","last_fullsized":"2023-10-08T13:26:08.716377+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720866+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:26:08.720866+0000","last_peered":"2023-10-08T13:26:08.720866+0000","last_clean":"2023-10-08T13:26:08.720866+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:26:08.720866+0000","last_undegraded":"2023-10-08T13:26:08.720866+0000","last_fullsized":"2023-10-08T13:26:08.720866+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720175+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:26:08.720175+0000","last_peered":"2023-10-08T13:26:08.720175+0000","last_clean":"2023-10-08T13:26:08.720175+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:26:08.720175+0000","last_undegraded":"2023-10-08T13:26:08.720175+0000","last_fullsized":"2023-10-08T13:26:08.720175+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721916+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:26:08.721916+0000","last_peered":"2023-10-08T13:26:08.721916+0000","last_clean":"2023-10-08T13:26:08.721916+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:26:08.721916+0000","last_undegraded":"2023-10-08T13:26:08.721916+0000","last_fullsized":"2023-10-08T13:26:08.721916+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.727891+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:26:09.727891+0000","last_peered":"2023-10-08T13:26:09.727891+0000","last_clean":"2023-10-08T13:26:09.727891+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:26:09.727891+0000","last_undegraded":"2023-10-08T13:26:09.727891+0000","last_fullsized":"2023-10-08T13:26:09.727891+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722295+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:26:08.722295+0000","last_peered":"2023-10-08T13:26:08.722295+0000","last_clean":"2023-10-08T13:26:08.722295+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:26:08.722295+0000","last_undegraded":"2023-10-08T13:26:08.722295+0000","last_fullsized":"2023-10-08T13:26:08.722295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725710+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:26:08.725710+0000","last_peered":"2023-10-08T13:26:08.725710+0000","last_clean":"2023-10-08T13:26:08.725710+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:26:08.725710+0000","last_undegraded":"2023-10-08T13:26:08.725710+0000","last_fullsized":"2023-10-08T13:26:08.725710+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722906+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:26:08.722906+0000","last_peered":"2023-10-08T13:26:08.722906+0000","last_clean":"2023-10-08T13:26:08.722906+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:26:08.722906+0000","last_undegraded":"2023-10-08T13:26:08.722906+0000","last_fullsized":"2023-10-08T13:26:08.722906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.718308+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:26:08.718308+0000","last_peered":"2023-10-08T13:26:08.718308+0000","last_clean":"2023-10-08T13:26:08.718308+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:26:08.718308+0000","last_undegraded":"2023-10-08T13:26:08.718308+0000","last_fullsized":"2023-10-08T13:26:08.718308+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721965+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:26:08.721965+0000","last_peered":"2023-10-08T13:26:08.721965+0000","last_clean":"2023-10-08T13:26:08.721965+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:26:08.721965+0000","last_undegraded":"2023-10-08T13:26:08.721965+0000","last_fullsized":"2023-10-08T13:26:08.721965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719407+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:26:08.719407+0000","last_peered":"2023-10-08T13:26:08.719407+0000","last_clean":"2023-10-08T13:26:08.719407+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:26:08.719407+0000","last_undegraded":"2023-10-08T13:26:08.719407+0000","last_fullsized":"2023-10-08T13:26:08.719407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719203+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:26:08.719203+0000","last_peered":"2023-10-08T13:26:08.719203+0000","last_clean":"2023-10-08T13:26:08.719203+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:26:08.719203+0000","last_undegraded":"2023-10-08T13:26:08.719203+0000","last_fullsized":"2023-10-08T13:26:08.719203+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720107+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:26:08.720107+0000","last_peered":"2023-10-08T13:26:08.720107+0000","last_clean":"2023-10-08T13:26:08.720107+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:26:08.720107+0000","last_undegraded":"2023-10-08T13:26:08.720107+0000","last_fullsized":"2023-10-08T13:26:08.720107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722029+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:26:08.722029+0000","last_peered":"2023-10-08T13:26:08.722029+0000","last_clean":"2023-10-08T13:26:08.722029+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:26:08.722029+0000","last_undegraded":"2023-10-08T13:26:08.722029+0000","last_fullsized":"2023-10-08T13:26:08.722029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716250+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:26:08.716250+0000","last_peered":"2023-10-08T13:26:08.716250+0000","last_clean":"2023-10-08T13:26:08.716250+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:26:08.716250+0000","last_undegraded":"2023-10-08T13:26:08.716250+0000","last_fullsized":"2023-10-08T13:26:08.716250+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.724464+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:26:08.724464+0000","last_peered":"2023-10-08T13:26:08.724464+0000","last_clean":"2023-10-08T13:26:08.724464+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:26:08.724464+0000","last_undegraded":"2023-10-08T13:26:08.724464+0000","last_fullsized":"2023-10-08T13:26:08.724464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726316+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:26:08.726316+0000","last_peered":"2023-10-08T13:26:08.726316+0000","last_clean":"2023-10-08T13:26:08.726316+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:26:08.726316+0000","last_undegraded":"2023-10-08T13:26:08.726316+0000","last_fullsized":"2023-10-08T13:26:08.726316+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722772+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:26:08.722772+0000","last_peered":"2023-10-08T13:26:08.722772+0000","last_clean":"2023-10-08T13:26:08.722772+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:26:08.722772+0000","last_undegraded":"2023-10-08T13:26:08.722772+0000","last_fullsized":"2023-10-08T13:26:08.722772+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722556+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:26:08.722556+0000","last_peered":"2023-10-08T13:26:08.722556+0000","last_clean":"2023-10-08T13:26:08.722556+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:26:08.722556+0000","last_undegraded":"2023-10-08T13:26:08.722556+0000","last_fullsized":"2023-10-08T13:26:08.722556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719375+0000","last_change":"2023-10-08T13:25:33.439503+0000","last_active":"2023-10-08T13:26:08.719375+0000","last_peered":"2023-10-08T13:26:08.719375+0000","last_clean":"2023-10-08T13:26:08.719375+0000","last_became_active":"2023-10-08T13:25:33.439197+0000","last_became_peered":"2023-10-08T13:25:33.439197+0000","last_unstale":"2023-10-08T13:26:08.719375+0000","last_undegraded":"2023-10-08T13:26:08.719375+0000","last_fullsized":"2023-10-08T13:26:08.719375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:28:19.983872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717438+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:26:08.717438+0000","last_peered":"2023-10-08T13:26:08.717438+0000","last_clean":"2023-10-08T13:26:08.717438+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:26:08.717438+0000","last_undegraded":"2023-10-08T13:26:08.717438+0000","last_fullsized":"2023-10-08T13:26:08.717438+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719762+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:26:08.719762+0000","last_peered":"2023-10-08T13:26:08.719762+0000","last_clean":"2023-10-08T13:26:08.719762+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:26:08.719762+0000","last_undegraded":"2023-10-08T13:26:08.719762+0000","last_fullsized":"2023-10-08T13:26:08.719762+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:38.471776+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:26:38.471776+0000","last_peered":"2023-10-08T13:26:38.471776+0000","last_clean":"2023-10-08T13:26:38.471776+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:26:38.471776+0000","last_undegraded":"2023-10-08T13:26:38.471776+0000","last_fullsized":"2023-10-08T13:26:38.471776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717804+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:26:08.717804+0000","last_peered":"2023-10-08T13:26:08.717804+0000","last_clean":"2023-10-08T13:26:08.717804+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:26:08.717804+0000","last_undegraded":"2023-10-08T13:26:08.717804+0000","last_fullsized":"2023-10-08T13:26:08.717804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717213+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:26:08.717213+0000","last_peered":"2023-10-08T13:26:08.717213+0000","last_clean":"2023-10-08T13:26:08.717213+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:26:08.717213+0000","last_undegraded":"2023-10-08T13:26:08.717213+0000","last_fullsized":"2023-10-08T13:26:08.717213+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.721375+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:26:08.721375+0000","last_peered":"2023-10-08T13:26:08.721375+0000","last_clean":"2023-10-08T13:26:08.721375+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:26:08.721375+0000","last_undegraded":"2023-10-08T13:26:08.721375+0000","last_fullsized":"2023-10-08T13:26:08.721375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.729493+0000","last_change":"2023-10-08T13:26:09.729493+0000","last_active":"2023-10-08T13:26:09.729493+0000","last_peered":"2023-10-08T13:26:09.729493+0000","last_clean":"2023-10-08T13:26:09.729493+0000","last_became_active":"2023-10-08T13:26:09.729238+0000","last_became_peered":"2023-10-08T13:26:09.729238+0000","last_unstale":"2023-10-08T13:26:09.729493+0000","last_undegraded":"2023-10-08T13:26:09.729493+0000","last_fullsized":"2023-10-08T13:26:09.729493+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.262086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719417+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:26:08.719417+0000","last_peered":"2023-10-08T13:26:08.719417+0000","last_clean":"2023-10-08T13:26:08.719417+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:26:08.719417+0000","last_undegraded":"2023-10-08T13:26:08.719417+0000","last_fullsized":"2023-10-08T13:26:08.719417+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719802+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:26:08.719802+0000","last_peered":"2023-10-08T13:26:08.719802+0000","last_clean":"2023-10-08T13:26:08.719802+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:26:08.719802+0000","last_undegraded":"2023-10-08T13:26:08.719802+0000","last_fullsized":"2023-10-08T13:26:08.719802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717658+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:26:08.717658+0000","last_peered":"2023-10-08T13:26:08.717658+0000","last_clean":"2023-10-08T13:26:08.717658+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:26:08.717658+0000","last_undegraded":"2023-10-08T13:26:08.717658+0000","last_fullsized":"2023-10-08T13:26:08.717658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716332+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:26:08.716332+0000","last_peered":"2023-10-08T13:26:08.716332+0000","last_clean":"2023-10-08T13:26:08.716332+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:26:08.716332+0000","last_undegraded":"2023-10-08T13:26:08.716332+0000","last_fullsized":"2023-10-08T13:26:08.716332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725961+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:26:08.725961+0000","last_peered":"2023-10-08T13:26:08.725961+0000","last_clean":"2023-10-08T13:26:08.725961+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:26:08.725961+0000","last_undegraded":"2023-10-08T13:26:08.725961+0000","last_fullsized":"2023-10-08T13:26:08.725961+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.725819+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:26:08.725819+0000","last_peered":"2023-10-08T13:26:08.725819+0000","last_clean":"2023-10-08T13:26:08.725819+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:26:08.725819+0000","last_undegraded":"2023-10-08T13:26:08.725819+0000","last_fullsized":"2023-10-08T13:26:08.725819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.717410+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:26:08.717410+0000","last_peered":"2023-10-08T13:26:08.717410+0000","last_clean":"2023-10-08T13:26:08.717410+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:26:08.717410+0000","last_undegraded":"2023-10-08T13:26:08.717410+0000","last_fullsized":"2023-10-08T13:26:08.717410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720252+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:26:08.720252+0000","last_peered":"2023-10-08T13:26:08.720252+0000","last_clean":"2023-10-08T13:26:08.720252+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:26:08.720252+0000","last_undegraded":"2023-10-08T13:26:08.720252+0000","last_fullsized":"2023-10-08T13:26:08.720252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T13:26:09.729602+0000","last_change":"2023-10-08T13:26:09.729602+0000","last_active":"2023-10-08T13:26:09.729602+0000","last_peered":"2023-10-08T13:26:09.729602+0000","last_clean":"2023-10-08T13:26:09.729602+0000","last_became_active":"2023-10-08T13:26:09.729112+0000","last_became_peered":"2023-10-08T13:26:09.729112+0000","last_unstale":"2023-10-08T13:26:09.729602+0000","last_undegraded":"2023-10-08T13:26:09.729602+0000","last_fullsized":"2023-10-08T13:26:09.729602+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:29.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.726356+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:26:08.726356+0000","last_peered":"2023-10-08T13:26:08.726356+0000","last_clean":"2023-10-08T13:26:08.726356+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:26:08.726356+0000","last_undegraded":"2023-10-08T13:26:08.726356+0000","last_fullsized":"2023-10-08T13:26:08.726356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722449+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:26:08.722449+0000","last_peered":"2023-10-08T13:26:08.722449+0000","last_clean":"2023-10-08T13:26:08.722449+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:26:08.722449+0000","last_undegraded":"2023-10-08T13:26:08.722449+0000","last_fullsized":"2023-10-08T13:26:08.722449+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720999+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:26:08.720999+0000","last_peered":"2023-10-08T13:26:08.720999+0000","last_clean":"2023-10-08T13:26:08.720999+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:26:08.720999+0000","last_undegraded":"2023-10-08T13:26:08.720999+0000","last_fullsized":"2023-10-08T13:26:08.720999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.722011+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:26:08.722011+0000","last_peered":"2023-10-08T13:26:08.722011+0000","last_clean":"2023-10-08T13:26:08.722011+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:26:08.722011+0000","last_undegraded":"2023-10-08T13:26:08.722011+0000","last_fullsized":"2023-10-08T13:26:08.722011+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.720130+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:26:08.720130+0000","last_peered":"2023-10-08T13:26:08.720130+0000","last_clean":"2023-10-08T13:26:08.720130+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:26:08.720130+0000","last_undegraded":"2023-10-08T13:26:08.720130+0000","last_fullsized":"2023-10-08T13:26:08.720130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.719160+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:26:08.719160+0000","last_peered":"2023-10-08T13:26:08.719160+0000","last_clean":"2023-10-08T13:26:08.719160+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:26:08.719160+0000","last_undegraded":"2023-10-08T13:26:08.719160+0000","last_fullsized":"2023-10-08T13:26:08.719160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T13:26:08.716507+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:26:08.716507+0000","last_peered":"2023-10-08T13:26:08.716507+0000","last_clean":"2023-10-08T13:26:08.716507+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:26:08.716507+0000","last_undegraded":"2023-10-08T13:26:08.716507+0000","last_fullsized":"2023-10-08T13:26:08.716507+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65395,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":416,"num_read_kb":284,"num_write":234,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":196185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":504412,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.498},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63600000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.65400000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:25:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.68899999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678046,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28124,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717028,"statfs":{"total":95995035648,"available":95966236672,"internally_reserved":0,"allocated":1134592,"data_stored":1153576,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":9.8559999999999999,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.8759999999999994,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.44400000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.69699999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.38400000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.075,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.61499999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.86199999999999999,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.7279999999999998,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2539999999999996,"5min":4.2539999999999996,"15min":4.2539999999999996},"last":0.56399999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82399999999999995}]}]},{"osd":9,"up_from":66,"seq":283467841570,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":504342,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.45000000000000001,"15min":0.46200000000000002},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.59599999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65200000000000002,"15min":0.66400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76000000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.63800000000000001,"15min":0.65600000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82599999999999996,"5min":0.997,"15min":0.997},"last":0.746}]},{"osd":2,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70699999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.79200000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.53900000000000003,"15min":0.55500000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.60099999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.46700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72399999999999998,"5min":1.04,"15min":1.04},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.755,"5min":4.4619999999999997,"15min":4.4619999999999997},"last":0.876}]},{"osd":5,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.66600000000000004,"15min":0.67800000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.747,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72399999999999998,"15min":0.73899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88400000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.76500000000000001,"15min":0.78700000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85599999999999998,"5min":1.462,"15min":1.462},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.85699999999999998,"15min":0.88900000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":2.484,"15min":2.484},"last":0.93100000000000005}]},{"osd":8,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.75700000000000001,"15min":0.77400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84599999999999997,"5min":1.03,"15min":1.03},"last":0.79800000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.90600000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":11.278,"5min":11.278,"15min":11.278},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85799999999999998,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.83599999999999997}]},{"osd":11,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.96399999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103206,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":500343,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.62,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65100000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.2880000000000003,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.44600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.497,"5min":0.45600000000000002,"15min":0.44900000000000001},"min":{"1min":0.28699999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.59599999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.79300000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58899999999999997,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.745,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63600000000000001,"15min":0.63300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.33600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.313,"5min":0.311,"15min":0.311},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.82299999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.47799999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.90800000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.319,"5min":4.319,"15min":4.319},"last":0.80600000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:25:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.90800000000000003}]},{"osd":9,"last update":"Sun Oct 8 13:26:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.52200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.68000000000000005,"15min":0.66900000000000004},"min":{"1min":0.55600000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.88900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.63,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.98099999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.87},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.84399999999999997}]}]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1097120,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70599999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88300000000000001,"5min":0.995,"15min":0.995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.607}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":1.5349999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.497}]},{"osd":5,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.7110000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.53800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":1.585}]},{"osd":6,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85999999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65800000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.504,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.002,"5min":1.05,"15min":1.05},"last":0.748}]},{"osd":9,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.70599999999999996,"15min":0.70099999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58599999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.036,"15min":1.036},"last":1.488}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495662,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":499846,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.26800000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.495,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.74399999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.45400000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":1.085,"15min":1.085},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.65700000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.371},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65400000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":1.131,"15min":1.131},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.624,"15min":0.624},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46400000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":1.179,"15min":1.179},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.63800000000000001},"min":{"1min":0.47099999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.79900000000000004,"5min":1.206,"15min":1.206},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.57299999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85399999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:26:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.44},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.71099999999999997,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93000000000000005,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51100000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.61899999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":563555,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.70999999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.42299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.58299999999999996,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:26:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.53100000000000003},"min":{"1min":0.36899999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80900000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.44},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"min":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85199999999999998,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.499}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.755,"15min":0.80300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.127,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:26:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.46700000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83999999999999997,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66700000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:25:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.41399999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.49399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.69999999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:19 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75700000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.58199999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73699999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.82299999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":501302,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79300000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.74399999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.46100000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.434}]},{"osd":4,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":0.996,"15min":0.69999999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":45.225000000000001,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":2.7130000000000001,"5min":0.98499999999999999,"15min":0.68300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":45.244,"5min":45.244,"15min":45.244},"last":0.60599999999999998}]},{"osd":6,"last update":"Sun Oct 8 13:26:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77600000000000002,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.47199999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53500000000000003}]},{"osd":8,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92700000000000005,"5min":3.403,"15min":3.403},"last":0.67600000000000005}]},{"osd":9,"last update":"Sun Oct 8 13:26:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.69099999999999995,"15min":0.70899999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":1.026,"15min":1.026},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.68200000000000005,"15min":0.69399999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.95499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.625}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97099999999999997,"5min":1.008,"15min":1.008},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69499999999999995}]},{"osd":11,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.70599999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":564165,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68600000000000005,"5min":0.872,"15min":0.872},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68500000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42799999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.54700000000000004,"15min":0.52500000000000002},"min":{"1min":0.39600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90600000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.442,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52900000000000003}]},{"osd":3,"last update":"Sun Oct 8 13:26:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75800000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.97599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.44400000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.45500000000000002,"15min":0.42599999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.504,"15min":0.47199999999999998},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54300000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:25:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.41799999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59299999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:25:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65300000000000002,"15min":0.64900000000000002},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66600000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.64500000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.58899999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.75700000000000001,"15min":0.73399999999999999},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.054,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.627}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":1.002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72299999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149754,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":499273,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.32100000000000001},"min":{"1min":0.27000000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54100000000000004,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.35899999999999999,"15min":0.32500000000000001},"min":{"1min":0.28499999999999998,"5min":0.186,"15min":0.186},"max":{"1min":0.62,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.32000000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53400000000000003,"15min":0.499},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":1.806,"15min":1.806},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76300000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.439}]},{"osd":2,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.51700000000000002},"min":{"1min":0.49099999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.81799999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.5},"min":{"1min":0.432,"5min":0.309,"15min":0.309},"max":{"1min":0.78100000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73299999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.748,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.46000000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.48999999999999999},"min":{"1min":0.375,"5min":0.246,"15min":0.246},"max":{"1min":0.76900000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.47699999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.497},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.60099999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.42099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.84599999999999997,"5min":1.05,"15min":1.05},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.67200000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80400000000000005,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57399999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.88800000000000001,"5min":1.583,"15min":1.583},"last":0.621}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.629},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60899999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920823,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":503920,"data_compressed":20574,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.502},{"interface":"front","average":{"1min":0.504,"5min":0.436,"15min":0.39400000000000002},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.55500000000000005},"min":{"1min":0.50900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.90800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56399999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66800000000000004,"15min":0.63500000000000001},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:26:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66900000000000004,"15min":0.65200000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92300000000000004,"5min":1.004,"15min":1.004},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64700000000000002,"15min":0.64500000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.93999999999999995}]},{"osd":8,"last update":"Sun Oct 8 13:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.80300000000000005,"15min":0.80400000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.96999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.04,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.90600000000000003,"5min":1,"15min":1},"last":0.63300000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.131,"15min":1.131},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68799999999999994}]},{"osd":11,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.996}]}]},{"osd":5,"up_from":38,"seq":163208757298,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1096798,"data_compressed":56190,"data_compressed_allocated":73728,"data_compressed_original":647168,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.54500000000000004}]},{"osd":1,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.46100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.876,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.75700000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.38400000000000001,"15min":0.374},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64000000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39100000000000001},"min":{"1min":0.26100000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.71199999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:25:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.44400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.59099999999999997},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78300000000000003,"5min":1.032,"15min":1.032},"last":0.95099999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.46899999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65900000000000003,"15min":0.65300000000000002},"min":{"1min":0.44500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0389999999999999,"5min":1.615,"15min":1.615},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.57099999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.012},{"interface":"front","average":{"1min":0.754,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.57299999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.998}]},{"osd":8,"last update":"Sun Oct 8 13:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":1.069,"15min":1.069},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76700000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.82799999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39000000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94499999999999995,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1080000000000001,"5min":1.353,"15min":1.353},"last":0.92300000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.59899999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:26:46.813 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-08T13:26:46.813 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T13:26:46.813 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-08T13:26:46.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-08T13:26:47.372 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:47.922 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:47 smithi139 ceph-mon[99506]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:47.922 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:47 smithi139 ceph-mon[99506]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:47 smithi187 ceph-mon[104336]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:47 smithi187 ceph-mon[104336]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:47 smithi155 ceph-mon[103467]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:26:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:47 smithi155 ceph-mon[103467]: pgmap v276: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 -- 172.21.15.139:0/3086955004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 msgr2=0x7f0d2c106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 --2- 172.21.15.139:0/3086955004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c106b80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009990 tx=0x7f0d1c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 -- 172.21.15.139:0/3086955004 shutdown_connections 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 --2- 172.21.15.139:0/3086955004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 0x7f0d2c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 --2- 172.21.15.139:0/3086955004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c106b80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 --2- 172.21.15.139:0/3086955004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 -- 172.21.15.139:0/3086955004 >> 172.21.15.139:0/3086955004 conn(0x7f0d2c075790 msgr2=0x7f0d2c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 -- 172.21.15.139:0/3086955004 shutdown_connections 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.681+0000 7f0d31d03700 1 -- 172.21.15.139:0/3086955004 wait complete. 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 Processor -- start 2023-10-08T13:26:48.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 -- start start 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 0x7f0d2c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1970b0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c197220 con 0x7f0d2c068b30 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d31d03700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1973e0 con 0x7f0d2c068190 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:38858/0 (socket says 172.21.15.139:38858) 2023-10-08T13:26:48.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39146/0 (socket says 172.21.15.139:39146) 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 0x7f0d2c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.682+0000 7f0d2b7fe700 1 -- 172.21.15.139:0/4053975493 learned_addr learned my addr 172.21.15.139:0/4053975493 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 -- 172.21.15.139:0/4053975493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 msgr2=0x7f0d2c19c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c19c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 -- 172.21.15.139:0/4053975493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 msgr2=0x7f0d2c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 0x7f0d2c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 -- 172.21.15.139:0/4053975493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c0095f0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d2bfff700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400cc50 tx=0x7f0d2400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400aa90 con 0x7f0d2c1067a0 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c1976c0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d2400abf0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240115e0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.683+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c1a38b0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.684+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c108d50 con 0x7f0d2c1067a0 2023-10-08T13:26:48.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.686+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f0d24004ad0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.686+0000 7f0d28ff9700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 0x7f0d140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:48.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.687+0000 7f0d2b7fe700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 0x7f0d140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:48.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.687+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f0d240cd690 con 0x7f0d2c1067a0 2023-10-08T13:26:48.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.687+0000 7f0d2b7fe700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 0x7f0d140a3a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c010 tx=0x7f0d1c00be00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:48.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.690+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0d24096850 con 0x7f0d2c1067a0 2023-10-08T13:26:48.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.921+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d2c1978b0 con 0x7f0d2c1067a0 2023-10-08T13:26:48.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.921+0000 7f0d28ff9700 1 -- 172.21.15.139:0/4053975493 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0d24016020 con 0x7f0d2c1067a0 2023-10-08T13:26:48.923 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:48.923 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.923+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 msgr2=0x7f0d140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.923+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 0x7f0d140a3a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c010 tx=0x7f0d1c00be00 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.923+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 msgr2=0x7f0d2c196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.923+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400cc50 tx=0x7f0d2400cf60 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 shutdown_connections 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0d140a1560 0x7f0d140a3a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d2c1067a0 0x7f0d2c196a50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d2c068190 0x7f0d2c19c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 --2- 172.21.15.139:0/4053975493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2c068b30 0x7f0d2c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:48.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 >> 172.21.15.139:0/4053975493 conn(0x7f0d2c075790 msgr2=0x7f0d2c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:48.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 shutdown_connections 2023-10-08T13:26:48.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:48.924+0000 7f0d31d03700 1 -- 172.21.15.139:0/4053975493 wait complete. 2023-10-08T13:26:49.335 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-08T13:26:49.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:26:49.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 -- 172.21.15.139:0/79829494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 msgr2=0x7f83dc10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 --2- 172.21.15.139:0/79829494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc10c3c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009fc0 tx=0x7f83d400b330 comp rx=0 tx=0).stop 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 -- 172.21.15.139:0/79829494 shutdown_connections 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 --2- 172.21.15.139:0/79829494 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc10c3c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 --2- 172.21.15.139:0/79829494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 0x7f83dc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 --2- 172.21.15.139:0/79829494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 0x7f83dc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 -- 172.21.15.139:0/79829494 >> 172.21.15.139:0/79829494 conn(0x7f83dc0fb030 msgr2=0x7f83dc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:49.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 -- 172.21.15.139:0/79829494 shutdown_connections 2023-10-08T13:26:49.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.461+0000 7f83e1de1700 1 -- 172.21.15.139:0/79829494 wait complete. 2023-10-08T13:26:49.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 Processor -- start 2023-10-08T13:26:49.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 -- start start 2023-10-08T13:26:49.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 0x7f83dc19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 0x7f83dc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc1991e0 con 0x7f83dc0fff00 2023-10-08T13:26:49.467 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc199350 con 0x7f83dc105600 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83e1de1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc199510 con 0x7f83dc0ff540 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39158/0 (socket says 172.21.15.139:39158) 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 -- 172.21.15.139:0/3723926858 learned_addr learned my addr 172.21.15.139:0/3723926858 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83db7fe700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 0x7f83dc19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83dbfff700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 0x7f83dc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 -- 172.21.15.139:0/3723926858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 msgr2=0x7f83dc19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 0x7f83dc19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 -- 172.21.15.139:0/3723926858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 msgr2=0x7f83dc198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 0x7f83dc198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.468 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.462+0000 7f83daffd700 1 -- 172.21.15.139:0/3723926858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d4009c40 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83daffd700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f83d000e9c0 tx=0x7f83d000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d000cbd0 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc1997f0 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83d000eeb0 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d0005580 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.463+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc1a5a40 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.464+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc100c60 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.465+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f83d0004750 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.465+0000 7f83d8ff9700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 0x7f83c40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.465+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f83d0014070 con 0x7f83dc0fff00 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.465+0000 7f83db7fe700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 0x7f83c40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.466+0000 7f83db7fe700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 0x7f83c40a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009c60 tx=0x7f83cc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:49.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.470+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f83d0096770 con 0x7f83dc0fff00 2023-10-08T13:26:49.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.662+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83dc067450 con 0x7f83dc0fff00 2023-10-08T13:26:49.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.664+0000 7f83d8ff9700 1 -- 172.21.15.139:0/3723926858 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24773 (secure 0 0 0) 0x7f83d0099d90 con 0x7f83dc0fff00 2023-10-08T13:26:49.665 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:49.665 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":89,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:26:09.712811+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 msgr2=0x7f83c40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 0x7f83c40a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009c60 tx=0x7f83cc009260 comp rx=0 tx=0).stop 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 msgr2=0x7f83dc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f83d000e9c0 tx=0x7f83d000ecd0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 shutdown_connections 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f83c40a1560 0x7f83c40a3a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83dc105600 0x7f83dc198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83dc0ff540 0x7f83dc19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 --2- 172.21.15.139:0/3723926858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f83dc0fff00 0x7f83dc19ef90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 >> 172.21.15.139:0/3723926858 conn(0x7f83dc0fb030 msgr2=0x7f83dc0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:49.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 shutdown_connections 2023-10-08T13:26:49.671 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.666+0000 7f83e1de1700 1 -- 172.21.15.139:0/3723926858 wait complete. 2023-10-08T13:26:49.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:26:49.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:26:49.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 -- 172.21.15.139:0/4067228678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80ff620 msgr2=0x7fd9b810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/4067228678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80ff620 0x7fd9b810d600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd9a80099c0 tx=0x7fd9a8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 -- 172.21.15.139:0/4067228678 shutdown_connections 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/4067228678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80ff620 0x7fd9b810d600 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/4067228678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/4067228678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80fec60 0x7fd9b80ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 -- 172.21.15.139:0/4067228678 >> 172.21.15.139:0/4067228678 conn(0x7fd9b8075c20 msgr2=0x7fd9b80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 -- 172.21.15.139:0/4067228678 shutdown_connections 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.806+0000 7fd9be0a0700 1 -- 172.21.15.139:0/4067228678 wait complete. 2023-10-08T13:26:49.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 Processor -- start 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 -- start start 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ff620 0x7fd9b819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8196ff0 con 0x7fd9b80fec60 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8197160 con 0x7fd9b8106720 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9be0a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b8197320 con 0x7fd9b80ff620 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39170/0 (socket says 172.21.15.139:39170) 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 -- 172.21.15.139:0/1366285961 learned_addr learned my addr 172.21.15.139:0/1366285961 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:49.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b7fff700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b6ffd700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ff620 0x7fd9b819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 -- 172.21.15.139:0/1366285961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ff620 msgr2=0x7fd9b819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ff620 0x7fd9b819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 -- 172.21.15.139:0/1366285961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 msgr2=0x7fd9b8196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b77fe700 1 -- 172.21.15.139:0/1366285961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80095f0 con 0x7fd9b80fec60 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.807+0000 7fd9b7fff700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9b77fe700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ef10 tx=0x7fd9b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000cad0 con 0x7fd9b80fec60 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9b000f040 con 0x7fd9b80fec60 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b81975a0 con 0x7fd9b80fec60 2023-10-08T13:26:49.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0007ea0 con 0x7fd9b80fec60 2023-10-08T13:26:49.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.808+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b81a3850 con 0x7fd9b80fec60 2023-10-08T13:26:49.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.809+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8108ce0 con 0x7fd9b80fec60 2023-10-08T13:26:49.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.810+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd9b0007500 con 0x7fd9b80fec60 2023-10-08T13:26:49.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.810+0000 7fd9b4ff9700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 0x7fd9a00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:49.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.810+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd9b00cdcd0 con 0x7fd9b80fec60 2023-10-08T13:26:49.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.810+0000 7fd9b6ffd700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 0x7fd9a00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:49.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.811+0000 7fd9b6ffd700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 0x7fd9a00a3aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8197b50 tx=0x7fd9ac0094f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:49.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:49.814+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd9b0096de0 con 0x7fd9b80fec60 2023-10-08T13:26:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:49 smithi139 ceph-mon[99506]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4053975493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:26:49.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:49 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3723926858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:49 smithi187 ceph-mon[104336]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4053975493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:26:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:49 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3723926858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:50.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.006+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9b8197e50 con 0x7fd9b80fec60 2023-10-08T13:26:50.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.006+0000 7fd9b4ff9700 1 -- 172.21.15.139:0/1366285961 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9b009a400 con 0x7fd9b80fec60 2023-10-08T13:26:50.007 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:26:50.009 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 msgr2=0x7fd9a00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.009 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 0x7fd9a00a3aa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8197b50 tx=0x7fd9ac0094f0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 msgr2=0x7fd9b819c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000ef10 tx=0x7fd9b000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 shutdown_connections 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd9a00a15e0 0x7fd9a00a3aa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b8106720 0x7fd9b8196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9b80fec60 0x7fd9b819c860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 --2- 172.21.15.139:0/1366285961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ff620 0x7fd9b819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 >> 172.21.15.139:0/1366285961 conn(0x7fd9b8075c20 msgr2=0x7fd9b80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 shutdown_connections 2023-10-08T13:26:50.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.008+0000 7fd9be0a0700 1 -- 172.21.15.139:0/1366285961 wait complete. 2023-10-08T13:26:50.022 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:26:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:49 smithi155 ceph-mon[103467]: pgmap v277: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:49 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4053975493' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T13:26:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:49 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3723926858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:50.148 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- 172.21.15.139:0/1408215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 msgr2=0x7f92ec100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/1408215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec100bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009990 tx=0x7f92d8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- 172.21.15.139:0/1408215 shutdown_connections 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/1408215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec101100 0x7f92ec10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/1408215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec106750 0x7f92ec106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/1408215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec100bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- 172.21.15.139:0/1408215 >> 172.21.15.139:0/1408215 conn(0x7f92ec0fc230 msgr2=0x7f92ec0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- 172.21.15.139:0/1408215 shutdown_connections 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- 172.21.15.139:0/1408215 wait complete. 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 Processor -- start 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- start start 2023-10-08T13:26:50.149 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 0x7f92ec19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec106750 0x7f92ec196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1970e0 con 0x7f92ec100740 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec197250 con 0x7f92ec101100 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.146+0000 7f92f2c5d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec197410 con 0x7f92ec106750 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39182/0 (socket says 172.21.15.139:39182) 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 -- 172.21.15.139:0/510208264 learned_addr learned my addr 172.21.15.139:0/510208264 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92ebfff700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 0x7f92ec19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f11fa700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec106750 0x7f92ec196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.150 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 -- 172.21.15.139:0/510208264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec106750 msgr2=0x7f92ec196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec106750 0x7f92ec196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 -- 172.21.15.139:0/510208264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 msgr2=0x7f92ec19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 0x7f92ec19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 -- 172.21.15.139:0/510208264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80095f0 con 0x7f92ec100740 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92ebfff700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 0x7f92ec19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f09f9700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c9b0 tx=0x7f92e000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0007b00 con 0x7f92ec100740 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92e0007c60 con 0x7f92ec100740 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec1976f0 con 0x7f92ec100740 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0018660 con 0x7f92ec100740 2023-10-08T13:26:50.151 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.147+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec1a37f0 con 0x7f92ec100740 2023-10-08T13:26:50.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.148+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec108d60 con 0x7f92ec100740 2023-10-08T13:26:50.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.149+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f92e0018880 con 0x7f92ec100740 2023-10-08T13:26:50.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.150+0000 7f92e9ffb700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 0x7f92dc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.150+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f92e00cd2f0 con 0x7f92ec100740 2023-10-08T13:26:50.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.150+0000 7f92ebfff700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 0x7f92dc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.150+0000 7f92ebfff700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 0x7f92dc0a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f92d800b5c0 tx=0x7f92d801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.154+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92e0096400 con 0x7f92ec100740 2023-10-08T13:26:50.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.347+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92ec197df0 con 0x7f92ec100740 2023-10-08T13:26:50.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.348+0000 7f92e9ffb700 1 -- 172.21.15.139:0/510208264 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92e0099a20 con 0x7f92ec100740 2023-10-08T13:26:50.349 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:26:50.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 msgr2=0x7f92dc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 0x7f92dc0a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f92d800b5c0 tx=0x7f92d801a040 comp rx=0 tx=0).stop 2023-10-08T13:26:50.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 msgr2=0x7f92ec19c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c9b0 tx=0x7f92e000cd70 comp rx=0 tx=0).stop 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 shutdown_connections 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92dc0a1560 0x7f92dc0a3a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92ec106750 0x7f92ec196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92ec100740 0x7f92ec19c870 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 --2- 172.21.15.139:0/510208264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92ec101100 0x7f92ec19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 >> 172.21.15.139:0/510208264 conn(0x7f92ec0fc230 msgr2=0x7f92ec0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 shutdown_connections 2023-10-08T13:26:50.352 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.350+0000 7f92f2c5d700 1 -- 172.21.15.139:0/510208264 wait complete. 2023-10-08T13:26:50.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:26:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 -- 172.21.15.139:0/653601948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec0ff640 msgr2=0x7fa0ec0ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/653601948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec0ffac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009990 tx=0x7fa0e0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 -- 172.21.15.139:0/653601948 shutdown_connections 2023-10-08T13:26:50.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/653601948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 0x7fa0ec10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/653601948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec105630 0x7fa0ec105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/653601948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec0ffac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 -- 172.21.15.139:0/653601948 >> 172.21.15.139:0/653601948 conn(0x7fa0ec076790 msgr2=0x7fa0ec076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 -- 172.21.15.139:0/653601948 shutdown_connections 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 -- 172.21.15.139:0/653601948 wait complete. 2023-10-08T13:26:50.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.489+0000 7fa0f14aa700 1 Processor -- start 2023-10-08T13:26:50.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 -- start start 2023-10-08T13:26:50.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 0x7fa0ec197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec198700 con 0x7fa0ec105630 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec1a2f10 con 0x7fa0ec100000 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0f14aa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec1a3050 con 0x7fa0ec0ff640 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39200/0 (socket says 172.21.15.139:39200) 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 -- 172.21.15.139:0/4138988780 learned_addr learned my addr 172.21.15.139:0/4138988780 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eaffd700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0ea7fc700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 0x7fa0ec197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 -- 172.21.15.139:0/4138988780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec0ff640 msgr2=0x7fa0ec197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 -- 172.21.15.139:0/4138988780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 msgr2=0x7fa0ec197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 0x7fa0ec197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 -- 172.21.15.139:0/4138988780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00095f0 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.490+0000 7fa0eb7fe700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400ef30 tx=0x7fa0e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.491+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4018070 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.491+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0e400f040 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.491+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec1a3280 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.491+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e400cd00 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.491+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec1a3760 con 0x7fa0ec105630 2023-10-08T13:26:50.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.492+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ec107c40 con 0x7fa0ec105630 2023-10-08T13:26:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.493+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fa0e4003a00 con 0x7fa0ec105630 2023-10-08T13:26:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.494+0000 7fa0d3fff700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 0x7fa0d40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.494+0000 7fa0eaffd700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 0x7fa0d40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.494+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fa0e40ccdb0 con 0x7fa0ec105630 2023-10-08T13:26:50.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.495+0000 7fa0eaffd700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 0x7fa0d40a3aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009be0 tx=0x7fa0dc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.499+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0e4095f50 con 0x7fa0ec105630 2023-10-08T13:26:50.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.694+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0ec066ca0 con 0x7fa0ec105630 2023-10-08T13:26:50.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.695+0000 7fa0d3fff700 1 -- 172.21.15.139:0/4138988780 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0e4099570 con 0x7fa0ec105630 2023-10-08T13:26:50.696 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 msgr2=0x7fa0d40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 0x7fa0d40a3aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009be0 tx=0x7fa0dc009260 comp rx=0 tx=0).stop 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 msgr2=0x7fa0ec1a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400ef30 tx=0x7fa0e400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 shutdown_connections 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a15e0 0x7fa0d40a3aa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0ec105630 0x7fa0ec1a29d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ec0ff640 0x7fa0ec197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 --2- 172.21.15.139:0/4138988780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0ec100000 0x7fa0ec197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 >> 172.21.15.139:0/4138988780 conn(0x7fa0ec076790 msgr2=0x7fa0ec0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 shutdown_connections 2023-10-08T13:26:50.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.697+0000 7fa0f14aa700 1 -- 172.21.15.139:0/4138988780 wait complete. 2023-10-08T13:26:50.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 -- 172.21.15.139:0/3206476394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd884100b80 msgr2=0x7fd88410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3206476394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd884100b80 0x7fd88410c510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00b0a0 tx=0x7fd87c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 -- 172.21.15.139:0/3206476394 shutdown_connections 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3206476394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd884100b80 0x7fd88410c510 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3206476394 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8841046a0 0x7fd884104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3206476394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 0x7fd884100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 -- 172.21.15.139:0/3206476394 >> 172.21.15.139:0/3206476394 conn(0x7fd884074940 msgr2=0x7fd884074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 -- 172.21.15.139:0/3206476394 shutdown_connections 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.834+0000 7fd889a1c700 1 -- 172.21.15.139:0/3206476394 wait complete. 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 Processor -- start 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 -- start start 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 0x7fd88419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd884100b80 0x7fd88419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd884195fc0 con 0x7fd8841046a0 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd884196130 con 0x7fd8841001c0 2023-10-08T13:26:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.835+0000 7fd889a1c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841962f0 con 0x7fd884100b80 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39214/0 (socket says 172.21.15.139:39214) 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 -- 172.21.15.139:0/3146189131 learned_addr learned my addr 172.21.15.139:0/3146189131 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd882ffd700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 0x7fd88419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8827fc700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd884100b80 0x7fd88419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 -- 172.21.15.139:0/3146189131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd884100b80 msgr2=0x7fd88419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd884100b80 0x7fd88419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 -- 172.21.15.139:0/3146189131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 msgr2=0x7fd88419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 0x7fd88419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:50.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 -- 172.21.15.139:0/3146189131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c009d00 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd8837fe700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00b070 tx=0x7fd87c007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00e040 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd884196570 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd87c00be40 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c0052a0 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.836+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8841a2820 con 0x7fd8841046a0 2023-10-08T13:26:50.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.837+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd884107c40 con 0x7fd8841046a0 2023-10-08T13:26:50.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.838+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fd87c01d470 con 0x7fd8841046a0 2023-10-08T13:26:50.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.839+0000 7fd888a1a700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 0x7fd8700a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:50.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.839+0000 7fd882ffd700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 0x7fd8700a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:50.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.839+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fd87c0cef10 con 0x7fd8841046a0 2023-10-08T13:26:50.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.839+0000 7fd882ffd700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 0x7fd8700a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd884075e50 tx=0x7fd874009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:50.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:50.842+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd87c098160 con 0x7fd8841046a0 2023-10-08T13:26:50.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1366285961' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:50.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:50 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/510208264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1366285961' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:50.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:50 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/510208264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.035+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd884196e20 con 0x7fd8841046a0 2023-10-08T13:26:51.036 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.035+0000 7fd888a1a700 1 -- 172.21.15.139:0/3146189131 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd87c09b780 con 0x7fd8841046a0 2023-10-08T13:26:51.036 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:26:51.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 msgr2=0x7fd8700a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 0x7fd8700a3a20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd884075e50 tx=0x7fd874009260 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 msgr2=0x7fd884195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00b070 tx=0x7fd87c007930 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 shutdown_connections 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd8700a1560 0x7fd8700a3a20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8841046a0 0x7fd884195960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8841001c0 0x7fd88419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 --2- 172.21.15.139:0/3146189131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd884100b80 0x7fd88419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 >> 172.21.15.139:0/3146189131 conn(0x7fd884074940 msgr2=0x7fd8840fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 shutdown_connections 2023-10-08T13:26:51.039 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.037+0000 7fd889a1c700 1 -- 172.21.15.139:0/3146189131 wait complete. 2023-10-08T13:26:51.051 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:26:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1366285961' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:50 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/510208264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 -- 172.21.15.139:0/771561788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc544100620 msgr2=0x7fc54410c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/771561788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc544100620 0x7fc54410c610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00b0a0 tx=0x7fc53c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 -- 172.21.15.139:0/771561788 shutdown_connections 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/771561788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc544100620 0x7fc54410c610 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/771561788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5441057e0 0x7fc544105bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/771561788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5440ffc60 0x7fc5441000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 -- 172.21.15.139:0/771561788 >> 172.21.15.139:0/771561788 conn(0x7fc544075a90 msgr2=0x7fc5440fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 -- 172.21.15.139:0/771561788 shutdown_connections 2023-10-08T13:26:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.170+0000 7fc54a1a0700 1 -- 172.21.15.139:0/771561788 wait complete. 2023-10-08T13:26:51.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 Processor -- start 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 -- start start 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5440ffc60 0x7fc54419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc544100620 0x7fc54419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544197090 con 0x7fc5441057e0 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc544197200 con 0x7fc544100620 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.171+0000 7fc54a1a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5441973c0 con 0x7fc5440ffc60 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39228/0 (socket says 172.21.15.139:39228) 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 -- 172.21.15.139:0/3515622539 learned_addr learned my addr 172.21.15.139:0/3515622539 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc5437fe700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5440ffc60 0x7fc54419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc542ffd700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc544100620 0x7fc54419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 -- 172.21.15.139:0/3515622539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5440ffc60 msgr2=0x7fc54419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5440ffc60 0x7fc54419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 -- 172.21.15.139:0/3515622539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc544100620 msgr2=0x7fc54419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc544100620 0x7fc54419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 -- 172.21.15.139:0/3515622539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009d00 con 0x7fc5441057e0 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc543fff700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00b070 tx=0x7fc53c007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00e040 con 0x7fc5441057e0 2023-10-08T13:26:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc53c01dd50 con 0x7fc5441057e0 2023-10-08T13:26:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc544197640 con 0x7fc5441057e0 2023-10-08T13:26:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c01b450 con 0x7fc5441057e0 2023-10-08T13:26:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.172+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5441a38a0 con 0x7fc5441057e0 2023-10-08T13:26:51.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.173+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc544100f10 con 0x7fc5441057e0 2023-10-08T13:26:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.174+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc53c0125e0 con 0x7fc5441057e0 2023-10-08T13:26:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.175+0000 7fc540ff9700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 0x7fc52c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.175+0000 7fc5437fe700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 0x7fc52c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.175+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc53c0cf3c0 con 0x7fc5441057e0 2023-10-08T13:26:51.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.176+0000 7fc5437fe700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 0x7fc52c0a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc544067220 tx=0x7fc53400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.179+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc53c098600 con 0x7fc5441057e0 2023-10-08T13:26:51.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.416+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc544066bc0 con 0x7fc5441057e0 2023-10-08T13:26:51.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.416+0000 7fc540ff9700 1 -- 172.21.15.139:0/3515622539 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7fc53c09bc20 con 0x7fc5441057e0 2023-10-08T13:26:51.418 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:51.418 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:26:51.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 msgr2=0x7fc52c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 0x7fc52c0a3a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc544067220 tx=0x7fc53400b410 comp rx=0 tx=0).stop 2023-10-08T13:26:51.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 msgr2=0x7fc544196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00b070 tx=0x7fc53c007b70 comp rx=0 tx=0).stop 2023-10-08T13:26:51.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 shutdown_connections 2023-10-08T13:26:51.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc52c0a1560 0x7fc52c0a3a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5441057e0 0x7fc544196a30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5440ffc60 0x7fc54419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 --2- 172.21.15.139:0/3515622539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc544100620 0x7fc54419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 >> 172.21.15.139:0/3515622539 conn(0x7fc544075a90 msgr2=0x7fc5440fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 shutdown_connections 2023-10-08T13:26:51.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.419+0000 7fc54a1a0700 1 -- 172.21.15.139:0/3515622539 wait complete. 2023-10-08T13:26:51.424 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:26:51.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 -- 172.21.15.139:0/2375321251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc0fff20 msgr2=0x7f58fc10c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 --2- 172.21.15.139:0/2375321251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc0fff20 0x7f58fc10c3e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f58f400b0d0 tx=0x7f58f400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 -- 172.21.15.139:0/2375321251 shutdown_connections 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 --2- 172.21.15.139:0/2375321251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc0fff20 0x7f58fc10c3e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 --2- 172.21.15.139:0/2375321251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc105620 0x7f58fc105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 --2- 172.21.15.139:0/2375321251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 0x7f58fc0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.553+0000 7f5900b64700 1 -- 172.21.15.139:0/2375321251 >> 172.21.15.139:0/2375321251 conn(0x7f58fc0fb050 msgr2=0x7f58fc0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- 172.21.15.139:0/2375321251 shutdown_connections 2023-10-08T13:26:51.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- 172.21.15.139:0/2375321251 wait complete. 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 Processor -- start 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- start start 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 0x7f58fc1011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc0fff20 0x7f58fc101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1a4fe0 con 0x7f58fc105620 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1a5150 con 0x7f58fc0ff560 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.554+0000 7f5900b64700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1a5310 con 0x7f58fc0fff20 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39240/0 (socket says 172.21.15.139:39240) 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 -- 172.21.15.139:0/4057299135 learned_addr learned my addr 172.21.15.139:0/4057299135 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fa59c700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 0x7f58fc1011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58f9d9b700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc0fff20 0x7f58fc101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 -- 172.21.15.139:0/4057299135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc0fff20 msgr2=0x7f58fc101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc0fff20 0x7f58fc101710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 -- 172.21.15.139:0/4057299135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 msgr2=0x7f58fc1011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 0x7f58fc1011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 -- 172.21.15.139:0/4057299135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4009d00 con 0x7f58fc105620 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58fad9d700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58f40094c0 tx=0x7f58f40094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400e040 con 0x7f58fc105620 2023-10-08T13:26:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc1a5590 con 0x7f58fc105620 2023-10-08T13:26:51.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f401d940 con 0x7f58fc105620 2023-10-08T13:26:51.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f401b9f0 con 0x7f58fc105620 2023-10-08T13:26:51.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.555+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc1a5a10 con 0x7f58fc105620 2023-10-08T13:26:51.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.556+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc100c80 con 0x7f58fc105620 2023-10-08T13:26:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.558+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f58f401bb50 con 0x7f58fc105620 2023-10-08T13:26:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.558+0000 7f58f37fe700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 0x7f58e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.559+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f58f40cee80 con 0x7f58fc105620 2023-10-08T13:26:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.559+0000 7f58fa59c700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 0x7f58e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.559+0000 7f58fa59c700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 0x7f58e80a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007b60 tx=0x7f58e40073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.562+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f58f4098020 con 0x7f58fc105620 2023-10-08T13:26:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:51 smithi139 ceph-mon[99506]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4138988780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3146189131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:51 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3515622539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:51.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.756+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58fc0678a0 con 0x7f58fc105620 2023-10-08T13:26:51.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.757+0000 7f58f37fe700 1 -- 172.21.15.139:0/4057299135 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24773 (secure 0 0 0) 0x7f58f409b640 con 0x7f58fc105620 2023-10-08T13:26:51.759 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:51.759 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":89,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:26:09.712811+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:51.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 msgr2=0x7f58e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 0x7f58e80a3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007b60 tx=0x7f58e40073d0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 msgr2=0x7f58fc101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f58f40094c0 tx=0x7f58f40094f0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 shutdown_connections 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.759+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f58e80a1560 0x7f58e80a3a20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58fc105620 0x7f58fc101c70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58fc0ff560 0x7f58fc1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 --2- 172.21.15.139:0/4057299135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58fc0fff20 0x7f58fc101710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 >> 172.21.15.139:0/4057299135 conn(0x7f58fc0fb050 msgr2=0x7f58fc0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 shutdown_connections 2023-10-08T13:26:51.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.760+0000 7f5900b64700 1 -- 172.21.15.139:0/4057299135 wait complete. 2023-10-08T13:26:51.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:26:51.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 -- 172.21.15.139:0/3496997686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca41056b0 msgr2=0x7fdca4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/3496997686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca41056b0 0x7fdca4105a90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009990 tx=0x7fdc94009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 -- 172.21.15.139:0/3496997686 shutdown_connections 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/3496997686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca40fffe0 0x7fdca410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/3496997686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca41056b0 0x7fdca4105a90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/3496997686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 -- 172.21.15.139:0/3496997686 >> 172.21.15.139:0/3496997686 conn(0x7fdca4076780 msgr2=0x7fdca4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 -- 172.21.15.139:0/3496997686 shutdown_connections 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.940+0000 7fdcaa8de700 1 -- 172.21.15.139:0/3496997686 wait complete. 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 Processor -- start 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 -- start start 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca4106580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 0x7fdca4107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41a4df0 con 0x7fdca40fffe0 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41a4f60 con 0x7fdca41056b0 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdcaa8de700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41a5120 con 0x7fdca40ff620 2023-10-08T13:26:51.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.941+0000 7fdca37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39252/0 (socket says 172.21.15.139:39252) 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 -- 172.21.15.139:0/4152496995 learned_addr learned my addr 172.21.15.139:0/4152496995 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca8e7b700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 0x7fdca4107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca3fff700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca4106580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 -- 172.21.15.139:0/4152496995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 msgr2=0x7fdca4106580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca4106580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 -- 172.21.15.139:0/4152496995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 msgr2=0x7fdca4107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 0x7fdca4107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 -- 172.21.15.139:0/4152496995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940095f0 con 0x7fdca40fffe0 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca8e7b700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 0x7fdca4107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:51.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca3fff700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca4106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca37fe700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c9b0 tx=0x7fdc9800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007b00 con 0x7fdca40fffe0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca41a5400 con 0x7fdca40fffe0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc98007c60 con 0x7fdca40fffe0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98018660 con 0x7fdca40fffe0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.942+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca41a5960 con 0x7fdca40fffe0 2023-10-08T13:26:51.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.943+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4100d50 con 0x7fdca40fffe0 2023-10-08T13:26:51.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.944+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fdc98018880 con 0x7fdca40fffe0 2023-10-08T13:26:51.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.945+0000 7fdca17fa700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 0x7fdc8c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:51.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.945+0000 7fdca3fff700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 0x7fdc8c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:51.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.945+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdc980cd380 con 0x7fdca40fffe0 2023-10-08T13:26:51.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.945+0000 7fdca3fff700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 0x7fdc8c0a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000c00 tx=0x7fdc94005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:51.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:51.949+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdc98096490 con 0x7fdca40fffe0 2023-10-08T13:26:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:51 smithi187 ceph-mon[104336]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4138988780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3146189131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:51 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3515622539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:51 smithi155 ceph-mon[103467]: pgmap v278: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4138988780' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:52.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3146189131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:52.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:51 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3515622539' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:52.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.139+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdca4107a60 con 0x7fdca40fffe0 2023-10-08T13:26:52.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.139+0000 7fdca17fa700 1 -- 172.21.15.139:0/4152496995 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc98099ab0 con 0x7fdca40fffe0 2023-10-08T13:26:52.140 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:26:52.142 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 msgr2=0x7fdc8c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 0x7fdc8c0a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdc94000c00 tx=0x7fdc94005fb0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 msgr2=0x7fdca4106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c9b0 tx=0x7fdc9800cd70 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 shutdown_connections 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdc8c0a1560 0x7fdc8c0a3a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca41056b0 0x7fdca4107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdca40ff620 0x7fdca4106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 --2- 172.21.15.139:0/4152496995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdca40fffe0 0x7fdca4106ac0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.141+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 >> 172.21.15.139:0/4152496995 conn(0x7fdca4076780 msgr2=0x7fdca40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.142+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 shutdown_connections 2023-10-08T13:26:52.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.142+0000 7fdcaa8de700 1 -- 172.21.15.139:0/4152496995 wait complete. 2023-10-08T13:26:52.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:26:52.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1279024406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40fec60 msgr2=0x7f2eb40ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1279024406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40fec60 0x7f2eb40ff0e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009990 tx=0x7f2eb0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1279024406 shutdown_connections 2023-10-08T13:26:52.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1279024406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb40ff620 0x7f2eb410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1279024406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb4106740 0x7f2eb4106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1279024406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40fec60 0x7f2eb40ff0e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1279024406 >> 172.21.15.139:0/1279024406 conn(0x7f2eb4075c20 msgr2=0x7f2eb40fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1279024406 shutdown_connections 2023-10-08T13:26:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.278+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1279024406 wait complete. 2023-10-08T13:26:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 Processor -- start 2023-10-08T13:26:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 -- start start 2023-10-08T13:26:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40fec60 0x7f2eb419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 0x7f2eb4196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41970b0 con 0x7f2eb40ff620 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4197220 con 0x7f2eb40fec60 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2ebb5fd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41973e0 con 0x7f2eb4106740 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39266/0 (socket says 172.21.15.139:39266) 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 -- 172.21.15.139:0/1889206537 learned_addr learned my addr 172.21.15.139:0/1889206537 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb9399700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40fec60 0x7f2eb419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb9b9a700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 0x7f2eb4196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 -- 172.21.15.139:0/1889206537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 msgr2=0x7f2eb4196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 0x7f2eb4196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 -- 172.21.15.139:0/1889206537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40fec60 msgr2=0x7f2eb419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40fec60 0x7f2eb419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb8b98700 1 -- 172.21.15.139:0/1889206537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00095f0 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.279+0000 7f2eb9b9a700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 0x7f2eb4196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2eb8b98700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098e0 tx=0x7f2eb000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb001d070 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb4197660 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eb0022470 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0017650 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.280+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb41a38c0 con 0x7f2eb40ff620 2023-10-08T13:26:52.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.281+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4108d50 con 0x7f2eb40ff620 2023-10-08T13:26:52.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.282+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f2eb00225e0 con 0x7f2eb40ff620 2023-10-08T13:26:52.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.282+0000 7f2eaa7fc700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 0x7f2ea00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.282+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f2eb00ce6b0 con 0x7f2eb40ff620 2023-10-08T13:26:52.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.282+0000 7f2eb9399700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 0x7f2ea00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.283+0000 7f2eb9399700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 0x7f2ea00a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4007be0 tx=0x7f2ea40073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.286+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2eb0097850 con 0x7f2eb40ff620 2023-10-08T13:26:52.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.481+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2eb4197ec0 con 0x7f2eb40ff620 2023-10-08T13:26:52.482 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.481+0000 7f2eaa7fc700 1 -- 172.21.15.139:0/1889206537 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2eb009ae70 con 0x7f2eb40ff620 2023-10-08T13:26:52.482 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 msgr2=0x7f2ea00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 0x7f2ea00a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4007be0 tx=0x7f2ea40073d0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 msgr2=0x7f2eb419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00098e0 tx=0x7f2eb000f670 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 shutdown_connections 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ea00a1560 0x7f2ea00a3a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2eb4106740 0x7f2eb4196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb40fec60 0x7f2eb419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 --2- 172.21.15.139:0/1889206537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2eb40ff620 0x7f2eb419ce10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.483+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 >> 172.21.15.139:0/1889206537 conn(0x7f2eb4075c20 msgr2=0x7f2eb40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.484+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 shutdown_connections 2023-10-08T13:26:52.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.484+0000 7f2ebb5fd700 1 -- 172.21.15.139:0/1889206537 wait complete. 2023-10-08T13:26:52.497 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 -- 172.21.15.139:0/3943707549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c105660 msgr2=0x7f786c105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 --2- 172.21.15.139:0/3943707549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c105660 0x7f786c105a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f785c009990 tx=0x7f785c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 -- 172.21.15.139:0/3943707549 shutdown_connections 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 --2- 172.21.15.139:0/3943707549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f786c100730 0x7f786c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 --2- 172.21.15.139:0/3943707549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c105660 0x7f786c105a40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 --2- 172.21.15.139:0/3943707549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 -- 172.21.15.139:0/3943707549 >> 172.21.15.139:0/3943707549 conn(0x7f786c075c20 msgr2=0x7f786c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 -- 172.21.15.139:0/3943707549 shutdown_connections 2023-10-08T13:26:52.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.620+0000 7f7871b18700 1 -- 172.21.15.139:0/3943707549 wait complete. 2023-10-08T13:26:52.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 Processor -- start 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 -- start start 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f786c105660 0x7f786c1a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c198820 con 0x7f786c100730 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1a2f60 con 0x7f786c0ffd70 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f7871b18700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c1a3120 con 0x7f786c105660 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f786affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f786affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39278/0 (socket says 172.21.15.139:39278) 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.621+0000 7f786affd700 1 -- 172.21.15.139:0/2015013591 learned_addr learned my addr 172.21.15.139:0/2015013591 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786b7fe700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 -- 172.21.15.139:0/2015013591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f786c105660 msgr2=0x7f786c1a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f786c105660 0x7f786c1a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 -- 172.21.15.139:0/2015013591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 msgr2=0x7f786c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 -- 172.21.15.139:0/2015013591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0095f0 con 0x7f786c100730 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786b7fe700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f786affd700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f786000d950 tx=0x7f786000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860009b40 con 0x7f786c100730 2023-10-08T13:26:52.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7860009ca0 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c1a3400 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000f620 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.622+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c1a3960 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.623+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c107b90 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.624+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f7860010460 con 0x7f786c100730 2023-10-08T13:26:52.627 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.625+0000 7f7868ff9700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 0x7f78540a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.625+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f78600cd620 con 0x7f786c100730 2023-10-08T13:26:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.625+0000 7f786b7fe700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 0x7f78540a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.625+0000 7f786b7fe700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 0x7f78540a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f785c00b5c0 tx=0x7f785c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.628+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7860096730 con 0x7f786c100730 2023-10-08T13:26:52.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.822+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f786c0ff260 con 0x7f786c100730 2023-10-08T13:26:52.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.822+0000 7f7868ff9700 1 -- 172.21.15.139:0/2015013591 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7860020020 con 0x7f786c100730 2023-10-08T13:26:52.823 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 msgr2=0x7f78540a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 0x7f78540a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f785c00b5c0 tx=0x7f785c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 msgr2=0x7f786c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f786000d950 tx=0x7f786000dd10 comp rx=0 tx=0).stop 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 shutdown_connections 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78540a15e0 0x7f78540a3aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f786c105660 0x7f786c1a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c0ffd70 0x7f786c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 --2- 172.21.15.139:0/2015013591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f786c100730 0x7f786c197ee0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.824+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 >> 172.21.15.139:0/2015013591 conn(0x7f786c075c20 msgr2=0x7f786c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.825+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 shutdown_connections 2023-10-08T13:26:52.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.825+0000 7f7871b18700 1 -- 172.21.15.139:0/2015013591 wait complete. 2023-10-08T13:26:52.837 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:52 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4057299135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:52.837 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:52 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4152496995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:52.837 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:52 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1889206537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:52.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:26:52.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 -- 172.21.15.139:0/1816534324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc067ce0 msgr2=0x7fdddc0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 --2- 172.21.15.139:0/1816534324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc067ce0 0x7fdddc0680c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fddd00099c0 tx=0x7fddd0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 -- 172.21.15.139:0/1816534324 shutdown_connections 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 --2- 172.21.15.139:0/1816534324 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc105b80 0x7fdddc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 --2- 172.21.15.139:0/1816534324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc067ce0 0x7fdddc0680c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 --2- 172.21.15.139:0/1816534324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc1051c0 0x7fdddc105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 -- 172.21.15.139:0/1816534324 >> 172.21.15.139:0/1816534324 conn(0x7fdddc076780 msgr2=0x7fdddc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 -- 172.21.15.139:0/1816534324 shutdown_connections 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.961+0000 7fdde3742700 1 -- 172.21.15.139:0/1816534324 wait complete. 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 Processor -- start 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 -- start start 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc067ce0 0x7fdddc19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc105b80 0x7fdddc196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc197060 con 0x7fdddc1051c0 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc1971d0 con 0x7fdddc105b80 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde3742700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc197390 con 0x7fdddc067ce0 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde0cdd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde0cdd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39292/0 (socket says 172.21.15.139:39292) 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde0cdd700 1 -- 172.21.15.139:0/1150811238 learned_addr learned my addr 172.21.15.139:0/1150811238 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.962+0000 7fdde14de700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc067ce0 0x7fdddc19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde1cdf700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc105b80 0x7fdddc196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 -- 172.21.15.139:0/1150811238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc067ce0 msgr2=0x7fdddc19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc067ce0 0x7fdddc19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 -- 172.21.15.139:0/1150811238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc105b80 msgr2=0x7fdddc196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc105b80 0x7fdddc196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 -- 172.21.15.139:0/1150811238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00095f0 con 0x7fdddc1051c0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde0cdd700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fddd800c920 tx=0x7fddd800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8007b00 con 0x7fdddc1051c0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddd800ce70 con 0x7fdddc1051c0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc197670 con 0x7fdddc1051c0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80054e0 con 0x7fdddc1051c0 2023-10-08T13:26:52.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.963+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc1a38c0 con 0x7fdddc1051c0 2023-10-08T13:26:52.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.964+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc108c70 con 0x7fdddc1051c0 2023-10-08T13:26:52.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.965+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fddd8004750 con 0x7fdddc1051c0 2023-10-08T13:26:52.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.965+0000 7fddce7fc700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 0x7fddc80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:52.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.966+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fddd80ccf00 con 0x7fdddc1051c0 2023-10-08T13:26:52.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.966+0000 7fdde14de700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 0x7fddc80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:52.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.966+0000 7fdde14de700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 0x7fddc80a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009990 tx=0x7fddd0005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:52.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:52.970+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fddd8095fb0 con 0x7fdddc1051c0 2023-10-08T13:26:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:52 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4057299135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:52 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4152496995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:52 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1889206537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:52 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4057299135' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:53.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:52 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4152496995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:52 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1889206537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.159+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdddc197ec0 con 0x7fdddc1051c0 2023-10-08T13:26:53.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.159+0000 7fddce7fc700 1 -- 172.21.15.139:0/1150811238 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) v1 ==== 103+0+11 (secure 0 0 0) 0x7fddd801d0a0 con 0x7fdddc1051c0 2023-10-08T13:26:53.162 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:26:53.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.161+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 msgr2=0x7fddc80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.161+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 0x7fddc80a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009990 tx=0x7fddd0005c60 comp rx=0 tx=0).stop 2023-10-08T13:26:53.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.161+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 msgr2=0x7fdddc19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.161+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fddd800c920 tx=0x7fddd800cc30 comp rx=0 tx=0).stop 2023-10-08T13:26:53.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 shutdown_connections 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fddc80a1560 0x7fddc80a3a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdddc105b80 0x7fdddc196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdddc067ce0 0x7fdddc19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 --2- 172.21.15.139:0/1150811238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdddc1051c0 0x7fdddc19ce10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 >> 172.21.15.139:0/1150811238 conn(0x7fdddc076780 msgr2=0x7fdddc0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 shutdown_connections 2023-10-08T13:26:53.164 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.162+0000 7fdde3742700 1 -- 172.21.15.139:0/1150811238 wait complete. 2023-10-08T13:26:53.175 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2654174822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c4106650 msgr2=0x7ff3c4106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2654174822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c4106650 0x7ff3c4106a30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009990 tx=0x7ff3b8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2654174822 shutdown_connections 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2654174822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c40ff510 0x7ff3c410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2654174822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c4106650 0x7ff3c4106a30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2654174822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40feb50 0x7ff3c40fefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2654174822 >> 172.21.15.139:0/2654174822 conn(0x7ff3c4075a90 msgr2=0x7ff3c40fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:53.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2654174822 shutdown_connections 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2654174822 wait complete. 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 Processor -- start 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.296+0000 7ff3c99c1700 1 -- start start 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40ff510 0x7ff3c419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 0x7ff3c4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4199150 con 0x7ff3c40feb50 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c41992c0 con 0x7ff3c40ff510 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4199480 con 0x7ff3c4106650 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39304/0 (socket says 172.21.15.139:39304) 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 -- 172.21.15.139:0/2684392593 learned_addr learned my addr 172.21.15.139:0/2684392593 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c27fc700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40ff510 0x7ff3c419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c37fe700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 0x7ff3c4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 -- 172.21.15.139:0/2684392593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 msgr2=0x7ff3c4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 0x7ff3c4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 -- 172.21.15.139:0/2684392593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40ff510 msgr2=0x7ff3c419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40ff510 0x7ff3c419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 -- 172.21.15.139:0/2684392593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80095f0 con 0x7ff3c40feb50 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c37fe700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 0x7ff3c4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c2ffd700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801d070 con 0x7ff3c40feb50 2023-10-08T13:26:53.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b8022470 con 0x7ff3c40feb50 2023-10-08T13:26:53.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c4199700 con 0x7ff3c40feb50 2023-10-08T13:26:53.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8017650 con 0x7ff3c40feb50 2023-10-08T13:26:53.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.297+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c41a59b0 con 0x7ff3c40feb50 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.298+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c4101e70 con 0x7ff3c40feb50 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.299+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7ff3b80225e0 con 0x7ff3c40feb50 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.300+0000 7ff3c89bf700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 0x7ff3ac0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.300+0000 7ff3c27fc700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 0x7ff3ac0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.300+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7ff3b80ceb60 con 0x7ff3c40feb50 2023-10-08T13:26:53.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.301+0000 7ff3c27fc700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 0x7ff3ac0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4199cb0 tx=0x7ff3b400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:53.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.304+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff3b8097e20 con 0x7ff3c40feb50 2023-10-08T13:26:53.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.538+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3c4199fe0 con 0x7ff3c40feb50 2023-10-08T13:26:53.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.539+0000 7ff3c89bf700 1 -- 172.21.15.139:0/2684392593 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7ff3b809b440 con 0x7ff3c40feb50 2023-10-08T13:26:53.540 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:53.540 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:26:53.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 msgr2=0x7ff3ac0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 0x7ff3ac0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4199cb0 tx=0x7ff3b400b410 comp rx=0 tx=0).stop 2023-10-08T13:26:53.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 msgr2=0x7ff3c419e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b8004730 comp rx=0 tx=0).stop 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 shutdown_connections 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff3ac0a1560 0x7ff3ac0a3a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3c4106650 0x7ff3c4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff3c40feb50 0x7ff3c419e9c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 --2- 172.21.15.139:0/2684392593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3c40ff510 0x7ff3c419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 >> 172.21.15.139:0/2684392593 conn(0x7ff3c4075a90 msgr2=0x7ff3c410c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 shutdown_connections 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.541+0000 7ff3c99c1700 1 -- 172.21.15.139:0/2684392593 wait complete. 2023-10-08T13:26:53.543 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:26:53.555 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:26:53.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 -- 172.21.15.139:0/521269701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc104030 msgr2=0x7f51bc10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 --2- 172.21.15.139:0/521269701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc104030 0x7f51bc10bbb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f51b400b0a0 tx=0x7f51b400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 -- 172.21.15.139:0/521269701 shutdown_connections 2023-10-08T13:26:53.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 --2- 172.21.15.139:0/521269701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc104030 0x7f51bc10bbb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 --2- 172.21.15.139:0/521269701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc0fef10 0x7f51bc0ff2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 --2- 172.21.15.139:0/521269701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc0ff8c0 0x7f51bc103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 -- 172.21.15.139:0/521269701 >> 172.21.15.139:0/521269701 conn(0x7f51bc075a90 msgr2=0x7f51bc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:53.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 -- 172.21.15.139:0/521269701 shutdown_connections 2023-10-08T13:26:53.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.675+0000 7f51c1c07700 1 -- 172.21.15.139:0/521269701 wait complete. 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 Processor -- start 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 -- start start 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc104030 0x7f51bc19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc195920 0x7f51bc195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc1963a0 con 0x7f51bc0fef10 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc196510 con 0x7f51bc104030 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51c1c07700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc1966d0 con 0x7f51bc195920 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51bb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51bb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39318/0 (socket says 172.21.15.139:39318) 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51bb7fe700 1 -- 172.21.15.139:0/3428644537 learned_addr learned my addr 172.21.15.139:0/3428644537 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.676+0000 7f51baffd700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc104030 0x7f51bc19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bbfff700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc195920 0x7f51bc195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 -- 172.21.15.139:0/3428644537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc195920 msgr2=0x7f51bc195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc195920 0x7f51bc195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 -- 172.21.15.139:0/3428644537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc104030 msgr2=0x7f51bc19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc104030 0x7f51bc19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 -- 172.21.15.139:0/3428644537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009d00 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51bb7fe700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00c920 tx=0x7f51ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac007b00 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51ac00ce70 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc1a26c0 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0054e0 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.677+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc1a2ba0 con 0x7f51bc0fef10 2023-10-08T13:26:53.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.678+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc1072a0 con 0x7f51bc0fef10 2023-10-08T13:26:53.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.679+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f51ac004750 con 0x7f51bc0fef10 2023-10-08T13:26:53.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.680+0000 7f51b8ff9700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 0x7f51a80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:53.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.680+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f51ac0cce80 con 0x7f51bc0fef10 2023-10-08T13:26:53.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.680+0000 7f51baffd700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 0x7f51a80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:53.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.680+0000 7f51baffd700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 0x7f51a80a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51bc196ae0 tx=0x7f51a4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:53.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.684+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f51ac095f90 con 0x7f51bc0fef10 2023-10-08T13:26:53.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.880+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51bc1003e0 con 0x7f51bc0fef10 2023-10-08T13:26:53.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.881+0000 7f51b8ff9700 1 -- 172.21.15.139:0/3428644537 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+24773 (secure 0 0 0) 0x7f51ac01d090 con 0x7f51bc0fef10 2023-10-08T13:26:53.882 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:53.883 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":89,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:26:09.712811+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:26:53.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 msgr2=0x7f51a80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 0x7f51a80a3a20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51bc196ae0 tx=0x7f51a4009260 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 msgr2=0x7f51bc19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00c920 tx=0x7f51ac00cc30 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 shutdown_connections 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f51a80a1560 0x7f51a80a3a20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51bc195920 0x7f51bc195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51bc0fef10 0x7f51bc19b7f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 --2- 172.21.15.139:0/3428644537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51bc104030 0x7f51bc19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.883+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 >> 172.21.15.139:0/3428644537 conn(0x7f51bc075a90 msgr2=0x7f51bc1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.884+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 shutdown_connections 2023-10-08T13:26:53.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:53.884+0000 7f51c1c07700 1 -- 172.21.15.139:0/3428644537 wait complete. 2023-10-08T13:26:53.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:53 smithi139 ceph-mon[99506]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:53.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:53 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2015013591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:53 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1150811238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.896 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:53 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2684392593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:53.897 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:26:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:53 smithi187 ceph-mon[104336]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:53 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2015013591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:53 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1150811238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:53 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2684392593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:54.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 -- 172.21.15.139:0/1647913838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b700ffc80 msgr2=0x7f3b70100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 --2- 172.21.15.139:0/1647913838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b700ffc80 0x7f3b70100100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3b580099c0 tx=0x7f3b58009cd0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 -- 172.21.15.139:0/1647913838 shutdown_connections 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 --2- 172.21.15.139:0/1647913838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70100640 0x7f3b7010c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 --2- 172.21.15.139:0/1647913838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b70105690 0x7f3b70105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 --2- 172.21.15.139:0/1647913838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b700ffc80 0x7f3b70100100 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 -- 172.21.15.139:0/1647913838 >> 172.21.15.139:0/1647913838 conn(0x7f3b70075a90 msgr2=0x7f3b700fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 -- 172.21.15.139:0/1647913838 shutdown_connections 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.018+0000 7f3b76649700 1 -- 172.21.15.139:0/1647913838 wait complete. 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 Processor -- start 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 -- start start 2023-10-08T13:26:54.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b700ffc80 0x7f3b7019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70105690 0x7f3b70195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70195ec0 con 0x7f3b70100640 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b70196030 con 0x7f3b700ffc80 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b76649700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b701961f0 con 0x7f3b70105690 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39334/0 (socket says 172.21.15.139:39334) 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b6f7fe700 1 -- 172.21.15.139:0/2003965773 learned_addr learned my addr 172.21.15.139:0/2003965773 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.019+0000 7f3b6ffff700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b700ffc80 0x7f3b7019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 -- 172.21.15.139:0/2003965773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70105690 msgr2=0x7f3b70195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70105690 0x7f3b70195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 -- 172.21.15.139:0/2003965773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b700ffc80 msgr2=0x7f3b7019b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b700ffc80 0x7f3b7019b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 -- 172.21.15.139:0/2003965773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580095f0 con 0x7f3b70100640 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6f7fe700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3b58006010 tx=0x7f3b58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5801d070 con 0x7f3b70100640 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b580054f0 con 0x7f3b70100640 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b70196470 con 0x7f3b70100640 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800f6f0 con 0x7f3b70100640 2023-10-08T13:26:54.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.020+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b701a2710 con 0x7f3b70100640 2023-10-08T13:26:54.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.021+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b70107b60 con 0x7f3b70100640 2023-10-08T13:26:54.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.023+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f3b580047a0 con 0x7f3b70100640 2023-10-08T13:26:54.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.023+0000 7f3b6d7fa700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 0x7f3b5c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.023+0000 7f3b6ffff700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 0x7f3b5c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.023+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f3b580ce530 con 0x7f3b70100640 2023-10-08T13:26:54.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.024+0000 7f3b6ffff700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 0x7f3b5c0a3a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b70072bb0 tx=0x7f3b6000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.027+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b580976d0 con 0x7f3b70100640 2023-10-08T13:26:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:53 smithi155 ceph-mon[103467]: pgmap v279: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:26:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:53 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2015013591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:26:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:53 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1150811238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:26:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:53 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2684392593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:54.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.260+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b70196d10 con 0x7f3b70100640 2023-10-08T13:26:54.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.260+0000 7f3b6d7fa700 1 -- 172.21.15.139:0/2003965773 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f3b5809acf0 con 0x7f3b70100640 2023-10-08T13:26:54.262 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:26:54.262 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 msgr2=0x7f3b5c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 0x7f3b5c0a3a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b70072bb0 tx=0x7f3b6000a380 comp rx=0 tx=0).stop 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 msgr2=0x7f3b7019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3b58006010 tx=0x7f3b58004730 comp rx=0 tx=0).stop 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 shutdown_connections 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b5c0a1560 0x7f3b5c0a3a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b70105690 0x7f3b70195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b700ffc80 0x7f3b7019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 --2- 172.21.15.139:0/2003965773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b70100640 0x7f3b7019bc60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 >> 172.21.15.139:0/2003965773 conn(0x7f3b70075a90 msgr2=0x7f3b700fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 shutdown_connections 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.263+0000 7f3b76649700 1 -- 172.21.15.139:0/2003965773 wait complete. 2023-10-08T13:26:54.265 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:26:54.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T13:25:33.853946+0000', 'modified': '2023-10-08T13:26:04.411259+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24628, 'mds_1': 24607, 'mds_2': 24599, 'mds_3': 24595, 'mds_4': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14772': {'gid': 14772, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6837/2085954073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2085954073}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2085954073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14826': {'gid': 14826, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6839/4169446012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 4169446012}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 4169446012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14838': {'gid': 14838, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6841/3823660758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6840', 'nonce': 3823660758}, {'type': 'v1', 'addr': '172.21.15.139:6841', 'nonce': 3823660758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24518': {'gid': 24518, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6833/3719268095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 3719268095}, {'type': 'v1', 'addr': '172.21.15.155:6833', 'nonce': 3719268095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24542': {'gid': 24542, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/4262434274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 4262434274}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 4262434274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.155:6837/4218841185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 4218841185}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 4218841185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24595': {'gid': 24595, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.187:6835/3167078820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 3167078820}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 3167078820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.155:6839/4212065890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 4212065890}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 4212065890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24607': {'gid': 24607, 'name': 'c', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.187:6837/3566030950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 3566030950}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 3566030950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.187:6839/3909111900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 3909111900}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 3909111900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T13:26:54.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T13:26:54.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T13:26:54.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 -- 172.21.15.139:0/1865640719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad4100730 msgr2=0x7f4ad410c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 --2- 172.21.15.139:0/1865640719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad4100730 0x7f4ad410c720 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00b0a0 tx=0x7f4acc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 -- 172.21.15.139:0/1865640719 shutdown_connections 2023-10-08T13:26:54.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 --2- 172.21.15.139:0/1865640719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad4100730 0x7f4ad410c720 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 --2- 172.21.15.139:0/1865640719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 0x7f4ad4105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 --2- 172.21.15.139:0/1865640719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad40ffd70 0x7f4ad41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 -- 172.21.15.139:0/1865640719 >> 172.21.15.139:0/1865640719 conn(0x7f4ad4075c20 msgr2=0x7f4ad40fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 -- 172.21.15.139:0/1865640719 shutdown_connections 2023-10-08T13:26:54.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.398+0000 7f4adc390700 1 -- 172.21.15.139:0/1865640719 wait complete. 2023-10-08T13:26:54.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 Processor -- start 2023-10-08T13:26:54.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 -- start start 2023-10-08T13:26:54.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad4100730 0x7f4ad419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 0x7f4ad4195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad41960e0 con 0x7f4ad40ffd70 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4196250 con 0x7f4ad4105860 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4adc390700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4196410 con 0x7f4ad4100730 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39346/0 (socket says 172.21.15.139:39346) 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 -- 172.21.15.139:0/2063406084 learned_addr learned my addr 172.21.15.139:0/2063406084 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad4100730 0x7f4ad419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 -- 172.21.15.139:0/2063406084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad4100730 msgr2=0x7f4ad419be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada92d700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 0x7f4ad4195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad4100730 0x7f4ad419be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 -- 172.21.15.139:0/2063406084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 msgr2=0x7f4ad4195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 0x7f4ad4195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.399+0000 7f4ada12c700 1 -- 172.21.15.139:0/2063406084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009d00 con 0x7f4ad40ffd70 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d950 tx=0x7f4ac400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4acb7fe700 1 -- 172.21.15.139:0/2063406084 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4009b40 con 0x7f4ad40ffd70 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4acb7fe700 1 -- 172.21.15.139:0/2063406084 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac4009ca0 con 0x7f4ad40ffd70 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad41966f0 con 0x7f4ad40ffd70 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4acb7fe700 1 -- 172.21.15.139:0/2063406084 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400f620 con 0x7f4ad40ffd70 2023-10-08T13:26:54.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.400+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40fee40 con 0x7f4ad40ffd70 2023-10-08T13:26:54.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.402+0000 7f4acb7fe700 1 -- 172.21.15.139:0/2063406084 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f4ac4010460 con 0x7f4ad40ffd70 2023-10-08T13:26:54.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.402+0000 7f4acb7fe700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 0x7f4ac00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.403+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 0x7f4ac00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.403+0000 7f4acb7fe700 1 -- 172.21.15.139:0/2063406084 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4ac40cd650 con 0x7f4ad40ffd70 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.403+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 0x7f4ac00a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005950 tx=0x7f4ad00058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.403+0000 7f4ae8579b80 1 Processor -- start 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 -- start start 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652723750 0x55c65272e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c6527309f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c65268c410 con 0x55c652722e30 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c65267dbd0 con 0x55c65272e600 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c65267b4f0 con 0x55c652723750 2023-10-08T13:26:54.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39354/0 (socket says 172.21.15.139:39354) 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 -- 172.21.15.139:0/446339891 learned_addr learned my addr 172.21.15.139:0/446339891 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ad992b700 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652723750 0x55c65272e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada92d700 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c6527309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 -- 172.21.15.139:0/446339891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652723750 msgr2=0x55c65272e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652723750 0x55c65272e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 -- 172.21.15.139:0/446339891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 msgr2=0x55c6527309f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c6527309f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 -- 172.21.15.139:0/446339891 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6524a1d90 con 0x55c652722e30 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.404+0000 7f4ada12c700 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40a2220 tx=0x7f4ac4096830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53b5c092343ec47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ac8d82700 1 -- 172.21.15.139:0/446339891 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac409a3c0 con 0x55c652722e30 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ac8d82700 1 -- 172.21.15.139:0/446339891 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac409e510 con 0x55c652722e30 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ac8d82700 1 -- 172.21.15.139:0/446339891 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac409e340 con 0x55c652722e30 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 -- 172.21.15.139:0/446339891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 msgr2=0x55c652723210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40a2220 tx=0x7f4ac4096830 comp rx=0 tx=0).stop 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 -- 172.21.15.139:0/446339891 shutdown_connections 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c6527309f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652722e30 0x55c652723210 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/446339891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652723750 0x55c65272e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 -- 172.21.15.139:0/446339891 >> 172.21.15.139:0/446339891 conn(0x55c652698210 msgr2=0x55c65271f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 -- 172.21.15.139:0/446339891 shutdown_connections 2023-10-08T13:26:54.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.405+0000 7f4ae8579b80 1 -- 172.21.15.139:0/446339891 wait complete. 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 -- start start 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 Processor -- start 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65272df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c652723750 0x55c65272b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652676de0 con 0x55c65272e600 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6526136c0 con 0x55c652723750 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652613360 con 0x55c652722e30 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ae8579b80 10 client.0 _ll_register_callbacks cb 0x55c6524707b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39364/0 (socket says 172.21.15.139:39364) 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 -- 172.21.15.139:0/3417715489 learned_addr learned my addr 172.21.15.139:0/3417715489 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ad992b700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c652723750 0x55c65272b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada12c700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65272df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 -- 172.21.15.139:0/3417715489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 msgr2=0x55c65272df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65272df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 -- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c652723750 msgr2=0x55c65272b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c652723750 0x55c65272b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.406+0000 7f4ada92d700 1 -- 172.21.15.139:0/3417715489 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40fee40 con 0x55c65272e600 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ada92d700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4acc015000 tx=0x7f4acc0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e25ba26a901 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00e040 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4acc0076e0 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c65263ee60 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4acc009b80 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 10 client.15423 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c65248ac10 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c65263ee60 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4acc019050 con 0x55c65272e600 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 10 client.15423 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 10 client.15423 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:26:54.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 20 client.15423 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c65273e120 0x55c65273cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 4 client.15423 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.407+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c65266fdc0 con 0x55c65273e120 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.408+0000 7f4ada12c700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c65273e120 0x55c65273cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.408+0000 7f4abdffb700 10 client.15423 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.408+0000 7f4ada12c700 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c65273e120 0x55c65273cb60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b3ed17e055c6605 server_cookie=4bdb83c041e0a9e8 in_seq=0 out_seq=0 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4abdffb700 1 -- 172.21.15.139:0/3417715489 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c65266fdc0 con 0x55c65273e120 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4abdffb700 10 client.15423 handle_command_reply: tid=0 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 client.15423 shutdown 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 msgr2=0x55c65272b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4acc015000 tx=0x7f4acc0095d0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 shutdown_connections 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c65272e600 0x55c65272b890 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65272df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c65273e120 0x55c65273cb60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/3417715489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c652723750 0x55c65272b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4abdffb700 0 client.15423 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 >> 172.21.15.139:0/3417715489 conn(0x55c652698210 msgr2=0x55c65271ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 shutdown_connections 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 1 -- 172.21.15.139:0/3417715489 wait complete. 2023-10-08T13:26:54.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.409+0000 7f4ae8579b80 20 client.15423 trim_cache size 0 max 16384 2023-10-08T13:26:54.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 Processor -- start 2023-10-08T13:26:54.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 -- start start 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65273a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c65271f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6524f78d0 con 0x55c652723750 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c65271fe80 con 0x55c65272e600 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652724080 con 0x55c652722e30 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ad992b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ad992b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39370/0 (socket says 172.21.15.139:39370) 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.426+0000 7f4ad992b700 1 -- 172.21.15.139:0/364077243 learned_addr learned my addr 172.21.15.139:0/364077243 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ada12c700 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65273a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 -- 172.21.15.139:0/364077243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 msgr2=0x55c65273a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ada92d700 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c65271f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65273a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 -- 172.21.15.139:0/364077243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 msgr2=0x55c65271f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c65271f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 -- 172.21.15.139:0/364077243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6524c8200 con 0x55c652723750 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ad992b700 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000fd00 tx=0x7f4ad0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4290905937d3214 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ac9583700 1 -- 172.21.15.139:0/364077243 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0020c10 con 0x55c652723750 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ac9583700 1 -- 172.21.15.139:0/364077243 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ad0020d70 con 0x55c652723750 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.427+0000 7f4ac9583700 1 -- 172.21.15.139:0/364077243 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0028710 con 0x55c652723750 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- 172.21.15.139:0/364077243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 msgr2=0x55c65271ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000fd00 tx=0x7f4ad0012000 comp rx=0 tx=0).stop 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- 172.21.15.139:0/364077243 shutdown_connections 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c65271f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c65273a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/364077243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c65271ed20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- 172.21.15.139:0/364077243 >> 172.21.15.139:0/364077243 conn(0x55c652698210 msgr2=0x55c6527265c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- 172.21.15.139:0/364077243 shutdown_connections 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- 172.21.15.139:0/364077243 wait complete. 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- start start 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 Processor -- start 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c652727af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c652728570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652747010 con 0x55c652723750 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652791b10 con 0x55c65272e600 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c652791c80 con 0x55c652722e30 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ae8579b80 10 client.0 _ll_register_callbacks cb 0x7f4acc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ad992b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ad992b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39376/0 (socket says 172.21.15.139:39376) 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ad992b700 1 -- 172.21.15.139:0/2029031005 learned_addr learned my addr 172.21.15.139:0/2029031005 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c652727af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.428+0000 7f4ada92d700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c652728570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 -- 172.21.15.139:0/2029031005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 msgr2=0x55c652727af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c652727af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 -- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 msgr2=0x55c652728570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c652728570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 -- 172.21.15.139:0/2029031005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad000f9e0 con 0x55c652723750 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ad992b700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0011e70 tx=0x7f4ad0020c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96cc63b82e52f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0011640 con 0x55c652723750 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f4ad00117a0 con 0x55c652723750 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ac409e510 con 0x55c652723750 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad0011c90 con 0x55c652723750 2023-10-08T13:26:54.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ae8579b80 10 client.15429 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c6524a0260 con 0x55c652723750 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ac409e510 con 0x55c652723750 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.429+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ad0004aa0 con 0x55c652723750 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 10 client.15429 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 10 client.15429 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 20 client.15429 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c652796f00 0x55c6527933c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 4 client.15429 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c65266fae0 con 0x55c652796f00 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c652796f00 0x55c6527933c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4abdffb700 10 client.15429 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ada12c700 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c652796f00 0x55c6527933c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b558c341d795fe49 server_cookie=66a85d14d44e16f8 in_seq=0 out_seq=0 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4abdffb700 1 -- 172.21.15.139:0/2029031005 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55c65266fae0 con 0x55c652796f00 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4abdffb700 10 client.15429 handle_command_reply: tid=0 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.430+0000 7f4ae8579b80 1 client.15429 shutdown 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 msgr2=0x55c652728030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0011e70 tx=0x7f4ad0020c20 comp rx=0 tx=0).stop 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 shutdown_connections 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55c652796f00 0x55c6527933c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c65272e600 0x55c652728570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c652722e30 0x55c652727af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 --2- 172.21.15.139:0/2029031005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c652723750 0x55c652728030 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4abdffb700 0 client.15429 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 >> 172.21.15.139:0/2029031005 conn(0x55c652698210 msgr2=0x55c65271ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 shutdown_connections 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 1 -- 172.21.15.139:0/2029031005 wait complete. 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4ae8579b80 20 client.15429 trim_cache size 0 max 16384 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:26:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 4, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24566, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 51.024039453, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 89, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 95.101893544000006 2023-10-08T13:26:54.441 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 msgr2=0x7f4ac00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 0x7f4ac00a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005950 tx=0x7f4ad00058e0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 msgr2=0x7f4ad419b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400d950 tx=0x7f4ac400dd10 comp rx=0 tx=0).stop 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 shutdown_connections 2023-10-08T13:26:54.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4ac00a1560 0x7f4ac00a3a20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad4105860 0x7f4ad4195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ad40ffd70 0x7f4ad419b950 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 --2- 172.21.15.139:0/2063406084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad4100730 0x7f4ad419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 >> 172.21.15.139:0/2063406084 conn(0x7f4ad4075c20 msgr2=0x7f4ad4102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 shutdown_connections 2023-10-08T13:26:54.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.431+0000 7f4adc390700 1 -- 172.21.15.139:0/2063406084 wait complete. 2023-10-08T13:26:54.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.567+0000 7f5ad5d39700 1 -- 172.21.15.139:0/1871292750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 msgr2=0x7f5ad00ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/1871292750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad00ffac0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009990 tx=0x7f5ac4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 -- 172.21.15.139:0/1871292750 shutdown_connections 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/1871292750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 0x7f5ad010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/1871292750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 0x7f5ad0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/1871292750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad00ffac0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 -- 172.21.15.139:0/1871292750 >> 172.21.15.139:0/1871292750 conn(0x7f5ad0076790 msgr2=0x7f5ad0076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 -- 172.21.15.139:0/1871292750 shutdown_connections 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 -- 172.21.15.139:0/1871292750 wait complete. 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 Processor -- start 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.568+0000 7f5ad5d39700 1 -- start start 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 0x7f5ad0197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 0x7f5ad0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad01a2d50 con 0x7f5ad00ff640 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad01a2ec0 con 0x7f5ad0105630 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad01a3080 con 0x7f5ad0100000 2023-10-08T13:26:54.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39388/0 (socket says 172.21.15.139:39388) 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 -- 172.21.15.139:0/4189525710 learned_addr learned my addr 172.21.15.139:0/4189525710 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acffff700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 0x7f5ad0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5aceffd700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 0x7f5ad0197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 -- 172.21.15.139:0/4189525710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 msgr2=0x7f5ad0197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 0x7f5ad0197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 -- 172.21.15.139:0/4189525710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 msgr2=0x7f5ad0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 0x7f5ad0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 -- 172.21.15.139:0/4189525710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40095f0 con 0x7f5ad00ff640 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000d950 tx=0x7f5ac000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5accff9700 1 -- 172.21.15.139:0/4189525710 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0009940 con 0x7f5ad00ff640 2023-10-08T13:26:54.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad01a3360 con 0x7f5ad00ff640 2023-10-08T13:26:54.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5accff9700 1 -- 172.21.15.139:0/4189525710 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac0010460 con 0x7f5ad00ff640 2023-10-08T13:26:54.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5accff9700 1 -- 172.21.15.139:0/4189525710 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000f620 con 0x7f5ad00ff640 2023-10-08T13:26:54.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.569+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0195830 con 0x7f5ad00ff640 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.572+0000 7f5accff9700 1 -- 172.21.15.139:0/4189525710 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f5ac00108d0 con 0x7f5ad00ff640 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.572+0000 7f5accff9700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 0x7f5ab80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5aceffd700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 0x7f5ab80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5accff9700 1 -- 172.21.15.139:0/4189525710 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ac00cd140 con 0x7f5ad00ff640 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5aceffd700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 0x7f5ab80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b2e0 tx=0x7f5ac4005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 Processor -- start 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 -- start start 2023-10-08T13:26:54.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af998e30 0x5574af999210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af902410 con 0x5574af9a4600 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8f3bd0 con 0x5574af998e30 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.573+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8f14f0 con 0x5574af999750 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39400/0 (socket says 172.21.15.139:39400) 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 -- 172.21.15.139:0/860159139 learned_addr learned my addr 172.21.15.139:0/860159139 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.582 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af998e30 0x5574af999210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5aceffd700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 -- 172.21.15.139:0/860159139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 msgr2=0x5574af9a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 -- 172.21.15.139:0/860159139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af998e30 msgr2=0x5574af999210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af998e30 0x5574af999210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 -- 172.21.15.139:0/860159139 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574af717d90 con 0x5574af9a4600 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5aceffd700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5acffff700 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011600 tx=0x7f5ac8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f712e85c19d189 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5ab5ffb700 1 -- 172.21.15.139:0/860159139 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800e040 con 0x5574af9a4600 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5ab5ffb700 1 -- 172.21.15.139:0/860159139 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac800f040 con 0x5574af9a4600 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.574+0000 7f5ab5ffb700 1 -- 172.21.15.139:0/860159139 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80047d0 con 0x5574af9a4600 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/860159139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 msgr2=0x5574af9a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011600 tx=0x7f5ac8009920 comp rx=0 tx=0).stop 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/860159139 shutdown_connections 2023-10-08T13:26:54.584 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a69f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af998e30 0x5574af999210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/860159139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/860159139 >> 172.21.15.139:0/860159139 conn(0x5574af90e210 msgr2=0x5574af995280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/860159139 shutdown_connections 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/860159139 wait complete. 2023-10-08T13:26:54.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.575+0000 7f5ae1f22b80 1 -- start start 2023-10-08T13:26:54.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 Processor -- start 2023-10-08T13:26:54.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af9a4600 0x5574af9a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8ecde0 con 0x5574af998e30 2023-10-08T13:26:54.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8896c0 con 0x5574af9a4600 2023-10-08T13:26:54.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af889360 con 0x5574af999750 2023-10-08T13:26:54.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 10 client.0 _ll_register_callbacks cb 0x5574af6e67b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39402/0 (socket says 172.21.15.139:39402) 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2637864769 learned_addr learned my addr 172.21.15.139:0/2637864769 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acffff700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af9a4600 0x5574af9a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 msgr2=0x5574af9a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2637864769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af9a4600 msgr2=0x5574af9a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af9a4600 0x5574af9a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2637864769 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac80112b0 con 0x5574af998e30 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009520 tx=0x7f5ac0099eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fd689e3dc9b080 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5aaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac009a110 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ac009a270 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.576+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574af8b4e60 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac00b8170 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 10 client.15441 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5574af700c10 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac0063080 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ac0094ac0 con 0x5574af998e30 2023-10-08T13:26:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 10 client.15441 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:26:54.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 20 client.15441 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574af9b4120 0x5574af9b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 4 client.15441 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574af8e5dc0 con 0x5574af9b4120 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.577+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574af9b4120 0x5574af9b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.578+0000 7f5aaeffd700 10 client.15441 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.578+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574af9b4120 0x5574af9b2c00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc7aea1be157105 server_cookie=32a90768a3a754f8 in_seq=0 out_seq=0 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.578+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2637864769 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5574af8e5dc0 con 0x5574af9b4120 2023-10-08T13:26:54.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.578+0000 7f5aaeffd700 10 client.15441 handle_command_reply: tid=0 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.578+0000 7f5ae1f22b80 1 client.15441 shutdown 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 msgr2=0x5574af9a4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009520 tx=0x7f5ac0099eb0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 shutdown_connections 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574af9b4120 0x5574af9b2c00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af9a4600 0x5574af9a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5aaeffd700 0 client.15441 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af9a4070 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2637864769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af999750 0x5574af9a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 >> 172.21.15.139:0/2637864769 conn(0x5574af90e210 msgr2=0x5574af994e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 shutdown_connections 2023-10-08T13:26:54.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2637864769 wait complete. 2023-10-08T13:26:54.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.579+0000 7f5ae1f22b80 20 client.15441 trim_cache size 0 max 16384 2023-10-08T13:26:54.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.596+0000 7f5ae1f22b80 1 Processor -- start 2023-10-08T13:26:54.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.596+0000 7f5ae1f22b80 1 -- start start 2023-10-08T13:26:54.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af998e30 0x5574af995430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af9b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af76d8d0 con 0x5574af9a4600 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8ee070 con 0x5574af999750 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574af8e8ed0 con 0x5574af998e30 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39414/0 (socket says 172.21.15.139:39414) 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 -- 172.21.15.139:0/377873922 learned_addr learned my addr 172.21.15.139:0/377873922 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5aceffd700 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af9b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af998e30 0x5574af995430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 -- 172.21.15.139:0/377873922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af998e30 msgr2=0x5574af995430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af998e30 0x5574af995430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 -- 172.21.15.139:0/377873922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 msgr2=0x5574af9b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af9b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 -- 172.21.15.139:0/377873922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574af73e200 con 0x5574af9a4600 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5acffff700 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011600 tx=0x7f5ac8009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997ba119212f06da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ab67fc700 1 -- 172.21.15.139:0/377873922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800e050 con 0x5574af9a4600 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ab67fc700 1 -- 172.21.15.139:0/377873922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac8005a20 con 0x5574af9a4600 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.597+0000 7f5ab67fc700 1 -- 172.21.15.139:0/377873922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007760 con 0x5574af9a4600 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/377873922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 msgr2=0x5574af9a3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8011600 tx=0x7f5ac8009450 comp rx=0 tx=0).stop 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/377873922 shutdown_connections 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af9a4600 0x5574af9a3ba0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af998e30 0x5574af995430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/377873922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af9b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/377873922 >> 172.21.15.139:0/377873922 conn(0x5574af90e210 msgr2=0x5574af994d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/377873922 shutdown_connections 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/377873922 wait complete. 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.598+0000 7f5ae1f22b80 1 -- start start 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 Processor -- start 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af99e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af9a4600 0x5574af99e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afa07b10 con 0x5574af998e30 2023-10-08T13:26:54.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afa07c50 con 0x5574af999750 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574afa07e10 con 0x5574af9a4600 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5ae1f22b80 10 client.0 _ll_register_callbacks cb 0x7f5ac0099810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39416/0 (socket says 172.21.15.139:39416) 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2203012505 learned_addr learned my addr 172.21.15.139:0/2203012505 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acffff700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af9a4600 0x5574af99e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af99e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af9a4600 msgr2=0x5574af99e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af9a4600 0x5574af99e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2203012505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 msgr2=0x5574af99e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af99e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 -- 172.21.15.139:0/2203012505 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574af717d90 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af99e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5acf7fe700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0010fd0 tx=0x7f5ac0099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d63b0d76251c15e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.599+0000 7f5aaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0014040 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f5ac00b8170 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ac800f040 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac00a1fc0 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 10 client.15447 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5574af716260 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac800f040 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ac009a210 con 0x5574af998e30 2023-10-08T13:26:54.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 10 client.15447 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 10 client.15447 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 20 client.15447 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574afa0cdb0 0x5574afa091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 4 client.15447 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574af8e5ae0 con 0x5574afa0cdb0 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.600+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574afa0cdb0 0x5574afa091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5aaeffd700 10 client.15447 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5aceffd700 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574afa0cdb0 0x5574afa091d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fea6b212e95309d6 server_cookie=44f4220c5bff48cb in_seq=0 out_seq=0 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5aaeffd700 1 -- 172.21.15.139:0/2203012505 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5574af8e5ae0 con 0x5574afa0cdb0 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5aaeffd700 10 client.15447 handle_command_reply: tid=0 2023-10-08T13:26:54.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 client.15447 shutdown 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 msgr2=0x5574af99dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0010fd0 tx=0x7f5ac0099db0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 shutdown_connections 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5574afa0cdb0 0x5574afa091d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5574af9a4600 0x5574af99e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5aaeffd700 0 client.15447 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5574af998e30 0x5574af99dd70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 --2- 172.21.15.139:0/2203012505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574af999750 0x5574af99e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 >> 172.21.15.139:0/2203012505 conn(0x5574af90e210 msgr2=0x5574af9b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 shutdown_connections 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 1 -- 172.21.15.139:0/2203012505 wait complete. 2023-10-08T13:26:54.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.601+0000 7f5ae1f22b80 20 client.15447 trim_cache size 0 max 16384 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 3, 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24595, 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:26:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 52.201124958000001, 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 89, 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 99.683266846999999 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:26:54.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 msgr2=0x7f5ab80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 0x7f5ab80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b2e0 tx=0x7f5ac4005fd0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 msgr2=0x7f5ad0197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000d950 tx=0x7f5ac000dc60 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 shutdown_connections 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5ab80a1560 0x7f5ab80a3a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad0105630 0x7f5ad0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ad00ff640 0x7f5ad0197a40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 --2- 172.21.15.139:0/4189525710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad0100000 0x7f5ad0197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 >> 172.21.15.139:0/4189525710 conn(0x7f5ad0076790 msgr2=0x7f5ad00fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 shutdown_connections 2023-10-08T13:26:54.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.602+0000 7f5ad5d39700 1 -- 172.21.15.139:0/4189525710 wait complete. 2023-10-08T13:26:54.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T13:26:54.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 -- 172.21.15.139:0/3701039681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 msgr2=0x7f6700108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 --2- 172.21.15.139:0/3701039681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f6700108db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009990 tx=0x7f66f4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 -- 172.21.15.139:0/3701039681 shutdown_connections 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 --2- 172.21.15.139:0/3701039681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 0x7f670010f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 --2- 172.21.15.139:0/3701039681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f6700108db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 --2- 172.21.15.139:0/3701039681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 0x7f6700102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 -- 172.21.15.139:0/3701039681 >> 172.21.15.139:0/3701039681 conn(0x7f67000fe4b0 msgr2=0x7f67001008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 -- 172.21.15.139:0/3701039681 shutdown_connections 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 -- 172.21.15.139:0/3701039681 wait complete. 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.739+0000 7f6705719700 1 Processor -- start 2023-10-08T13:26:54.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 -- start start 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 0x7f6700198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 0x7f6700199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019dcf0 con 0x7f67001089d0 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019de60 con 0x7f6700103380 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f6705719700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670019e020 con 0x7f67001029c0 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39434/0 (socket says 172.21.15.139:39434) 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2902951282 learned_addr learned my addr 172.21.15.139:0/2902951282 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66feffd700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 0x7f6700198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 0x7f6700199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2902951282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 msgr2=0x7f6700198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 0x7f6700198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2902951282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 msgr2=0x7f6700199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 0x7f6700199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2902951282 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f40095f0 con 0x7f67001089d0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66f8007ee0 tx=0x7f66f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.740+0000 7f66e7fff700 1 -- 172.21.15.139:0/2902951282 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8017070 con 0x7f67001089d0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.741+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670019e300 con 0x7f67001089d0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.741+0000 7f66e7fff700 1 -- 172.21.15.139:0/2902951282 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f800f040 con 0x7f67001089d0 2023-10-08T13:26:54.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.741+0000 7f66e7fff700 1 -- 172.21.15.139:0/2902951282 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8005740 con 0x7f67001089d0 2023-10-08T13:26:54.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.741+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67001a5b40 con 0x7f67001089d0 2023-10-08T13:26:54.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.743+0000 7f66e7fff700 1 -- 172.21.15.139:0/2902951282 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f66f800dc60 con 0x7f67001089d0 2023-10-08T13:26:54.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.743+0000 7f66e7fff700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 0x7f66e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.743+0000 7f66feffd700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 0x7f66e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.743+0000 7f66e7fff700 1 -- 172.21.15.139:0/2902951282 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f66f80ccac0 con 0x7f67001089d0 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f66feffd700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 0x7f66e80a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005850 tx=0x7f66f401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 Processor -- start 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 -- start start 2023-10-08T13:26:54.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x56507261f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507262a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072588410 con 0x56507262a600 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072579bd0 con 0x56507261f750 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f6711902b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650725774f0 con 0x56507261ee30 2023-10-08T13:26:54.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39442/0 (socket says 172.21.15.139:39442) 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.744+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2688701965 learned_addr learned my addr 172.21.15.139:0/2688701965 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507262a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66feffd700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x56507261f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2688701965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 msgr2=0x56507261f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x56507261f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2688701965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 msgr2=0x56507262a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507262a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2688701965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56507239dd90 con 0x56507262a600 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507262a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f66f8095d90 tx=0x7f66f800df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403acac8a6c47ff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66e57fa700 1 -- 172.21.15.139:0/2688701965 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a1c20 con 0x56507262a600 2023-10-08T13:26:54.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66e57fa700 1 -- 172.21.15.139:0/2688701965 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f80ca2d0 con 0x56507262a600 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.745+0000 7f66e57fa700 1 -- 172.21.15.139:0/2688701965 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80840c0 con 0x56507262a600 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- 172.21.15.139:0/2688701965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 msgr2=0x56507262c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f66f8095d90 tx=0x7f66f800df60 comp rx=0 tx=0).stop 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- 172.21.15.139:0/2688701965 shutdown_connections 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507262c9f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x56507261f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- 172.21.15.139:0/2688701965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507262a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- 172.21.15.139:0/2688701965 >> 172.21.15.139:0/2688701965 conn(0x565072594210 msgr2=0x56507261b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- 172.21.15.139:0/2688701965 shutdown_connections 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- 172.21.15.139:0/2688701965 wait complete. 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- start start 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 Processor -- start 2023-10-08T13:26:54.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x5650726273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 0x565072627e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072572de0 con 0x56507261f750 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507250f6c0 con 0x56507262a600 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507250f360 con 0x56507261ee30 2023-10-08T13:26:54.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.746+0000 7f6711902b80 10 client.0 _ll_register_callbacks cb 0x56507236c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39446/0 (socket says 172.21.15.139:39446) 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 -- 172.21.15.139:0/2611692559 learned_addr learned my addr 172.21.15.139:0/2611692559 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66feffd700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x5650726273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 0x565072627e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 -- 172.21.15.139:0/2611692559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 msgr2=0x5650726273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x5650726273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 -- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 msgr2=0x565072627e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 0x565072627e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 -- 172.21.15.139:0/2611692559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f8082e70 con 0x56507261f750 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 0x565072627e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:26:54.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fc0 tx=0x7f66f0012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf6a5d6b62e85f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0004520 con 0x56507261f750 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f66f0003680 con 0x56507261f750 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56507253ae60 con 0x56507261f750 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f0003840 con 0x56507261f750 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f6711902b80 10 client.15459 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565072386c10 con 0x56507261f750 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.747+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56507253ae60 con 0x56507261f750 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66f001bb20 con 0x56507261f750 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 20 client.15459 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56507263a280 0x565072638d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 4 client.15459 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56507256bdc0 con 0x56507263a280 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f66feffd700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56507263a280 0x565072638d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f66e2ff5700 10 client.15459 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.748+0000 7f66feffd700 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56507263a280 0x565072638d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b4b30457d713ae4 server_cookie=b81197b535ba84f7 in_seq=0 out_seq=0 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f66e2ff5700 1 -- 172.21.15.139:0/2611692559 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56507256bdc0 con 0x56507263a280 2023-10-08T13:26:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f66e2ff5700 10 client.15459 handle_command_reply: tid=0 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 client.15459 shutdown 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 msgr2=0x565072627900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007fc0 tx=0x7f66f0012730 comp rx=0 tx=0).stop 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 shutdown_connections 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56507263a280 0x565072638d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507262a600 0x565072627e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x5650726273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f66e2ff5700 0 client.15459 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 --2- 172.21.15.139:0/2611692559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261f750 0x565072627900 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 >> 172.21.15.139:0/2611692559 conn(0x565072594210 msgr2=0x56507261ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 shutdown_connections 2023-10-08T13:26:54.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.749+0000 7f6711902b80 1 -- 172.21.15.139:0/2611692559 wait complete. 2023-10-08T13:26:54.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.750+0000 7f6711902b80 20 client.15459 trim_cache size 0 max 16384 2023-10-08T13:26:54.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 Processor -- start 2023-10-08T13:26:54.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 -- start start 2023-10-08T13:26:54.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x565072629c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507261ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650723f38d0 con 0x56507262a600 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507261ab90 con 0x56507261f750 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f6711902b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56507256bdc0 con 0x56507261ee30 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39456/0 (socket says 172.21.15.139:39456) 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2685964872 learned_addr learned my addr 172.21.15.139:0/2685964872 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507261ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66feffd700 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x565072629c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2685964872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 msgr2=0x565072629c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x565072629c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2685964872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 msgr2=0x56507261ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507261ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.767+0000 7f66ff7fe700 1 -- 172.21.15.139:0/2685964872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650723c4200 con 0x56507262a600 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f66ff7fe700 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009510 tx=0x7f66f8099790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253541dc821988b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f66e5ffb700 1 -- 172.21.15.139:0/2685964872 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f80a1c20 con 0x56507262a600 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f66e5ffb700 1 -- 172.21.15.139:0/2685964872 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f80b90d0 con 0x56507262a600 2023-10-08T13:26:54.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f66e5ffb700 1 -- 172.21.15.139:0/2685964872 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8099d50 con 0x56507262a600 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 -- 172.21.15.139:0/2685964872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 msgr2=0x56507261b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009510 tx=0x7f66f8099790 comp rx=0 tx=0).stop 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 -- 172.21.15.139:0/2685964872 shutdown_connections 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507262a600 0x56507261b260 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507261ee30 0x565072629c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 --2- 172.21.15.139:0/2685964872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x56507261ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 -- 172.21.15.139:0/2685964872 >> 172.21.15.139:0/2685964872 conn(0x565072594210 msgr2=0x56507261a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 -- 172.21.15.139:0/2685964872 shutdown_connections 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.768+0000 7f6711902b80 1 -- 172.21.15.139:0/2685964872 wait complete. 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 -- start start 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 Processor -- start 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x565072624ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507262a600 0x565072623650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072623c20 con 0x56507261ee30 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072623d90 con 0x56507261f750 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565072623f50 con 0x56507262a600 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f6711902b80 10 client.0 _ll_register_callbacks cb 0x7f66f0007980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39458/0 (socket says 172.21.15.139:39458) 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 -- 172.21.15.139:0/1912423 learned_addr learned my addr 172.21.15.139:0/1912423 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x565072624ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 -- 172.21.15.139:0/1912423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507262a600 msgr2=0x565072623650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507262a600 0x565072623650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 -- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 msgr2=0x565072624ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x565072624ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.769+0000 7f66feffd700 1 -- 172.21.15.139:0/1912423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56507239dd90 con 0x56507261ee30 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66feffd700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009990 tx=0x7f66f4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828af0c1555eac3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f401d040 con 0x56507261ee30 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f66f4005500 con 0x56507261ee30 2023-10-08T13:26:54.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66f80ca2d0 con 0x56507261ee30 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f40056c0 con 0x56507261ee30 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 10 client.15465 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56507239c260 con 0x56507261ee30 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f80ca2d0 con 0x56507261ee30 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66f4030030 con 0x56507261ee30 2023-10-08T13:26:54.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 10 client.15465 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 10 client.15465 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 20 client.15465 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5650726929b0 0x56507268ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 4 client.15465 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.770+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56507256bae0 con 0x5650726929b0 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5650726929b0 0x56507268ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66e2ff5700 10 client.15465 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66fe7fc700 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5650726929b0 0x56507268ed50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e63f26d95f260409 server_cookie=298a11bf28fe8c1e in_seq=0 out_seq=0 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66e2ff5700 1 -- 172.21.15.139:0/1912423 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56507256bae0 con 0x5650726929b0 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66e2ff5700 10 client.15465 handle_command_reply: tid=0 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 client.15465 shutdown 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 msgr2=0x565072624ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009990 tx=0x7f66f4009310 comp rx=0 tx=0).stop 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 shutdown_connections 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5650726929b0 0x56507268ed50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56507262a600 0x565072623650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56507261ee30 0x565072624ab0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f66e2ff5700 0 client.15465 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:26:54.785 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 --2- 172.21.15.139:0/1912423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56507261f750 0x565072624ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 >> 172.21.15.139:0/1912423 conn(0x565072594210 msgr2=0x56507261aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 shutdown_connections 2023-10-08T13:26:54.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 1 -- 172.21.15.139:0/1912423 wait complete. 2023-10-08T13:26:54.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.771+0000 7f6711902b80 20 client.15465 trim_cache size 0 max 16384 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 2, 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24599, 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:26:54.787 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 53.374364538999998, 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 89, 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 86.538271062999996 2023-10-08T13:26:54.788 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:26:54.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 msgr2=0x7f66e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 0x7f66e80a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005850 tx=0x7f66f401a040 comp rx=0 tx=0).stop 2023-10-08T13:26:54.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 msgr2=0x7f670019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66f8007ee0 tx=0x7f66f800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.790 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 shutdown_connections 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66e80a1560 0x7f66e80a3a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f67001089d0 0x7f670019d6b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67001029c0 0x7f6700198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 --2- 172.21.15.139:0/2902951282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6700103380 0x7f6700199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 >> 172.21.15.139:0/2902951282 conn(0x7f67000fe4b0 msgr2=0x7f67000fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 shutdown_connections 2023-10-08T13:26:54.792 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.772+0000 7f6705719700 1 -- 172.21.15.139:0/2902951282 wait complete. 2023-10-08T13:26:54.792 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 -- 172.21.15.139:0/865393107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540fffe0 msgr2=0x7fc05410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/865393107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540fffe0 0x7fc05410c4e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00b0a0 tx=0x7fc04c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 -- 172.21.15.139:0/865393107 shutdown_connections 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/865393107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540fffe0 0x7fc05410c4e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/865393107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0541056b0 0x7fc054105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/865393107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0540ff620 0x7fc0540ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.913+0000 7fc05ba4f700 1 -- 172.21.15.139:0/865393107 >> 172.21.15.139:0/865393107 conn(0x7fc054076780 msgr2=0x7fc054076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- 172.21.15.139:0/865393107 shutdown_connections 2023-10-08T13:26:54.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- 172.21.15.139:0/865393107 wait complete. 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 Processor -- start 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- start start 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0540fffe0 0x7fc054101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0541056b0 0x7fc054101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541a4ee0 con 0x7fc0540ff620 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541a5050 con 0x7fc0540fffe0 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc05ba4f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541a5210 con 0x7fc0541056b0 2023-10-08T13:26:54.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc0597eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc0597eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39472/0 (socket says 172.21.15.139:39472) 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.914+0000 7fc0597eb700 1 -- 172.21.15.139:0/2471450051 learned_addr learned my addr 172.21.15.139:0/2471450051 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc058fea700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0540fffe0 0x7fc054101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc059fec700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0541056b0 0x7fc054101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 -- 172.21.15.139:0/2471450051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0541056b0 msgr2=0x7fc054101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0541056b0 0x7fc054101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 -- 172.21.15.139:0/2471450051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0540fffe0 msgr2=0x7fc054101a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0540fffe0 0x7fc054101a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 -- 172.21.15.139:0/2471450051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009d00 con 0x7fc0540ff620 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0597eb700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e970 tx=0x7fc04800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0467fc700 1 -- 172.21.15.139:0/2471450051 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048009790 con 0x7fc0540ff620 2023-10-08T13:26:54.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0467fc700 1 -- 172.21.15.139:0/2471450051 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc04800c7e0 con 0x7fc0540ff620 2023-10-08T13:26:54.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0541a54f0 con 0x7fc0540ff620 2023-10-08T13:26:54.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc0467fc700 1 -- 172.21.15.139:0/2471450051 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048003c70 con 0x7fc0540ff620 2023-10-08T13:26:54.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.915+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0541a5a50 con 0x7fc0540ff620 2023-10-08T13:26:54.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.917+0000 7fc0467fc700 1 -- 172.21.15.139:0/2471450051 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc04800cc50 con 0x7fc0540ff620 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.918+0000 7fc0467fc700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 0x7fc0400a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.918+0000 7fc058fea700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 0x7fc0400a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.918+0000 7fc0467fc700 1 -- 172.21.15.139:0/2471450051 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc048014070 con 0x7fc0540ff620 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.918+0000 7fc058fea700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 0x7fc0400a3aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc054102c70 tx=0x7fc0500073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 Processor -- start 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 -- start start 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b60c410 con 0x56246b6ae600 2023-10-08T13:26:54.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5fdbd0 con 0x56246b6a2e30 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc067c38b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5fb4f0 con 0x56246b6a3750 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc059fec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc059fec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39484/0 (socket says 172.21.15.139:39484) 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc059fec700 1 -- 172.21.15.139:0/3535613511 learned_addr learned my addr 172.21.15.139:0/3535613511 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc0597eb700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc058fea700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc059fec700 1 -- 172.21.15.139:0/3535613511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 msgr2=0x56246b6ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.919+0000 7fc059fec700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc059fec700 1 -- 172.21.15.139:0/3535613511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 msgr2=0x56246b6a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc059fec700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc059fec700 1 -- 172.21.15.139:0/3535613511 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56246b421d90 con 0x56246b6ae600 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc058fea700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc059fec700 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009500 tx=0x7fc04c009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d4473a03cf9edc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc03f7fe700 1 -- 172.21.15.139:0/3535613511 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00e040 con 0x56246b6ae600 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc03f7fe700 1 -- 172.21.15.139:0/3535613511 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc04c009b80 con 0x56246b6ae600 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.920+0000 7fc03f7fe700 1 -- 172.21.15.139:0/3535613511 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c007880 con 0x56246b6ae600 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- 172.21.15.139:0/3535613511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 msgr2=0x56246b6b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009500 tx=0x7fc04c009530 comp rx=0 tx=0).stop 2023-10-08T13:26:54.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- 172.21.15.139:0/3535613511 shutdown_connections 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6b09f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3535613511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- 172.21.15.139:0/3535613511 >> 172.21.15.139:0/3535613511 conn(0x56246b618210 msgr2=0x56246b69f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- 172.21.15.139:0/3535613511 shutdown_connections 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- 172.21.15.139:0/3535613511 wait complete. 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 -- start start 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 Processor -- start 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.921+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5f6de0 con 0x56246b6ae600 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5936c0 con 0x56246b6a2e30 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b593360 con 0x56246b6a3750 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 10 client.0 _ll_register_callbacks cb 0x56246b3f07b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39490/0 (socket says 172.21.15.139:39490) 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 -- 172.21.15.139:0/1182130210 learned_addr learned my addr 172.21.15.139:0/1182130210 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc058fea700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc0597eb700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 -- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 msgr2=0x56246b6ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 -- 172.21.15.139:0/1182130210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 msgr2=0x56246b6adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 -- 172.21.15.139:0/1182130210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05410cde0 con 0x56246b6ae600 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc0597eb700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc059fec700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00bd60 tx=0x7fc04c00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a17e056c2d96cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc03cff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00e040 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc04c0076e0 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56246b5efdc0 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc04c0078c0 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 10 client.15477 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.922+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56246b40ac10 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56246b5efdc0 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc04c019030 con 0x56246b6ae600 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 10 client.15477 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 20 client.15477 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b6bdc10 0x56246b6bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 4 client.15477 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56246b5efae0 con 0x56246b6bdc10 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.923+0000 7fc0597eb700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b6bdc10 0x56246b6bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc03cff9700 10 client.15477 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc0597eb700 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b6bdc10 0x56246b6bc9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c25806f839064386 server_cookie=4c4c2526050683d8 in_seq=0 out_seq=0 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc03cff9700 1 -- 172.21.15.139:0/1182130210 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56246b5efae0 con 0x56246b6bdc10 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc03cff9700 10 client.15477 handle_command_reply: tid=0 2023-10-08T13:26:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc067c38b80 1 client.15477 shutdown 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 msgr2=0x56246b6ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.924+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00bd60 tx=0x7fc04c00be40 comp rx=0 tx=0).stop 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 shutdown_connections 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6ae600 0x56246b6ab820 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a2e30 0x56246b6adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b6bdc10 0x56246b6bc9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 --2- 172.21.15.139:0/1182130210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a3750 0x56246b6ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc03cff9700 0 client.15477 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 >> 172.21.15.139:0/1182130210 conn(0x56246b618210 msgr2=0x56246b69ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 shutdown_connections 2023-10-08T13:26:54.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 1 -- 172.21.15.139:0/1182130210 wait complete. 2023-10-08T13:26:54.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.925+0000 7fc067c38b80 20 client.15477 trim_cache size 0 max 16384 2023-10-08T13:26:54.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3428644537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:54.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:54 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2003965773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 Processor -- start 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 -- start start 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a3750 0x56246b6aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 0x56246b6c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b4778d0 con 0x56246b6a2e30 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5efae0 con 0x56246b6a3750 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc067c38b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b5efdc0 con 0x56246b6ae600 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.942+0000 7fc0597eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39494/0 (socket says 172.21.15.139:39494) 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 -- 172.21.15.139:0/3586083716 learned_addr learned my addr 172.21.15.139:0/3586083716 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc058fea700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a3750 0x56246b6aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc059fec700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 0x56246b6c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 -- 172.21.15.139:0/3586083716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 msgr2=0x56246b6c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 0x56246b6c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 -- 172.21.15.139:0/3586083716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a3750 msgr2=0x56246b6aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a3750 0x56246b6aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 -- 172.21.15.139:0/3586083716 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56246b448200 con 0x56246b6a2e30 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc059fec700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 0x56246b6c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc0597eb700 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0480ca980 tx=0x7fc04800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34917b23a5524b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc03ffff700 1 -- 172.21.15.139:0/3586083716 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04809a8c0 con 0x56246b6a2e30 2023-10-08T13:26:54.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc03ffff700 1 -- 172.21.15.139:0/3586083716 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc04809a160 con 0x56246b6a2e30 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.943+0000 7fc03ffff700 1 -- 172.21.15.139:0/3586083716 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0480caba0 con 0x56246b6a2e30 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- 172.21.15.139:0/3586083716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 msgr2=0x56246b6ba110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0480ca980 tx=0x7fc04800cf50 comp rx=0 tx=0).stop 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- 172.21.15.139:0/3586083716 shutdown_connections 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6ae600 0x56246b6c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a2e30 0x56246b6ba110 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 --2- 172.21.15.139:0/3586083716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6a3750 0x56246b6aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- 172.21.15.139:0/3586083716 >> 172.21.15.139:0/3586083716 conn(0x56246b618210 msgr2=0x56246b6a6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- 172.21.15.139:0/3586083716 shutdown_connections 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- 172.21.15.139:0/3586083716 wait complete. 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 -- start start 2023-10-08T13:26:54.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.944+0000 7fc067c38b80 1 Processor -- start 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a2e30 0x56246b6c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6ae600 0x56246b6c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b6c11a0 con 0x56246b6a3750 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b6c1310 con 0x56246b6ae600 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56246b6c1480 con 0x56246b6a2e30 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 10 client.0 _ll_register_callbacks cb 0x7fc048095e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39502/0 (socket says 172.21.15.139:39502) 2023-10-08T13:26:54.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 -- 172.21.15.139:0/515284683 learned_addr learned my addr 172.21.15.139:0/515284683 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc059fec700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6ae600 0x56246b6c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc0597eb700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a2e30 0x56246b6c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 -- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a2e30 msgr2=0x56246b6c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a2e30 0x56246b6c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 -- 172.21.15.139:0/515284683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6ae600 msgr2=0x56246b6c0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6ae600 0x56246b6c0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 -- 172.21.15.139:0/515284683 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0541a5a50 con 0x56246b6a3750 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc058fea700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc050007fd0 tx=0x7fc0500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50dcd25c62692 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc03cff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050026070 con 0x56246b6a3750 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc050017040 con 0x56246b6a3750 2023-10-08T13:26:54.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56246b5bee60 con 0x56246b6a3750 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc050004540 con 0x56246b6a3750 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 10 client.15483 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.945+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56246b420260 con 0x56246b6a3750 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56246b5bee60 con 0x56246b6a3750 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc050011af0 con 0x56246b6a3750 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 10 client.15483 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 10 client.15483 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 20 client.15483 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b716730 0x56246b712c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 4 client.15483 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56246b442f20 con 0x56246b716730 2023-10-08T13:26:54.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc0597eb700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b716730 0x56246b712c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc0597eb700 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b716730 0x56246b712c50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea7da6c214ab3cbe server_cookie=dec0f6a42200ee08 in_seq=0 out_seq=0 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.946+0000 7fc03cff9700 10 client.15483 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc03cff9700 1 -- 172.21.15.139:0/515284683 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56246b442f20 con 0x56246b716730 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc03cff9700 10 client.15483 handle_command_reply: tid=0 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 client.15483 shutdown 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 msgr2=0x56246b6c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc050007fd0 tx=0x7fc0500047c0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 shutdown_connections 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56246b6ae600 0x56246b6c0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x56246b716730 0x56246b712c50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56246b6a2e30 0x56246b6c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc03cff9700 0 client.15483 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 --2- 172.21.15.139:0/515284683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56246b6a3750 0x56246b6c0720 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 >> 172.21.15.139:0/515284683 conn(0x56246b618210 msgr2=0x56246b6acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 shutdown_connections 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 1 -- 172.21.15.139:0/515284683 wait complete. 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc067c38b80 20 client.15483 trim_cache size 0 max 16384 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:26:54.958 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 1, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24607, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 54.571432719000001, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 89, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 97.872175616999996 2023-10-08T13:26:54.959 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 msgr2=0x7fc0400a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 0x7fc0400a3aa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc054102c70 tx=0x7fc0500073d0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 msgr2=0x7fc054101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.947+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e970 tx=0x7fc04800ec80 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 shutdown_connections 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0400a15e0 0x7fc0400a3aa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0541056b0 0x7fc054101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc0540ff620 0x7fc054101540 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 --2- 172.21.15.139:0/2471450051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc0540fffe0 0x7fc054101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 >> 172.21.15.139:0/2471450051 conn(0x7fc054076780 msgr2=0x7fc054103820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:54.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 shutdown_connections 2023-10-08T13:26:54.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:54.948+0000 7fc05ba4f700 1 -- 172.21.15.139:0/2471450051 wait complete. 2023-10-08T13:26:54.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:26:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3428644537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:54.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:54 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2003965773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 -- 172.21.15.139:0/1030524938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 msgr2=0x7fdf7010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 --2- 172.21.15.139:0/1030524938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf7010d610 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b0a0 tx=0x7fdf6800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 -- 172.21.15.139:0/1030524938 shutdown_connections 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 --2- 172.21.15.139:0/1030524938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf7010d610 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 --2- 172.21.15.139:0/1030524938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70106750 0x7fdf70106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 --2- 172.21.15.139:0/1030524938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70100740 0x7fdf70100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 -- 172.21.15.139:0/1030524938 >> 172.21.15.139:0/1030524938 conn(0x7fdf700fc230 msgr2=0x7fdf700fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 -- 172.21.15.139:0/1030524938 shutdown_connections 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.083+0000 7fdf7754f700 1 -- 172.21.15.139:0/1030524938 wait complete. 2023-10-08T13:26:55.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 Processor -- start 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 -- start start 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70100740 0x7fdf70072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 0x7fdf70073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a4f70 con 0x7fdf70101100 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a50e0 con 0x7fdf70106750 2023-10-08T13:26:55.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf7754f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701a52a0 con 0x7fdf70100740 2023-10-08T13:26:55.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf74aea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 0x7fdf70073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf74aea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39516/0 (socket says 172.21.15.139:39516) 2023-10-08T13:26:55.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf74aea700 1 -- 172.21.15.139:0/2162642188 learned_addr learned my addr 172.21.15.139:0/2162642188 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:55.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf752eb700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70100740 0x7fdf70072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 -- 172.21.15.139:0/2162642188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70100740 msgr2=0x7fdf70072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70100740 0x7fdf70072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 -- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 msgr2=0x7fdf70073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf75aec700 1 -- 172.21.15.139:0/2162642188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68009d00 con 0x7fdf70106750 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.084+0000 7fdf74aea700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf75aec700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 0x7fdf70073590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b070 tx=0x7fdf68009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf667fc700 1 -- 172.21.15.139:0/2162642188 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800e040 con 0x7fdf70106750 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf701a5520 con 0x7fdf70106750 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf667fc700 1 -- 172.21.15.139:0/2162642188 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf68007990 con 0x7fdf70106750 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf667fc700 1 -- 172.21.15.139:0/2162642188 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68005040 con 0x7fdf70106750 2023-10-08T13:26:55.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.085+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701a59f0 con 0x7fdf70106750 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.087+0000 7fdf667fc700 1 -- 172.21.15.139:0/2162642188 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fdf6801d470 con 0x7fdf70106750 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.088+0000 7fdf667fc700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 0x7fdf5c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.088+0000 7fdf752eb700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 0x7fdf5c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.088+0000 7fdf667fc700 1 -- 172.21.15.139:0/2162642188 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdf680ce870 con 0x7fdf70106750 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.088+0000 7fdf752eb700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 0x7fdf5c0a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf60007b60 tx=0x7fdf600073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 Processor -- start 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 -- start start 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb76a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb76a600 0x564bdb76c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb6c8410 con 0x564bdb75ee30 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb6b9bd0 con 0x564bdb76a600 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf83738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb6b74f0 con 0x564bdb75f750 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39522/0 (socket says 172.21.15.139:39522) 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 -- 172.21.15.139:0/1228197302 learned_addr learned my addr 172.21.15.139:0/1228197302 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf74aea700 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb76a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf75aec700 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb76a600 0x564bdb76c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 -- 172.21.15.139:0/1228197302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 msgr2=0x564bdb76a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb76a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 -- 172.21.15.139:0/1228197302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb76a600 msgr2=0x564bdb76c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb76a600 0x564bdb76c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 -- 172.21.15.139:0/1228197302 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bdb4ddd90 con 0x564bdb75ee30 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.089+0000 7fdf752eb700 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf60010d90 tx=0x7fdf60013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957148c2aafd3634 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf5b7fe700 1 -- 172.21.15.139:0/1228197302 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60011bb0 con 0x564bdb75ee30 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf5b7fe700 1 -- 172.21.15.139:0/1228197302 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf60015070 con 0x564bdb75ee30 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf5b7fe700 1 -- 172.21.15.139:0/1228197302 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6001c610 con 0x564bdb75ee30 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 -- 172.21.15.139:0/1228197302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 msgr2=0x564bdb75f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdf60010d90 tx=0x7fdf60013000 comp rx=0 tx=0).stop 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 -- 172.21.15.139:0/1228197302 shutdown_connections 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb76a600 0x564bdb76c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb75f210 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 --2- 172.21.15.139:0/1228197302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb76a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 -- 172.21.15.139:0/1228197302 >> 172.21.15.139:0/1228197302 conn(0x564bdb6d4210 msgr2=0x564bdb75b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 -- 172.21.15.139:0/1228197302 shutdown_connections 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.090+0000 7fdf83738b80 1 -- 172.21.15.139:0/1228197302 wait complete. 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 -- start start 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 Processor -- start 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75f750 0x564bdb767290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb6b2de0 con 0x564bdb75ee30 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb64f6c0 con 0x564bdb75f750 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb64f360 con 0x564bdb76a600 2023-10-08T13:26:55.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf83738b80 10 client.0 _ll_register_callbacks cb 0x564bdb4ac7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf752eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf752eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39528/0 (socket says 172.21.15.139:39528) 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf752eb700 1 -- 172.21.15.139:0/3308686703 learned_addr learned my addr 172.21.15.139:0/3308686703 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.091+0000 7fdf74aea700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75f750 0x564bdb767290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf75aec700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 -- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 msgr2=0x564bdb7678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 -- 172.21.15.139:0/3308686703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75f750 msgr2=0x564bdb767290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75f750 0x564bdb767290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 -- 172.21.15.139:0/3308686703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60010a40 con 0x564bdb75ee30 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf752eb700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6001ec50 tx=0x7fdf6001ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d9acbb0050eb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.101 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6002c070 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdf60017070 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bdb67ae60 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf60011dc0 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 10 client.15495 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564bdb4c6c10 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564bdb67ae60 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdf60003680 con 0x564bdb75ee30 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 10 client.15495 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 10 client.15495 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.092+0000 7fdf83738b80 20 client.15495 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:55.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb77a130 0x564bdb778bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf83738b80 4 client.15495 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564bdb6abdc0 con 0x564bdb77a130 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf74aea700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb77a130 0x564bdb778bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf58ff9700 10 client.15495 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.093+0000 7fdf74aea700 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb77a130 0x564bdb778bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba54a7f92e7006f1 server_cookie=ae87c5b36d6cc09a in_seq=0 out_seq=0 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf58ff9700 1 -- 172.21.15.139:0/3308686703 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564bdb6abdc0 con 0x564bdb77a130 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf58ff9700 10 client.15495 handle_command_reply: tid=0 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 client.15495 shutdown 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 msgr2=0x564bdb76a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdf6001ec50 tx=0x7fdf6001ff90 comp rx=0 tx=0).stop 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 shutdown_connections 2023-10-08T13:26:55.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75ee30 0x564bdb76a010 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb77a130 0x564bdb778bd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3308686703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75f750 0x564bdb767290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf58ff9700 0 client.15495 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 >> 172.21.15.139:0/3308686703 conn(0x564bdb6d4210 msgr2=0x564bdb75ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 shutdown_connections 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 1 -- 172.21.15.139:0/3308686703 wait complete. 2023-10-08T13:26:55.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.094+0000 7fdf83738b80 20 client.15495 trim_cache size 0 max 16384 2023-10-08T13:26:55.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3428644537' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:26:55.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:54 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2003965773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.111+0000 7fdf83738b80 1 Processor -- start 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.111+0000 7fdf83738b80 1 -- start start 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb776170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb782a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb5338d0 con 0x564bdb76a600 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb6594d0 con 0x564bdb75ee30 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf83738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb53fde0 con 0x564bdb75f750 2023-10-08T13:26:55.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39540/0 (socket says 172.21.15.139:39540) 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 -- 172.21.15.139:0/3665075969 learned_addr learned my addr 172.21.15.139:0/3665075969 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf74aea700 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb782a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 -- 172.21.15.139:0/3665075969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 msgr2=0x564bdb782a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb782a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 -- 172.21.15.139:0/3665075969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 msgr2=0x564bdb776170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb776170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 -- 172.21.15.139:0/3665075969 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bdb504200 con 0x564bdb76a600 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf75aec700 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf680980e0 tx=0x7fdf680bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b99869d4a7ba69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf5bfff700 1 -- 172.21.15.139:0/3665075969 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68004de0 con 0x564bdb76a600 2023-10-08T13:26:55.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf5bfff700 1 -- 172.21.15.139:0/3665075969 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf6809bd70 con 0x564bdb76a600 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.112+0000 7fdf5bfff700 1 -- 172.21.15.139:0/3665075969 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68099aa0 con 0x564bdb76a600 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- 172.21.15.139:0/3665075969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 msgr2=0x564bdb769b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf680980e0 tx=0x7fdf680bb040 comp rx=0 tx=0).stop 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- 172.21.15.139:0/3665075969 shutdown_connections 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb76a600 0x564bdb769b40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb776170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 --2- 172.21.15.139:0/3665075969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb75f750 0x564bdb782a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- 172.21.15.139:0/3665075969 >> 172.21.15.139:0/3665075969 conn(0x564bdb6d4210 msgr2=0x564bdb765ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- 172.21.15.139:0/3665075969 shutdown_connections 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- 172.21.15.139:0/3665075969 wait complete. 2023-10-08T13:26:55.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 -- start start 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.113+0000 7fdf83738b80 1 Processor -- start 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb763fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb764d30 con 0x564bdb75f750 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb7ce060 con 0x564bdb75ee30 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bdb7ce1a0 con 0x564bdb76a600 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 10 client.0 _ll_register_callbacks cb 0x564bdb4ac7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39544/0 (socket says 172.21.15.139:39544) 2023-10-08T13:26:55.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 -- 172.21.15.139:0/244512636 learned_addr learned my addr 172.21.15.139:0/244512636 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf75aec700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf752eb700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb763fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 -- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 msgr2=0x564bdb7cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 -- 172.21.15.139:0/244512636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 msgr2=0x564bdb763fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb763fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 -- 172.21.15.139:0/244512636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf701a59f0 con 0x564bdb75f750 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf75aec700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf752eb700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb763fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf74aea700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf70074220 tx=0x7fdf6c021ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c08f811519253c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:55.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c017040 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf60015070 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.114+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fdf6c0212b0 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf6c021470 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 10 client.15501 fetch_fsmap learned FSMap version 26 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564bdb4dc260 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf60015070 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdf6c012d20 con 0x564bdb75f750 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 10 client.15501 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:26:55.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 20 client.15501 populate_metadata read hostname 'smithi139' 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb7d3550 0x564bdb7cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 4 client.15501 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564bdb6abae0 con 0x564bdb7d3550 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.115+0000 7fdf752eb700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb7d3550 0x564bdb7cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf58ff9700 10 client.15501 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf752eb700 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb7d3550 0x564bdb7cf9d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f20691095580c1 server_cookie=d3faa89a8abf3616 in_seq=0 out_seq=0 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf58ff9700 1 -- 172.21.15.139:0/244512636 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564bdb6abae0 con 0x564bdb7d3550 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf58ff9700 10 client.15501 handle_command_reply: tid=0 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 client.15501 shutdown 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 msgr2=0x564bdb7644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf70074220 tx=0x7fdf6c021ef0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 shutdown_connections 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564bdb76a600 0x564bdb7cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564bdb7d3550 0x564bdb7cf9d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564bdb75ee30 0x564bdb763fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 --2- 172.21.15.139:0/244512636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564bdb75f750 0x564bdb7644e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf58ff9700 0 client.15501 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 >> 172.21.15.139:0/244512636 conn(0x564bdb6d4210 msgr2=0x564bdb7657e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 shutdown_connections 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 1 -- 172.21.15.139:0/244512636 wait complete. 2023-10-08T13:26:55.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.116+0000 7fdf83738b80 20 client.15501 trim_cache size 0 max 16384 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24628, 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:26:55.127 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 80.692512536999999, 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 89, 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 93.633253922999998 2023-10-08T13:26:55.128 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 msgr2=0x7fdf5c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 0x7fdf5c0a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf60007b60 tx=0x7fdf600073d0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 msgr2=0x7fdf70073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 0x7fdf70073590 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b070 tx=0x7fdf68009c60 comp rx=0 tx=0).stop 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 shutdown_connections 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdf5c0a1560 0x7fdf5c0a3a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf70106750 0x7fdf70073590 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf70100740 0x7fdf70072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 --2- 172.21.15.139:0/2162642188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf70101100 0x7fdf70073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:55.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 >> 172.21.15.139:0/2162642188 conn(0x7fdf700fc230 msgr2=0x7fdf700fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:55.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 shutdown_connections 2023-10-08T13:26:55.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:55.117+0000 7fdf7754f700 1 -- 172.21.15.139:0/2162642188 wait complete. 2023-10-08T13:26:55.131 INFO:tasks.cephadm:Setup complete, yielding 2023-10-08T13:26:55.131 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T13:26:55.141 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:26:55.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-08T13:26:55.698 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:55.950 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:55 smithi139 ceph-mon[99506]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:55 smithi187 ceph-mon[104336]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:55 smithi155 ceph-mon[103467]: pgmap v280: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:26:57.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 -- 172.21.15.139:0/3574738194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 msgr2=0x7f873c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:57.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 --2- 172.21.15.139:0/3574738194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c104990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8730009990 tx=0x7f8730009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 -- 172.21.15.139:0/3574738194 shutdown_connections 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 --2- 172.21.15.139:0/3574738194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c1000a0 0x7f873c10c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 --2- 172.21.15.139:0/3574738194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c104990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 --2- 172.21.15.139:0/3574738194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c0ff6e0 0x7f873c0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 -- 172.21.15.139:0/3574738194 >> 172.21.15.139:0/3574738194 conn(0x7f873c0766c0 msgr2=0x7f873c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 -- 172.21.15.139:0/3574738194 shutdown_connections 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 -- 172.21.15.139:0/3574738194 wait complete. 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.014+0000 7f8742f18700 1 Processor -- start 2023-10-08T13:26:57.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 -- start start 2023-10-08T13:26:57.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 0x7f873c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:57.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c1000a0 0x7f873c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:57.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:57.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c195fb0 con 0x7f873c1045b0 2023-10-08T13:26:57.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c196120 con 0x7f873c0ff6e0 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8742f18700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c1962e0 con 0x7f873c1000a0 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39560/0 (socket says 172.21.15.139:39560) 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 -- 172.21.15.139:0/209677036 learned_addr learned my addr 172.21.15.139:0/209677036 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f873bfff700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c1000a0 0x7f873c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8740cb4700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 0x7f873c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 -- 172.21.15.139:0/209677036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c1000a0 msgr2=0x7f873c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c1000a0 0x7f873c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 -- 172.21.15.139:0/209677036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 msgr2=0x7f873c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 0x7f873c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 -- 172.21.15.139:0/209677036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300095f0 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f8740cb4700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 0x7f873c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.015+0000 7f87414b5700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f873400ef30 tx=0x7f873400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.016+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734018070 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.016+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f873400f040 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.016+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c196560 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.016+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734003dc0 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.016+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c1a2800 con 0x7f873c1045b0 2023-10-08T13:26:57.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.017+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c107c20 con 0x7f873c1045b0 2023-10-08T13:26:57.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.018+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f873400caa0 con 0x7f873c1045b0 2023-10-08T13:26:57.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.019+0000 7f8739ffb700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 0x7f872c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:57.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.019+0000 7f8740cb4700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 0x7f872c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:57.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.019+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f87340ccf90 con 0x7f873c1045b0 2023-10-08T13:26:57.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.019+0000 7f8740cb4700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 0x7f872c0a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f873000b2e0 tx=0x7f8730005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:57.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.023+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87340960d0 con 0x7f873c1045b0 2023-10-08T13:26:57.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.228+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f873c196e10 con 0x7f872c0a1560 2023-10-08T13:26:57.230 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.229+0000 7f8739ffb700 1 -- 172.21.15.139:0/209677036 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f873c196e10 con 0x7f872c0a1560 2023-10-08T13:26:57.230 INFO:teuthology.orchestra.run.smithi139.stdout:Backend: cephadm 2023-10-08T13:26:57.231 INFO:teuthology.orchestra.run.smithi139.stdout:Available: Yes 2023-10-08T13:26:57.231 INFO:teuthology.orchestra.run.smithi139.stdout:Paused: No 2023-10-08T13:26:57.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 msgr2=0x7f872c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:57.232 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 0x7f872c0a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f873000b2e0 tx=0x7f8730005fd0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 msgr2=0x7f873c195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f873400ef30 tx=0x7f873400c450 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 shutdown_connections 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f872c0a1560 0x7f872c0a3a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f873c1045b0 0x7f873c195950 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f873c0ff6e0 0x7f873c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 --2- 172.21.15.139:0/209677036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f873c1000a0 0x7f873c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 >> 172.21.15.139:0/209677036 conn(0x7f873c0766c0 msgr2=0x7f873c0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 shutdown_connections 2023-10-08T13:26:57.233 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:57.231+0000 7f8742f18700 1 -- 172.21.15.139:0/209677036 wait complete. 2023-10-08T13:26:57.549 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-08T13:26:57.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:57 smithi139 ceph-mon[99506]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:57 smithi187 ceph-mon[104336]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:57 smithi155 ceph-mon[103467]: pgmap v281: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:26:58.109 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:26:58.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:58 smithi187 ceph-mon[104336]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:59.053 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:58 smithi139 ceph-mon[99506]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:59.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:58 smithi155 ceph-mon[103467]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:26:59.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- 172.21.15.139:0/2293088246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86441056b0 msgr2=0x7f8644105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:59.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 --2- 172.21.15.139:0/2293088246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86441056b0 0x7f8644105a90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8634009990 tx=0x7f8634009ca0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- 172.21.15.139:0/2293088246 shutdown_connections 2023-10-08T13:26:59.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 --2- 172.21.15.139:0/2293088246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 0x7f864410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 --2- 172.21.15.139:0/2293088246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86441056b0 0x7f8644105a90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 --2- 172.21.15.139:0/2293088246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86440ff750 0x7f86440ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- 172.21.15.139:0/2293088246 >> 172.21.15.139:0/2293088246 conn(0x7f8644075790 msgr2=0x7f8644075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- 172.21.15.139:0/2293088246 shutdown_connections 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- 172.21.15.139:0/2293088246 wait complete. 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 Processor -- start 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.518+0000 7f864bb16700 1 -- start start 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 0x7f8644197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 0x7f86441a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644198810 con 0x7f86440ff750 2023-10-08T13:26:59.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a2fd0 con 0x7f8644100110 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441a3110 con 0x7f86441056b0 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39568/0 (socket says 172.21.15.139:39568) 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 -- 172.21.15.139:0/1302220737 learned_addr learned my addr 172.21.15.139:0/1302220737 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86490b1700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 0x7f8644197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864a0b3700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 0x7f86441a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 -- 172.21.15.139:0/1302220737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 msgr2=0x7f86441a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:59.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 0x7f86441a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 -- 172.21.15.139:0/1302220737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 msgr2=0x7f8644197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 0x7f8644197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 -- 172.21.15.139:0/1302220737 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340095f0 con 0x7f86440ff750 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864a0b3700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 0x7f86441a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f86498b2700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f86340098e0 tx=0x7f863400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863401d070 con 0x7f86440ff750 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8634022470 con 0x7f86440ff750 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644195800 con 0x7f86440ff750 2023-10-08T13:26:59.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634017650 con 0x7f86440ff750 2023-10-08T13:26:59.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.519+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644195cf0 con 0x7f86440ff750 2023-10-08T13:26:59.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.520+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644107c40 con 0x7f86440ff750 2023-10-08T13:26:59.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.522+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f86340225e0 con 0x7f86440ff750 2023-10-08T13:26:59.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.522+0000 7f863affd700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 0x7f86300a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:26:59.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.522+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f86340ce6c0 con 0x7f86440ff750 2023-10-08T13:26:59.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.522+0000 7f86490b1700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 0x7f86300a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:26:59.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.523+0000 7f86490b1700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 0x7f86300a3aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f86440689a0 tx=0x7f864000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:26:59.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.525+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8634097920 con 0x7f86440ff750 2023-10-08T13:26:59.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.725+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8644068750 con 0x7f86300a15e0 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.739+0000 7f863affd700 1 -- 172.21.15.139:0/1302220737 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f8644068750 con 0x7f86300a15e0 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:mds.a smithi139 running (93s) 17s ago 93s - - 18.0.0-6639-g7b3143ba 09a1f3752b5d ac1c4ff4981e 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:mds.b smithi155 running (91s) 22s ago 91s 21.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d a2e7923543b6 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:mds.c smithi187 running (103s) 22s ago 102s 19.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 6d84acf594e3 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:mds.d smithi139 running (109s) 17s ago 109s - - 18.0.0-6639-g7b3143ba 09a1f3752b5d c6d3c438c345 2023-10-08T13:26:59.740 INFO:teuthology.orchestra.run.smithi139.stdout:mds.e smithi155 running (107s) 22s ago 106s 19.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 98586beb2c73 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.f smithi187 running (105s) 22s ago 104s 18.9M - 18.0.0-6639-g7b3143ba 09a1f3752b5d f27171503217 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.g smithi139 running (96s) 17s ago 95s - - 18.0.0-6639-g7b3143ba 09a1f3752b5d 8eecb365316f 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.h smithi155 running (100s) 22s ago 100s 18.6M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 6e6f5aab3085 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.i smithi187 running (98s) 22s ago 98s 31.2M - 18.0.0-6639-g7b3143ba 09a1f3752b5d f4a161e82502 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.j smithi139 running (112s) 17s ago 111s - - 18.0.0-6639-g7b3143ba 09a1f3752b5d 08a8859909ad 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.k smithi155 running (114s) 22s ago 113s 17.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d c2827106d6e5 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mds.l smithi187 running (116s) 22s ago 115s 17.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 2604dbdf70b2 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mgr.x smithi139 *:9283,8765 running (8m) 17s ago 8m - - 18.0.0-6639-g7b3143ba 09a1f3752b5d 86ed3be2e0eb 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mgr.y smithi155 *:8443,8765 running (6m) 22s ago 6m 451M - 18.0.0-6639-g7b3143ba 09a1f3752b5d d0f3ad530cfd 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mgr.z smithi187 *:8443,8765 running (6m) 22s ago 6m 451M - 18.0.0-6639-g7b3143ba 09a1f3752b5d e77fd364c53e 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mon.a smithi139 running (8m) 17s ago 8m - 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 505ea1ff9709 2023-10-08T13:26:59.741 INFO:teuthology.orchestra.run.smithi139.stdout:mon.b smithi155 running (7m) 22s ago 7m 66.0M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 36c3a9b11604 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:mon.c smithi187 running (7m) 22s ago 7m 65.0M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d a7269149ef2b 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.0 smithi139 running (6m) 17s ago 6m - 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 0f5279c25ff4 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.1 smithi155 running (5m) 22s ago 5m 75.8M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d d564e2c28bb7 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.2 smithi187 running (5m) 22s ago 5m 77.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d d06c0f2ebef3 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.3 smithi139 running (5m) 17s ago 5m - 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 505dd4b1c1c4 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.4 smithi155 running (4m) 22s ago 4m 63.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d c45c2969e97b 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.5 smithi187 running (4m) 22s ago 4m 68.6M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d cbb3b0373c65 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.6 smithi139 running (3m) 17s ago 3m - 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 1c55a37820f0 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.7 smithi155 running (3m) 22s ago 3m 66.9M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 44638337888c 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.8 smithi187 running (3m) 22s ago 3m 63.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 32b94e3a3b70 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.9 smithi139 running (2m) 17s ago 2m - 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 73a0671798e5 2023-10-08T13:26:59.742 INFO:teuthology.orchestra.run.smithi139.stdout:osd.10 smithi155 running (2m) 22s ago 2m 65.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 7f1f72cc0203 2023-10-08T13:26:59.743 INFO:teuthology.orchestra.run.smithi139.stdout:osd.11 smithi187 running (2m) 22s ago 2m 54.7M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d fd61b63bedd7 2023-10-08T13:26:59.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 msgr2=0x7f86300a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:59.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 0x7f86300a3aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f86440689a0 tx=0x7f864000b410 comp rx=0 tx=0).stop 2023-10-08T13:26:59.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 msgr2=0x7f8644197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f86340098e0 tx=0x7f863400f670 comp rx=0 tx=0).stop 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 shutdown_connections 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f86300a15e0 0x7f86300a3aa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86441056b0 0x7f86441a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86440ff750 0x7f8644197a10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 --2- 172.21.15.139:0/1302220737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8644100110 0x7f8644197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 >> 172.21.15.139:0/1302220737 conn(0x7f8644075790 msgr2=0x7f86440fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 shutdown_connections 2023-10-08T13:26:59.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:26:59.741+0000 7f864bb16700 1 -- 172.21.15.139:0/1302220737 wait complete. 2023-10-08T13:26:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:26:59 smithi187 ceph-mon[104336]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:26:59 smithi155 ceph-mon[103467]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:00.132 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:26:59 smithi139 ceph-mon[99506]: pgmap v282: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:00.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-08T13:27:00.717 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:00.967 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:00 smithi139 ceph-mon[99506]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:00 smithi187 ceph-mon[104336]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:00 smithi155 ceph-mon[103467]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:01 smithi187 ceph-mon[104336]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:02.009 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.006+0000 7fc090994700 1 -- 172.21.15.139:0/3279869384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068b30 msgr2=0x7fc08c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:02.009 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.006+0000 7fc090994700 1 --2- 172.21.15.139:0/3279869384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068b30 0x7fc08c10d690 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b0a0 tx=0x7fc08400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.009 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 -- 172.21.15.139:0/3279869384 shutdown_connections 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 --2- 172.21.15.139:0/3279869384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068b30 0x7fc08c10d690 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 --2- 172.21.15.139:0/3279869384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 0x7fc08c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 --2- 172.21.15.139:0/3279869384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068190 0x7fc08c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 -- 172.21.15.139:0/3279869384 >> 172.21.15.139:0/3279869384 conn(0x7fc08c075790 msgr2=0x7fc08c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 -- 172.21.15.139:0/3279869384 shutdown_connections 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 -- 172.21.15.139:0/3279869384 wait complete. 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 Processor -- start 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.007+0000 7fc090994700 1 -- start start 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068b30 0x7fc08c1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 0x7fc08c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:02.010 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19bca0 con 0x7fc08c068190 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19be10 con 0x7fc08c1067c0 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c19bfd0 con 0x7fc08c068b30 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39582/0 (socket says 172.21.15.139:39582) 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 -- 172.21.15.139:0/2980984754 learned_addr learned my addr 172.21.15.139:0/2980984754 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc089d9b700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068b30 0x7fc08c1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08ad9d700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 0x7fc08c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 -- 172.21.15.139:0/2980984754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068b30 msgr2=0x7fc08c1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068b30 0x7fc08c1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 -- 172.21.15.139:0/2980984754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 msgr2=0x7fc08c19b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:02.011 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 0x7fc08c19b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 -- 172.21.15.139:0/2980984754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009d00 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc08a59c700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00d950 tx=0x7fc07c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c009940 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc07c010460 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c19c2b0 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00f620 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.008+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c1a3b10 con 0x7fc08c068190 2023-10-08T13:27:02.012 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.009+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c108de0 con 0x7fc08c068190 2023-10-08T13:27:02.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.010+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fc07c0108d0 con 0x7fc08c068190 2023-10-08T13:27:02.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.011+0000 7fc07b7fe700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 0x7fc0740a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:02.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.011+0000 7fc089d9b700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 0x7fc0740a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:02.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.011+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fc07c0cd010 con 0x7fc08c068190 2023-10-08T13:27:02.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.012+0000 7fc089d9b700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 0x7fc0740a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc08c198300 tx=0x7fc08000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:02.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.016+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc07c096120 con 0x7fc08c068190 2023-10-08T13:27:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:01 smithi155 ceph-mon[103467]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:02.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:01 smithi139 ceph-mon[99506]: pgmap v283: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:02.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.213+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc08c1980b0 con 0x7fc0740a15e0 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.219+0000 7fc07b7fe700 1 -- 172.21.15.139:0/2980984754 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fc08c1980b0 con 0x7fc0740a15e0 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:mds.all 12/12 24s ago 2m smithi139=a;smithi139=d;smithi139=g;smithi139=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi187=c;smithi187=f;smithi187=i;smithi187=l;count:12 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:mgr 3/3 24s ago 6m smithi139=x;smithi155=y;smithi187=z;count:3 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:mon 3/3 24s ago 7m smithi139:172.21.15.139=a;smithi155:172.21.15.155=b;smithi187:172.21.15.187=c;count:3 2023-10-08T13:27:02.219 INFO:teuthology.orchestra.run.smithi139.stdout:osd 12 24s ago - 2023-10-08T13:27:02.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 msgr2=0x7fc0740a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:02.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 0x7fc0740a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc08c198300 tx=0x7fc08000a300 comp rx=0 tx=0).stop 2023-10-08T13:27:02.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 msgr2=0x7fc08c196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:02.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00d950 tx=0x7fc07c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:27:02.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 shutdown_connections 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc0740a15e0 0x7fc0740a3aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc08c1067c0 0x7fc08c19b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc08c068190 0x7fc08c196da0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 --2- 172.21.15.139:0/2980984754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc08c068b30 0x7fc08c1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 >> 172.21.15.139:0/2980984754 conn(0x7fc08c075790 msgr2=0x7fc08c0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 shutdown_connections 2023-10-08T13:27:02.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:02.221+0000 7fc090994700 1 -- 172.21.15.139:0/2980984754 wait complete. 2023-10-08T13:27:02.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-08T13:27:03.142 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:03 smithi187 ceph-mon[104336]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:03 smithi187 ceph-mon[104336]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:03 smithi155 ceph-mon[103467]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:03 smithi155 ceph-mon[103467]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:03 smithi139 ceph-mon[99506]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:03 smithi139 ceph-mon[99506]: pgmap v284: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:27:04.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 -- 172.21.15.139:0/432606939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a0069860 msgr2=0x7f45a010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:04.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 --2- 172.21.15.139:0/432606939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a0069860 0x7f45a010d670 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f459800b0a0 tx=0x7f459800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 -- 172.21.15.139:0/432606939 shutdown_connections 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 --2- 172.21.15.139:0/432606939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a0069860 0x7f45a010d670 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 --2- 172.21.15.139:0/432606939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a01067a0 0x7f45a0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 --2- 172.21.15.139:0/432606939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a0069320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 -- 172.21.15.139:0/432606939 >> 172.21.15.139:0/432606939 conn(0x7f45a00766c0 msgr2=0x7f45a0076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 -- 172.21.15.139:0/432606939 shutdown_connections 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.426+0000 7f45a83f8700 1 -- 172.21.15.139:0/432606939 wait complete. 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 Processor -- start 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 -- start start 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a00ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a0069860 0x7f45a00ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:04.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01a5060 con 0x7f45a01067a0 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01a51d0 con 0x7f45a0068ec0 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a83f8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a01a5390 con 0x7f45a0069860 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a6995700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a6995700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39600/0 (socket says 172.21.15.139:39600) 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a6995700 1 -- 172.21.15.139:0/2036732714 learned_addr learned my addr 172.21.15.139:0/2036732714 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.427+0000 7f45a6194700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a00ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a5993700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a0069860 0x7f45a00ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 -- 172.21.15.139:0/2036732714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a0069860 msgr2=0x7f45a00ffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a0069860 0x7f45a00ffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 -- 172.21.15.139:0/2036732714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 msgr2=0x7f45a00ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a00ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 -- 172.21.15.139:0/2036732714 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598009d00 con 0x7f45a01067a0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6194700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a00ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a6995700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f459800b070 tx=0x7f4598007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800e040 con 0x7f45a01067a0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a01a5610 con 0x7f45a01067a0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4598009440 con 0x7f45a01067a0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459801b450 con 0x7f45a01067a0 2023-10-08T13:27:04.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.428+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a01a5a80 con 0x7f45a01067a0 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.429+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0108d50 con 0x7f45a01067a0 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.431+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7f459801d480 con 0x7f45a01067a0 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.431+0000 7f45977fe700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 0x7f458c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.431+0000 7f45a6194700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 0x7f458c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.431+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7f45980cf2e0 con 0x7f45a01067a0 2023-10-08T13:27:04.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.432+0000 7f45a6194700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 0x7f458c0a3a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45900103d0 tx=0x7f459000b3c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:04.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.435+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4598098420 con 0x7f45a01067a0 2023-10-08T13:27:04.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.631+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f45a01106f0 con 0x7f458c0a1560 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.633+0000 7f45977fe700 1 -- 172.21.15.139:0/2036732714 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f45a01106f0 con 0x7f458c0a1560 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stdout:HOST ADDR LABELS STATUS 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139 172.21.15.139 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stdout:smithi155 172.21.15.155 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stdout:smithi187 172.21.15.187 2023-10-08T13:27:04.633 INFO:teuthology.orchestra.run.smithi139.stdout:3 hosts in cluster 2023-10-08T13:27:04.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 msgr2=0x7f458c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:04.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 0x7f458c0a3a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45900103d0 tx=0x7f459000b3c0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 msgr2=0x7f45a0100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f459800b070 tx=0x7f4598007870 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 shutdown_connections 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f458c0a1560 0x7f458c0a3a20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45a01067a0 0x7f45a0100230 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45a0068ec0 0x7f45a00ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 --2- 172.21.15.139:0/2036732714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a0069860 0x7f45a00ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 >> 172.21.15.139:0/2036732714 conn(0x7f45a00766c0 msgr2=0x7f45a00fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 shutdown_connections 2023-10-08T13:27:04.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:04.635+0000 7f45a83f8700 1 -- 172.21.15.139:0/2036732714 wait complete. 2023-10-08T13:27:05.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-08T13:27:05.566 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:05 smithi187 ceph-mon[104336]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:05 smithi187 ceph-mon[104336]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:05.994 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:05 smithi139 ceph-mon[99506]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:05.994 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:05 smithi139 ceph-mon[99506]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:05 smithi155 ceph-mon[103467]: pgmap v285: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:05 smithi155 ceph-mon[103467]: from='client.15525 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- 172.21.15.139:0/2712508241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 msgr2=0x7fecbc104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 --2- 172.21.15.139:0/2712508241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc104b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009990 tx=0x7fecb8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- 172.21.15.139:0/2712508241 shutdown_connections 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 --2- 172.21.15.139:0/2712508241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 0x7fecbc10c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 --2- 172.21.15.139:0/2712508241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc104b00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 --2- 172.21.15.139:0/2712508241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 0x7fecbc100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- 172.21.15.139:0/2712508241 >> 172.21.15.139:0/2712508241 conn(0x7fecbc074a10 msgr2=0x7fecbc074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- 172.21.15.139:0/2712508241 shutdown_connections 2023-10-08T13:27:06.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- 172.21.15.139:0/2712508241 wait complete. 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 Processor -- start 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.872+0000 7fecc36a0700 1 -- start start 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 0x7fecbc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 0x7fecbc101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc1a4fc0 con 0x7fecbc104720 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc1a5130 con 0x7fecbc1002a0 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc1a52f0 con 0x7fecbc100c60 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc143c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 0x7fecbc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:06.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39614/0 (socket says 172.21.15.139:39614) 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 -- 172.21.15.139:0/709150585 learned_addr learned my addr 172.21.15.139:0/709150585 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc0c3b700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 0x7fecbc101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 -- 172.21.15.139:0/709150585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 msgr2=0x7fecbc101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 0x7fecbc101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 -- 172.21.15.139:0/709150585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 msgr2=0x7fecbc101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 0x7fecbc101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 -- 172.21.15.139:0/709150585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80095f0 con 0x7fecbc104720 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc1c3d700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b970 tx=0x7fecb400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb400d860 con 0x7fecbc104720 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb400de80 con 0x7fecbc104720 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc1a55d0 con 0x7fecbc104720 2023-10-08T13:27:06.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4017400 con 0x7fecbc104720 2023-10-08T13:27:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.873+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc1a5b20 con 0x7fecbc104720 2023-10-08T13:27:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.875+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc108cb0 con 0x7fecbc104720 2023-10-08T13:27:06.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.875+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 21) v1 ==== 136072+0+0 (secure 0 0 0) 0x7fecb400e630 con 0x7fecbc104720 2023-10-08T13:27:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.876+0000 7fecb27fc700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 0x7feca80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.876+0000 7fecc143c700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 0x7feca80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.876+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fecb4006e40 con 0x7fecbc104720 2023-10-08T13:27:06.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.876+0000 7fecc143c700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 0x7feca80a3aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b2e0 tx=0x7fecb8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:06.880+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fecb40d3080 con 0x7fecbc104720 2023-10-08T13:27:07.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.078+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fecbc102900 con 0x7feca80a15e0 2023-10-08T13:27:07.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.080+0000 7fecb27fc700 1 -- 172.21.15.139:0/709150585 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fecbc102900 con 0x7feca80a15e0 2023-10-08T13:27:07.081 INFO:teuthology.orchestra.run.smithi139.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-08T13:27:07.081 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:27:07.081 INFO:teuthology.orchestra.run.smithi139.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:27:07.081 INFO:teuthology.orchestra.run.smithi139.stdout:smithi187 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MW400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T13:27:07.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 msgr2=0x7feca80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:07.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 0x7feca80a3aa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fecb800b2e0 tx=0x7fecb8005960 comp rx=0 tx=0).stop 2023-10-08T13:27:07.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 msgr2=0x7fecbc101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:07.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fecb400b970 tx=0x7fecb400bc80 comp rx=0 tx=0).stop 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 shutdown_connections 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7feca80a15e0 0x7feca80a3aa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecbc104720 0x7fecbc101ea0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecbc1002a0 0x7fecbc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 --2- 172.21.15.139:0/709150585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecbc100c60 0x7fecbc101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 >> 172.21.15.139:0/709150585 conn(0x7fecbc074a10 msgr2=0x7fecbc0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 shutdown_connections 2023-10-08T13:27:07.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:07.082+0000 7fecc36a0700 1 -- 172.21.15.139:0/709150585 wait complete. 2023-10-08T13:27:07.522 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T13:27:07.533 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:27:07.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-08T13:27:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:07 smithi187 ceph-mon[104336]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:27:08.091 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:07 smithi155 ceph-mon[103467]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:27:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:07 smithi139 ceph-mon[99506]: pgmap v286: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:27:08.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:08 smithi139 ceph-mon[99506]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:08.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:08 smithi187 ceph-mon[104336]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:09.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:08 smithi155 ceph-mon[103467]: from='client.15531 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 -- 172.21.15.139:0/117850797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 msgr2=0x7fbae0105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 --2- 172.21.15.139:0/117850797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0105cb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009990 tx=0x7fbad0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 -- 172.21.15.139:0/117850797 shutdown_connections 2023-10-08T13:27:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 --2- 172.21.15.139:0/117850797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 0x7fbae010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 --2- 172.21.15.139:0/117850797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0105cb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 --2- 172.21.15.139:0/117850797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 0x7fbae00ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 -- 172.21.15.139:0/117850797 >> 172.21.15.139:0/117850797 conn(0x7fbae0074a10 msgr2=0x7fbae0074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 -- 172.21.15.139:0/117850797 shutdown_connections 2023-10-08T13:27:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.300+0000 7fbae480d700 1 -- 172.21.15.139:0/117850797 wait complete. 2023-10-08T13:27:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 Processor -- start 2023-10-08T13:27:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 -- start start 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 0x7fbae019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 0x7fbae019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae01970c0 con 0x7fbae01058d0 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0197230 con 0x7fbae00ff190 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbae480d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae01973f0 con 0x7fbae00ffb30 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39628/0 (socket says 172.21.15.139:39628) 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 -- 172.21.15.139:0/3516887932 learned_addr learned my addr 172.21.15.139:0/3516887932 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbade59c700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 0x7fbae019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaddd9b700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 0x7fbae019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 -- 172.21.15.139:0/3516887932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 msgr2=0x7fbae019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 0x7fbae019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 -- 172.21.15.139:0/3516887932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 msgr2=0x7fbae019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 0x7fbae019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 -- 172.21.15.139:0/3516887932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad00095f0 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.301+0000 7fbaded9d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b9e0 tx=0x7fbad800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800d8e0 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae01976d0 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbad8009880 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80143d0 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae01a3910 con 0x7fbae01058d0 2023-10-08T13:27:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.302+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae0108d30 con 0x7fbae01058d0 2023-10-08T13:27:09.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.304+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fbad800da40 con 0x7fbae01058d0 2023-10-08T13:27:09.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.305+0000 7fbacf7fe700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 0x7fbac80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:09.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.305+0000 7fbade59c700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 0x7fbac80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:09.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.305+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 9235+0+0 (secure 0 0 0) 0x7fbad8011070 con 0x7fbae01058d0 2023-10-08T13:27:09.307 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.306+0000 7fbade59c700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 0x7fbac80a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006010 tx=0x7fbad0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:09.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.308+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbad80966d0 con 0x7fbae01058d0 2023-10-08T13:27:09.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.541+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbae0067c30 con 0x7fbae01058d0 2023-10-08T13:27:09.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.541+0000 7fbacf7fe700 1 -- 172.21.15.139:0/3516887932 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2989 (secure 0 0 0) 0x7fbad8099cf0 con 0x7fbae01058d0 2023-10-08T13:27:09.542 INFO:teuthology.orchestra.run.smithi139.stdout:e26 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:legacy client fscid: 1 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:Filesystem 'cephfs' (1) 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:fs_name cephfs 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 26 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:created 2023-10-08T13:25:33.853946+0000 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:modified 2023-10-08T13:26:04.411259+0000 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:tableserver 0 2023-10-08T13:27:09.543 INFO:teuthology.orchestra.run.smithi139.stdout:root 0 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:session_timeout 300 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:session_autoclose 300 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:max_file_size 1099511627776 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:max_xattr_size 65536 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:required_client_features {} 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:last_failure 0 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:last_failure_osd_epoch 0 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:max_mds 5 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:in 0,1,2,3,4 2023-10-08T13:27:09.544 INFO:teuthology.orchestra.run.smithi139.stdout:up {0=24628,1=24607,2=24599,3=24595,4=24566} 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:failed 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:damaged 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:stopped 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:data_pools [3,4] 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:metadata_pool 2 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:inline_data disabled 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:balancer 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:bal_rank_mask -1 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:standby_count_wanted 0 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.i{0:24628} state up:active seq 5 addr [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.e{0:24542} state up:standby-replay seq 1 addr [v2:172.21.15.155:6834/4262434274,v1:172.21.15.155:6835/4262434274] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c{1:24607} state up:active seq 12 addr [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.k{1:24518} state up:standby-replay seq 1 addr [v2:172.21.15.155:6832/3719268095,v1:172.21.15.155:6833/3719268095] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b{2:24599} state up:active seq 10 addr [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a{2:14838} state up:standby-replay seq 1 addr [v2:172.21.15.139:6840/3823660758,v1:172.21.15.139:6841/3823660758] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.f{3:24595} state up:active seq 13 addr [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.g{3:14826} state up:standby-replay seq 1 addr [v2:172.21.15.139:6838/4169446012,v1:172.21.15.139:6839/4169446012] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.h{4:24566} state up:active seq 13 addr [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d{4:14772} state up:standby-replay seq 1 addr [v2:172.21.15.139:6836/2085954073,v1:172.21.15.139:6837/2085954073] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:Standby daemons: 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:09.546 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.l{-1:14736} state up:standby seq 1 addr [v2:172.21.15.187:6832/2027109215,v1:172.21.15.187:6833/2027109215] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.547 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.j{-1:14760} state up:standby seq 1 addr [v2:172.21.15.139:6834/516841200,v1:172.21.15.139:6835/516841200] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T13:27:09.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 msgr2=0x7fbac80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:09.547 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 0x7fbac80a3990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbad0006010 tx=0x7fbad0005960 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 msgr2=0x7fbae0196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b9e0 tx=0x7fbad800bcf0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 shutdown_connections 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbac80a14d0 0x7fbac80a3990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbae01058d0 0x7fbae0196a60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbae00ff190 0x7fbae019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 --2- 172.21.15.139:0/3516887932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbae00ffb30 0x7fbae019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 >> 172.21.15.139:0/3516887932 conn(0x7fbae0074a10 msgr2=0x7fbae00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 shutdown_connections 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:09.543+0000 7fbae480d700 1 -- 172.21.15.139:0/3516887932 wait complete. 2023-10-08T13:27:09.548 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:27:09.928 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:09.928 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:27:09.929 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-08T13:27:09.929 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:27:09.929 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2023-10-08T13:27:09.929 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:27:09.929 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:09 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3516887932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:27:09.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:27:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:09 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3516887932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:27:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: pgmap v287: 129 pgs: 129 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]: dispatch 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2023-10-08T13:27:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:09 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3516887932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T13:27:10.509 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:11.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-08T13:27:11.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:27:11.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2023-10-08T13:27:11.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:10 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:27:11.043 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:10 smithi139 ceph-mon[99506]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:27:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-08T13:27:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:27:11.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2023-10-08T13:27:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:10 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:27:11.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:10 smithi155 ceph-mon[103467]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:27:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2023-10-08T13:27:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2023-10-08T13:27:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 1]}]': finished 2023-10-08T13:27:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:10 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2023-10-08T13:27:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:10 smithi187 ceph-mon[104336]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T13:27:11.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 -- 172.21.15.139:0/1599743498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 msgr2=0x7f140c10c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 --2- 172.21.15.139:0/1599743498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c10c590 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f140400b0d0 tx=0x7f140400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 -- 172.21.15.139:0/1599743498 shutdown_connections 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 --2- 172.21.15.139:0/1599743498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c10c590 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 --2- 172.21.15.139:0/1599743498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c105730 0x7f140c105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 --2- 172.21.15.139:0/1599743498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c0ff720 0x7f140c0ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 -- 172.21.15.139:0/1599743498 >> 172.21.15.139:0/1599743498 conn(0x7f140c0757d0 msgr2=0x7f140c075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:11.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 -- 172.21.15.139:0/1599743498 shutdown_connections 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.686+0000 7f1414605700 1 -- 172.21.15.139:0/1599743498 wait complete. 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 Processor -- start 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 -- start start 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 0x7f140c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c105730 0x7f140c1959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c196190 con 0x7f140c1000e0 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c196300 con 0x7f140c0ff720 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1414605700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1964c0 con 0x7f140c105730 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:11.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39640/0 (socket says 172.21.15.139:39640) 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 -- 172.21.15.139:0/1555827956 learned_addr learned my addr 172.21.15.139:0/1555827956 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f14123a1700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 0x7f140c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1412ba2700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c105730 0x7f140c1959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 -- 172.21.15.139:0/1555827956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c105730 msgr2=0x7f140c1959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c105730 0x7f140c1959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 -- 172.21.15.139:0/1555827956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 msgr2=0x7f140c19b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 0x7f140c19b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f1411ba0700 1 -- 172.21.15.139:0/1555827956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009d00 con 0x7f140c1000e0 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.687+0000 7f14123a1700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 0x7f140c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:11.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f1411ba0700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c9b0 tx=0x7f13fc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007b00 con 0x7f140c1000e0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13fc007c60 con 0x7f140c1000e0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c1966e0 con 0x7f140c1000e0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc018660 con 0x7f140c1000e0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.688+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c069050 con 0x7f140c1000e0 2023-10-08T13:27:11.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.689+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c100e00 con 0x7f140c1000e0 2023-10-08T13:27:11.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.690+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f13fc018880 con 0x7f140c1000e0 2023-10-08T13:27:11.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.690+0000 7f14037fe700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 0x7f13f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:11.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.691+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f13fc0cd560 con 0x7f140c1000e0 2023-10-08T13:27:11.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.691+0000 7f14123a1700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 0x7f13f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:11.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.691+0000 7f14123a1700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 0x7f13f80a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1408005fd0 tx=0x7f1408005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:11.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.694+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f13fc0967f0 con 0x7f140c1000e0 2023-10-08T13:27:11.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.884+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f140c196ec0 con 0x7f140c1000e0 2023-10-08T13:27:11.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.885+0000 7f14037fe700 1 -- 172.21.15.139:0/1555827956 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) v1 ==== 56+0+6109 (secure 0 0 0) 0x7f13fc099e10 con 0x7f140c1000e0 2023-10-08T13:27:11.886 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 91 2023-10-08T13:27:11.886 INFO:teuthology.orchestra.run.smithi139.stdout:fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:created 2023-10-08T13:18:09.442366+0000 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:modified 2023-10-08T13:27:10.730150+0000 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:crush_version 27 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:full_ratio 0.95 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:backfillfull_ratio 0.9 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:nearfull_ratio 0.85 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:require_min_compat_client luminous 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:min_compat_client luminous 2023-10-08T13:27:11.887 INFO:teuthology.orchestra.run.smithi139.stdout:require_osd_release reef 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:stretch_mode_enabled false 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:max_osd 12 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:osd.0 up in weight 1 up_from 9 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6802/927870802,v1:172.21.15.139:6803/927870802] [v2:172.21.15.139:6804/927870802,v1:172.21.15.139:6805/927870802] exists,up 7d1e38b5-74c5-449b-96f0-3619599c9602 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:osd.1 up in weight 1 up_from 14 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/765538581,v1:172.21.15.155:6801/765538581] [v2:172.21.15.155:6802/765538581,v1:172.21.15.155:6803/765538581] exists,up a8d6fd01-729c-4b3b-9073-1df5819593c0 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:osd.2 up in weight 1 up_from 19 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/3332520457,v1:172.21.15.187:6801/3332520457] [v2:172.21.15.187:6802/3332520457,v1:172.21.15.187:6803/3332520457] exists,up 59c35f9f-67d3-45b6-9bf0-c13e6c593ddd 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:osd.3 up in weight 1 up_from 26 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6810/254276736,v1:172.21.15.139:6811/254276736] [v2:172.21.15.139:6812/254276736,v1:172.21.15.139:6813/254276736] exists,up 6c4fd3e0-7072-4fc5-8b9d-48030d0a877a 2023-10-08T13:27:11.888 INFO:teuthology.orchestra.run.smithi139.stdout:osd.4 up in weight 1 up_from 33 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6808/3389759441,v1:172.21.15.155:6809/3389759441] [v2:172.21.15.155:6810/3389759441,v1:172.21.15.155:6811/3389759441] exists,up b56dde7b-4858-481a-bbcb-1d3d243a368d 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.5 up in weight 1 up_from 38 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6808/247670329,v1:172.21.15.187:6809/247670329] [v2:172.21.15.187:6810/247670329,v1:172.21.15.187:6811/247670329] exists,up a99b3b48-6c21-402e-9030-59a51a671f21 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.6 up in weight 1 up_from 46 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6818/3559626556,v1:172.21.15.139:6819/3559626556] [v2:172.21.15.139:6820/3559626556,v1:172.21.15.139:6821/3559626556] exists,up 4b0ca25a-6499-4462-9664-e1c0cb8a12b2 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.7 up in weight 1 up_from 51 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6816/1735491118,v1:172.21.15.155:6817/1735491118] [v2:172.21.15.155:6818/1735491118,v1:172.21.15.155:6819/1735491118] exists,up a94a0e56-610f-4aae-a73e-80a5f7b7dbe6 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.8 up in weight 1 up_from 58 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6816/3076471964,v1:172.21.15.187:6817/3076471964] [v2:172.21.15.187:6818/3076471964,v1:172.21.15.187:6819/3076471964] exists,up a53a4eb0-33db-4e79-9640-45d1717efe54 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.9 up in weight 1 up_from 66 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6826/317853684,v1:172.21.15.139:6827/317853684] [v2:172.21.15.139:6828/317853684,v1:172.21.15.139:6829/317853684] exists,up a9b3fbe3-9a87-4a39-b045-3d243900ce93 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.10 up in weight 1 up_from 71 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6824/1252167532,v1:172.21.15.155:6825/1252167532] [v2:172.21.15.155:6826/1252167532,v1:172.21.15.155:6827/1252167532] exists,up 6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:osd.11 up in weight 1 up_from 78 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6824/599992854,v1:172.21.15.187:6825/599992854] [v2:172.21.15.187:6826/599992854,v1:172.21.15.187:6827/599992854] exists,up ec8bf58f-7d6f-4a86-b95c-8b104705fcaf 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 2.b [8,11] 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 2.f [8,11] 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 2.10 [2,1] 2023-10-08T13:27:11.889 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 2.16 [2,4] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.c [3,9] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.14 [4,6] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.17 [4,8] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.25 [5,9] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.36 [4,9] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 3.37 [5,7] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 4.5 [9,10] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 4.16 [9,8] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 4.1a [5,8] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:pg_upmap_items 4.1b [9,8] 2023-10-08T13:27:11.890 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/542053995 expires 2023-10-09T13:20:08.525995+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/4107466857 expires 2023-10-09T13:20:08.525995+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6801/2305265719 expires 2023-10-09T13:20:08.525995+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6800/2305265719 expires 2023-10-09T13:20:08.525995+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/1347436644 expires 2023-10-09T13:19:05.548203+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6801/368295246 expires 2023-10-09T13:18:43.030956+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6800/368295246 expires 2023-10-09T13:18:43.030956+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/1490471359 expires 2023-10-09T13:20:08.525995+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/3474112198 expires 2023-10-09T13:19:05.548203+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6800/1721493169 expires 2023-10-09T13:19:05.548203+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/1278886955 expires 2023-10-09T13:19:05.548203+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/3196233301 expires 2023-10-09T13:18:43.030956+0000 2023-10-08T13:27:11.891 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:6801/1721493169 expires 2023-10-09T13:19:05.548203+0000 2023-10-08T13:27:11.892 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/4197784005 expires 2023-10-09T13:18:43.030956+0000 2023-10-08T13:27:11.892 INFO:teuthology.orchestra.run.smithi139.stdout:blocklist 172.21.15.139:0/3589198312 expires 2023-10-09T13:18:43.030956+0000 2023-10-08T13:27:11.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 msgr2=0x7f13f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 0x7f13f80a3990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1408005fd0 tx=0x7f1408005db0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 msgr2=0x7f140c19be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c9b0 tx=0x7f13fc00cd70 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 shutdown_connections 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13f80a14d0 0x7f13f80a3990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f140c105730 0x7f140c1959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f140c0ff720 0x7f140c19b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 --2- 172.21.15.139:0/1555827956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f140c1000e0 0x7f140c19be70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:11.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 >> 172.21.15.139:0/1555827956 conn(0x7f140c0757d0 msgr2=0x7f140c0fd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:11.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 shutdown_connections 2023-10-08T13:27:11.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:11.887+0000 7f1414605700 1 -- 172.21.15.139:0/1555827956 wait complete. 2023-10-08T13:27:11.911 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:11 smithi139 ceph-mon[99506]: pgmap v289: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:27:11.912 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:11 smithi139 ceph-mon[99506]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:27:11.912 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:11 smithi139 ceph-mon[99506]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-08T13:27:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:11 smithi155 ceph-mon[103467]: pgmap v289: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:27:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:11 smithi155 ceph-mon[103467]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:27:12.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:11 smithi155 ceph-mon[103467]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-08T13:27:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:11 smithi187 ceph-mon[104336]: pgmap v289: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:27:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:11 smithi187 ceph-mon[104336]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T13:27:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:11 smithi187 ceph-mon[104336]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-10-08T13:27:12.257 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-08T13:27:12.269 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 -- 172.21.15.139:0/3439230396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff540 msgr2=0x7f133c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 --2- 172.21.15.139:0/3439230396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff540 0x7f133c0ff9c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f132c0099c0 tx=0x7f132c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 -- 172.21.15.139:0/3439230396 shutdown_connections 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 --2- 172.21.15.139:0/3439230396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0fff00 0x7f133c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 --2- 172.21.15.139:0/3439230396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c105600 0x7f133c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 --2- 172.21.15.139:0/3439230396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c0ff540 0x7f133c0ff9c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 -- 172.21.15.139:0/3439230396 >> 172.21.15.139:0/3439230396 conn(0x7f133c0fb030 msgr2=0x7f133c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:12.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 -- 172.21.15.139:0/3439230396 shutdown_connections 2023-10-08T13:27:12.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.395+0000 7f13411fc700 1 -- 172.21.15.139:0/3439230396 wait complete. 2023-10-08T13:27:12.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.396+0000 7f13411fc700 1 Processor -- start 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.396+0000 7f13411fc700 1 -- start start 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff540 0x7f133c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff00 0x7f133c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c198630 con 0x7f133c105600 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a2e60 con 0x7f133c0ff540 2023-10-08T13:27:12.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1a2fa0 con 0x7f133c0fff00 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39654/0 (socket says 172.21.15.139:39654) 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 -- 172.21.15.139:0/297323159 learned_addr learned my addr 172.21.15.139:0/297323159 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133ad9d700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff540 0x7f133c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133a59c700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff00 0x7f133c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 -- 172.21.15.139:0/297323159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff00 msgr2=0x7f133c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff00 0x7f133c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 -- 172.21.15.139:0/297323159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff540 msgr2=0x7f133c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff540 0x7f133c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 -- 172.21.15.139:0/297323159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0095f0 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f133b59e700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1334007f10 tx=0x7f133400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334017070 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c1a3200 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f133400f040 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334005610 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.397+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1a36e0 con 0x7f133c105600 2023-10-08T13:27:12.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.398+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c107aa0 con 0x7f133c105600 2023-10-08T13:27:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.399+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1334004ad0 con 0x7f133c105600 2023-10-08T13:27:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.400+0000 7f1333fff700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.400+0000 7f133ad9d700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.400+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f13340ccf70 con 0x7f133c105600 2023-10-08T13:27:12.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.400+0000 7f133ad9d700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1324007be0 tx=0x7f13240073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:12.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.404+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1334096170 con 0x7f133c105600 2023-10-08T13:27:12.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.601+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f133c067dd0 con 0x7f133c105600 2023-10-08T13:27:12.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.602+0000 7f1333fff700 1 -- 172.21.15.139:0/297323159 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7f1334099790 con 0x7f133c105600 2023-10-08T13:27:12.604 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:12.604 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.604+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 msgr2=0x7f13280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.604+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1324007be0 tx=0x7f13240073d0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.604+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 msgr2=0x7f133c1a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.604+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1334007f10 tx=0x7f133400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 shutdown_connections 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f13280a14d0 0x7f13280a3990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c105600 0x7f133c1a2920 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f133c0ff540 0x7f133c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 --2- 172.21.15.139:0/297323159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c0fff00 0x7f133c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 >> 172.21.15.139:0/297323159 conn(0x7f133c0fb030 msgr2=0x7f133c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:12.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 shutdown_connections 2023-10-08T13:27:12.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.605+0000 7f13411fc700 1 -- 172.21.15.139:0/297323159 wait complete. 2023-10-08T13:27:12.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:27:12.619 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 -- 172.21.15.139:0/1924175141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 msgr2=0x7f95480ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 --2- 172.21.15.139:0/1924175141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f95480ffac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f953c009990 tx=0x7f953c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 -- 172.21.15.139:0/1924175141 shutdown_connections 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 --2- 172.21.15.139:0/1924175141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548100000 0x7f954810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 --2- 172.21.15.139:0/1924175141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548105630 0x7f9548105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 --2- 172.21.15.139:0/1924175141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f95480ffac0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 -- 172.21.15.139:0/1924175141 >> 172.21.15.139:0/1924175141 conn(0x7f9548076790 msgr2=0x7f9548076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 -- 172.21.15.139:0/1924175141 shutdown_connections 2023-10-08T13:27:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.745+0000 7f954c968700 1 -- 172.21.15.139:0/1924175141 wait complete. 2023-10-08T13:27:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 Processor -- start 2023-10-08T13:27:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 -- start start 2023-10-08T13:27:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f9548197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.748 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548105630 0x7f95481a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481987e0 con 0x7f95480ff640 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481a2fe0 con 0x7f9548100000 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954c968700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481a3120 con 0x7f9548105630 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:58186/0 (socket says 172.21.15.139:58186) 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 -- 172.21.15.139:0/2379760902 learned_addr learned my addr 172.21.15.139:0/2379760902 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f954659c700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f9548197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9546d9d700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548105630 0x7f95481a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.749 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 -- 172.21.15.139:0/2379760902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548105630 msgr2=0x7f95481a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548105630 0x7f95481a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 -- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 msgr2=0x7f9548197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f9548197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 -- 172.21.15.139:0/2379760902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0095f0 con 0x7f9548100000 2023-10-08T13:27:12.750 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.746+0000 7f9545d9b700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f953c005910 tx=0x7f953c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.748+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c01d070 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.748+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f953c022470 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.748+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95481a3350 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.748+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c017650 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.748+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95481a3820 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.749+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9548107c40 con 0x7f9548100000 2023-10-08T13:27:12.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.750+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f953c00fac0 con 0x7f9548100000 2023-10-08T13:27:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.751+0000 7f95377fe700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 0x7f95300a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.751+0000 7f954659c700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 0x7f95300a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.751+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f953c0ce420 con 0x7f9548100000 2023-10-08T13:27:12.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.751+0000 7f954659c700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 0x7f95300a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9538009be0 tx=0x7f9538009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:12.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.756+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f953c097650 con 0x7f9548100000 2023-10-08T13:27:12.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:12 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1555827956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:27:12.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:12 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/297323159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:12.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.947+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9548069250 con 0x7f9548100000 2023-10-08T13:27:12.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.948+0000 7f95377fe700 1 -- 172.21.15.139:0/2379760902 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f953c09ac70 con 0x7f9548100000 2023-10-08T13:27:12.949 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:27:12.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 msgr2=0x7f95300a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 0x7f95300a3a10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9538009be0 tx=0x7f9538009260 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 msgr2=0x7f9548197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f953c005910 tx=0x7f953c004730 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 shutdown_connections 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95300a1550 0x7f95300a3a10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9548105630 0x7f95481a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95480ff640 0x7f9548197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 --2- 172.21.15.139:0/2379760902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9548100000 0x7f9548197f60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 >> 172.21.15.139:0/2379760902 conn(0x7f9548076790 msgr2=0x7f95480fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 shutdown_connections 2023-10-08T13:27:12.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:12.950+0000 7f954c968700 1 -- 172.21.15.139:0/2379760902 wait complete. 2023-10-08T13:27:12.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:27:13.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 -- 172.21.15.139:0/1127520595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69800ffd90 msgr2=0x7f6980100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 --2- 172.21.15.139:0/1127520595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69800ffd90 0x7f6980100210 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f697c009990 tx=0x7f697c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 -- 172.21.15.139:0/1127520595 shutdown_connections 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 --2- 172.21.15.139:0/1127520595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6980100750 0x7f698010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 --2- 172.21.15.139:0/1127520595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 --2- 172.21.15.139:0/1127520595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69800ffd90 0x7f6980100210 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 -- 172.21.15.139:0/1127520595 >> 172.21.15.139:0/1127520595 conn(0x7f6980075c20 msgr2=0x7f69800fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 -- 172.21.15.139:0/1127520595 shutdown_connections 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.087+0000 7f6988347700 1 -- 172.21.15.139:0/1127520595 wait complete. 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 Processor -- start 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 -- start start 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 0x7f6980101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801a5030 con 0x7f6980100750 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801a51a0 con 0x7f6980105630 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f6988347700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801a5360 con 0x7f69800ffd90 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39680/0 (socket says 172.21.15.139:39680) 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 -- 172.21.15.139:0/3467069409 learned_addr learned my addr 172.21.15.139:0/3467069409 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69860e3700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 0x7f6980101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69868e4700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 -- 172.21.15.139:0/3467069409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 msgr2=0x7f6980101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 0x7f6980101230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 -- 172.21.15.139:0/3467069409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 msgr2=0x7f6980101cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980101cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 -- 172.21.15.139:0/3467069409 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0095f0 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69860e3700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 0x7f6980101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69868e4700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69858e2700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f697c000c00 tx=0x7f697c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.088+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c01d070 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.089+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f697c00fde0 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.089+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69801a55e0 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.089+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c017770 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.089+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69801a5b10 con 0x7f6980100750 2023-10-08T13:27:13.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.089+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980100da0 con 0x7f6980100750 2023-10-08T13:27:13.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.091+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f697c022aa0 con 0x7f6980100750 2023-10-08T13:27:13.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.091+0000 7f69777fe700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 0x7f696c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.091+0000 7f69860e3700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 0x7f696c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.091+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f697c0ce590 con 0x7f6980100750 2023-10-08T13:27:13.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.092+0000 7f69860e3700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 0x7f696c0a3a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6970005fd0 tx=0x7f6970005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:12 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1555827956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:27:13.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:12 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/297323159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:13.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.095+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f697c05d100 con 0x7f6980100750 2023-10-08T13:27:13.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:12 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1555827956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T13:27:13.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:12 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/297323159' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:13.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.288+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f698010f510 con 0x7f6980100750 2023-10-08T13:27:13.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.289+0000 7f69777fe700 1 -- 172.21.15.139:0/3467069409 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f697c097820 con 0x7f6980100750 2023-10-08T13:27:13.290 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 msgr2=0x7f696c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 0x7f696c0a3a10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6970005fd0 tx=0x7f6970005db0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 msgr2=0x7f6980101770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f697c000c00 tx=0x7f697c00f880 comp rx=0 tx=0).stop 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 shutdown_connections 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f696c0a1550 0x7f696c0a3a10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6980105630 0x7f6980101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69800ffd90 0x7f6980101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 --2- 172.21.15.139:0/3467069409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6980100750 0x7f6980101770 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 >> 172.21.15.139:0/3467069409 conn(0x7f6980075c20 msgr2=0x7f69800fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 shutdown_connections 2023-10-08T13:27:13.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.291+0000 7f6988347700 1 -- 172.21.15.139:0/3467069409 wait complete. 2023-10-08T13:27:13.304 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:27:13.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- 172.21.15.139:0/373685978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91781056b0 msgr2=0x7f9178105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 --2- 172.21.15.139:0/373685978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91781056b0 0x7f9178105a90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9168009990 tx=0x7f9168009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- 172.21.15.139:0/373685978 shutdown_connections 2023-10-08T13:27:13.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 --2- 172.21.15.139:0/373685978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91780fffe0 0x7f917810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 --2- 172.21.15.139:0/373685978 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91781056b0 0x7f9178105a90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 --2- 172.21.15.139:0/373685978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780ff620 0x7f91780ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- 172.21.15.139:0/373685978 >> 172.21.15.139:0/373685978 conn(0x7f9178076780 msgr2=0x7f9178076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- 172.21.15.139:0/373685978 shutdown_connections 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- 172.21.15.139:0/373685978 wait complete. 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 Processor -- start 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.427+0000 7f917e70e700 1 -- start start 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 0x7f91781017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 0x7f9178101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781a4f30 con 0x7f91780ff620 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781a50a0 con 0x7f91781056b0 2023-10-08T13:27:13.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917e70e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91781a5260 con 0x7f91780fffe0 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39692/0 (socket says 172.21.15.139:39692) 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 -- 172.21.15.139:0/489586745 learned_addr learned my addr 172.21.15.139:0/489586745 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917ccab700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 0x7f9178101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f91777fe700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 0x7f91781017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 -- 172.21.15.139:0/489586745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 msgr2=0x7f91781017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 0x7f91781017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 -- 172.21.15.139:0/489586745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 msgr2=0x7f9178101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 0x7f9178101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 -- 172.21.15.139:0/489586745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680095f0 con 0x7f91780ff620 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f91777fe700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 0x7f91781017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:13.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f917ccab700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 0x7f9178101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.428+0000 7f9177fff700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f91680098e0 tx=0x7f916800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.429+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916801d070 con 0x7f91780ff620 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.429+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f916800fb90 con 0x7f91780ff620 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.429+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91781a54e0 con 0x7f91780ff620 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.429+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168017650 con 0x7f91780ff620 2023-10-08T13:27:13.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.429+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91781a59c0 con 0x7f91780ff620 2023-10-08T13:27:13.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.430+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9178100d50 con 0x7f91780ff620 2023-10-08T13:27:13.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.431+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f916800fd00 con 0x7f91780ff620 2023-10-08T13:27:13.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.431+0000 7f91757fa700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 0x7f91640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.431+0000 7f91777fe700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 0x7f91640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.431+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f91680ce640 con 0x7f91780ff620 2023-10-08T13:27:13.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.432+0000 7f91777fe700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 0x7f91640a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9160005d90 tx=0x7f9160005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.435+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f91680978d0 con 0x7f91780ff620 2023-10-08T13:27:13.625 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.624+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f917810f500 con 0x7f91780ff620 2023-10-08T13:27:13.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.625+0000 7f91757fa700 1 -- 172.21.15.139:0/489586745 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f916809aef0 con 0x7f91780ff620 2023-10-08T13:27:13.626 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 msgr2=0x7f91640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 0x7f91640a3990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9160005d90 tx=0x7f9160005d00 comp rx=0 tx=0).stop 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 msgr2=0x7f91781012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f91680098e0 tx=0x7f916800f720 comp rx=0 tx=0).stop 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 shutdown_connections 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f91640a14d0 0x7f91640a3990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91781056b0 0x7f9178101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f91780ff620 0x7f91781012b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 --2- 172.21.15.139:0/489586745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91780fffe0 0x7f91781017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 >> 172.21.15.139:0/489586745 conn(0x7f9178076780 msgr2=0x7f91780fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 shutdown_connections 2023-10-08T13:27:13.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.627+0000 7f917e70e700 1 -- 172.21.15.139:0/489586745 wait complete. 2023-10-08T13:27:13.640 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:27:13.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- 172.21.15.139:0/3527828659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 msgr2=0x7f5d1410d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/3527828659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d1410d610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00b0a0 tx=0x7f5d0c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- 172.21.15.139:0/3527828659 shutdown_connections 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/3527828659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d1410d610 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/3527828659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14106750 0x7f5d14106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/3527828659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14100740 0x7f5d14100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- 172.21.15.139:0/3527828659 >> 172.21.15.139:0/3527828659 conn(0x7f5d140fc230 msgr2=0x7f5d140fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- 172.21.15.139:0/3527828659 shutdown_connections 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- 172.21.15.139:0/3527828659 wait complete. 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 Processor -- start 2023-10-08T13:27:13.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- start start 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 0x7f5d14072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14106750 0x7f5d14073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141a4e60 con 0x7f5d14101100 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141a4fd0 con 0x7f5d14106750 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.764+0000 7f5d1aebe700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141a5190 con 0x7f5d14100740 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39708/0 (socket says 172.21.15.139:39708) 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 -- 172.21.15.139:0/951081536 learned_addr learned my addr 172.21.15.139:0/951081536 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d1945b700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14106750 0x7f5d14073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d18c5a700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 0x7f5d14072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.768 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 -- 172.21.15.139:0/951081536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 msgr2=0x7f5d14072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 0x7f5d14072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 -- 172.21.15.139:0/951081536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14106750 msgr2=0x7f5d14073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14106750 0x7f5d14073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 -- 172.21.15.139:0/951081536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c009d00 con 0x7f5d14101100 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d18c5a700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 0x7f5d14072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d13fff700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000c9b0 tx=0x7f5d0000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00007b00 con 0x7f5d14101100 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d141a5470 con 0x7f5d14101100 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d00007c60 con 0x7f5d14101100 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00018660 con 0x7f5d14101100 2023-10-08T13:27:13.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.765+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d141a5980 con 0x7f5d14101100 2023-10-08T13:27:13.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.767+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14108d40 con 0x7f5d14101100 2023-10-08T13:27:13.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.768+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5d0000f450 con 0x7f5d14101100 2023-10-08T13:27:13.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.768+0000 7f5d11ffb700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 0x7f5d040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:13.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.768+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5d000cd620 con 0x7f5d14101100 2023-10-08T13:27:13.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.768+0000 7f5d18c5a700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 0x7f5d040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:13.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.769+0000 7f5d18c5a700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 0x7f5d040a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d08005fd0 tx=0x7f5d08005db0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:13.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.772+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5d00096820 con 0x7f5d14101100 2023-10-08T13:27:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:13 smithi139 ceph-mon[99506]: pgmap v291: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 127 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:13 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2379760902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:13 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3467069409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:13 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/489586745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:13.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.963+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d14073f80 con 0x7f5d14101100 2023-10-08T13:27:13.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.963+0000 7f5d11ffb700 1 -- 172.21.15.139:0/951081536 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d00099e40 con 0x7f5d14101100 2023-10-08T13:27:13.965 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 msgr2=0x7f5d040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 0x7f5d040a3990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d08005fd0 tx=0x7f5d08005db0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 msgr2=0x7f5d14073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000c9b0 tx=0x7f5d0000ccc0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 shutdown_connections 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5d040a14d0 0x7f5d040a3990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d14106750 0x7f5d14073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d14100740 0x7f5d14072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 --2- 172.21.15.139:0/951081536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d14101100 0x7f5d14073030 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:13.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 >> 172.21.15.139:0/951081536 conn(0x7f5d140fc230 msgr2=0x7f5d140fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:13.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 shutdown_connections 2023-10-08T13:27:13.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:13.966+0000 7f5d1aebe700 1 -- 172.21.15.139:0/951081536 wait complete. 2023-10-08T13:27:13.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:27:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:13 smithi155 ceph-mon[103467]: pgmap v291: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 127 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:13 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2379760902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:13 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3467069409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:13 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/489586745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 -- 172.21.15.139:0/284927379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95640fff00 msgr2=0x7f956410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 --2- 172.21.15.139:0/284927379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95640fff00 0x7f956410c3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f955c00b0d0 tx=0x7f955c00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 -- 172.21.15.139:0/284927379 shutdown_connections 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 --2- 172.21.15.139:0/284927379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95640fff00 0x7f956410c3c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 --2- 172.21.15.139:0/284927379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564105600 0x7f95641059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 --2- 172.21.15.139:0/284927379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 0x7f95640ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 -- 172.21.15.139:0/284927379 >> 172.21.15.139:0/284927379 conn(0x7f95640fb030 msgr2=0x7f95640fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 -- 172.21.15.139:0/284927379 shutdown_connections 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.099+0000 7f956c28e700 1 -- 172.21.15.139:0/284927379 wait complete. 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 Processor -- start 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 -- start start 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 0x7f9564196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95640fff00 0x7f9564196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419b920 con 0x7f9564105600 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419ba90 con 0x7f95640ff540 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956c28e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956419bc50 con 0x7f95640fff00 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39724/0 (socket says 172.21.15.139:39724) 2023-10-08T13:27:14.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 -- 172.21.15.139:0/3173657449 learned_addr learned my addr 172.21.15.139:0/3173657449 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a02a700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 0x7f9564196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f9569829700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95640fff00 0x7f9564196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 -- 172.21.15.139:0/3173657449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95640fff00 msgr2=0x7f9564196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95640fff00 0x7f9564196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 -- 172.21.15.139:0/3173657449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 msgr2=0x7f9564196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 0x7f9564196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 -- 172.21.15.139:0/3173657449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c009d00 con 0x7f9564105600 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f956a82b700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f955c007fd0 tx=0x7f955c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.100+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00e040 con 0x7f9564105600 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.101+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f955c007950 con 0x7f9564105600 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.101+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956419bed0 con 0x7f9564105600 2023-10-08T13:27:14.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.101+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c01b6b0 con 0x7f9564105600 2023-10-08T13:27:14.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.101+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95641a37e0 con 0x7f9564105600 2023-10-08T13:27:14.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.101+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9564100c60 con 0x7f9564105600 2023-10-08T13:27:14.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.102+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f955c005050 con 0x7f9564105600 2023-10-08T13:27:14.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.103+0000 7f95577fe700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 0x7f95500a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.103+0000 7f956a02a700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 0x7f95500a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.103+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f955c0cebc0 con 0x7f9564105600 2023-10-08T13:27:14.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.104+0000 7f956a02a700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 0x7f95500a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f956000ac50 tx=0x7f956000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.107+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f955c097e50 con 0x7f9564105600 2023-10-08T13:27:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:13 smithi187 ceph-mon[104336]: pgmap v291: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 127 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:13 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2379760902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:13 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3467069409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:13 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/489586745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:14.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.342+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9564197de0 con 0x7f9564105600 2023-10-08T13:27:14.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.343+0000 7f95577fe700 1 -- 172.21.15.139:0/3173657449 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f955c09b470 con 0x7f9564105600 2023-10-08T13:27:14.344 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:14.344 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:27:14.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 msgr2=0x7f95500a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 0x7f95500a3990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f956000ac50 tx=0x7f956000a380 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 msgr2=0x7f956419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f955c007fd0 tx=0x7f955c0094c0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 shutdown_connections 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a14d0 0x7f95500a3990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564105600 0x7f956419b350 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95640ff540 0x7f9564196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 --2- 172.21.15.139:0/3173657449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95640fff00 0x7f9564196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 >> 172.21.15.139:0/3173657449 conn(0x7f95640fb030 msgr2=0x7f95640fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 shutdown_connections 2023-10-08T13:27:14.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.345+0000 7f956c28e700 1 -- 172.21.15.139:0/3173657449 wait complete. 2023-10-08T13:27:14.348 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:27:14.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:14.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.480+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/688435879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0ff540 msgr2=0x7f6cbc0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.480+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/688435879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc0ff9c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00099c0 tx=0x7f6cb0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/688435879 shutdown_connections 2023-10-08T13:27:14.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/688435879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/688435879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 0x7f6cbc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/688435879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc0ff9c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/688435879 >> 172.21.15.139:0/688435879 conn(0x7f6cbc0fb030 msgr2=0x7f6cbc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/688435879 shutdown_connections 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/688435879 wait complete. 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 Processor -- start 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.481+0000 7f6cc1f4e700 1 -- start start 2023-10-08T13:27:14.485 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc101520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 0x7f6cbc101fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1a4e30 con 0x7f6cbc0fff00 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1a4fa0 con 0x7f6cbc0ff540 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1a5160 con 0x7f6cbc105600 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39736/0 (socket says 172.21.15.139:39736) 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 -- 172.21.15.139:0/1398452667 learned_addr learned my addr 172.21.15.139:0/1398452667 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:14.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbb7fe700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc101520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbbfff700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 0x7f6cbc101fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 -- 172.21.15.139:0/1398452667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 msgr2=0x7f6cbc101fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 0x7f6cbc101fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 -- 172.21.15.139:0/1398452667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0ff540 msgr2=0x7f6cbc101520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc101520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 -- 172.21.15.139:0/1398452667 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00095f0 con 0x7f6cbc0fff00 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cbaffd700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b580 tx=0x7f6cb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb001d070 con 0x7f6cbc0fff00 2023-10-08T13:27:14.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc1a53e0 con 0x7f6cbc0fff00 2023-10-08T13:27:14.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cb000fb30 con 0x7f6cbc0fff00 2023-10-08T13:27:14.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0022c80 con 0x7f6cbc0fff00 2023-10-08T13:27:14.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.482+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc1a5800 con 0x7f6cbc0fff00 2023-10-08T13:27:14.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.483+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc100c60 con 0x7f6cbc0fff00 2023-10-08T13:27:14.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.484+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f6cb000fca0 con 0x7f6cbc0fff00 2023-10-08T13:27:14.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.485+0000 7f6cb8ff9700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 0x7f6ca40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.485+0000 7f6cbb7fe700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 0x7f6ca40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.485+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6cb00ce360 con 0x7f6cbc0fff00 2023-10-08T13:27:14.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.486+0000 7f6cbb7fe700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 0x7f6ca40a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cac005950 tx=0x7f6cac00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.489+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6cb00975f0 con 0x7f6cbc0fff00 2023-10-08T13:27:14.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.686+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cbc067450 con 0x7f6cbc0fff00 2023-10-08T13:27:14.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.687+0000 7f6cb8ff9700 1 -- 172.21.15.139:0/1398452667 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7f6cb009ac10 con 0x7f6cbc0fff00 2023-10-08T13:27:14.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:14.689 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.689+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 msgr2=0x7f6ca40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 0x7f6ca40a3990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cac005950 tx=0x7f6cac00b410 comp rx=0 tx=0).stop 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 msgr2=0x7f6cbc101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b580 tx=0x7f6cb0004730 comp rx=0 tx=0).stop 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 shutdown_connections 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f6ca40a14d0 0x7f6ca40a3990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cbc105600 0x7f6cbc101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cbc0ff540 0x7f6cbc101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 --2- 172.21.15.139:0/1398452667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cbc0fff00 0x7f6cbc101a60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 >> 172.21.15.139:0/1398452667 conn(0x7f6cbc0fb030 msgr2=0x7f6cbc103840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 shutdown_connections 2023-10-08T13:27:14.692 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.690+0000 7f6cc1f4e700 1 -- 172.21.15.139:0/1398452667 wait complete. 2023-10-08T13:27:14.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:27:14.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:27:14.831 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 -- 172.21.15.139:0/1622400502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980ff620 msgr2=0x7fb1980ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.831 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1622400502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980ff620 0x7fb1980ffaa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb194009990 tx=0x7fb194009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 -- 172.21.15.139:0/1622400502 shutdown_connections 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1622400502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1980fffe0 0x7fb19810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1622400502 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1981056b0 0x7fb198105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1622400502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980ff620 0x7fb1980ffaa0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 -- 172.21.15.139:0/1622400502 >> 172.21.15.139:0/1622400502 conn(0x7fb198076780 msgr2=0x7fb198076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 -- 172.21.15.139:0/1622400502 shutdown_connections 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.828+0000 7fb1a02da700 1 -- 172.21.15.139:0/1622400502 wait complete. 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 Processor -- start 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 -- start start 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1980ff620 0x7fb198197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.832 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1981056b0 0x7fb198198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981a2cc0 con 0x7fb1980fffe0 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981a2e30 con 0x7fb1981056b0 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb1a02da700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981a2ff0 con 0x7fb1980ff620 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb19d875700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb19d875700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39750/0 (socket says 172.21.15.139:39750) 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.829+0000 7fb19d875700 1 -- 172.21.15.139:0/1142210070 learned_addr learned my addr 172.21.15.139:0/1142210070 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19e076700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1980ff620 0x7fb198197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19e877700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1981056b0 0x7fb198198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 -- 172.21.15.139:0/1142210070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1980ff620 msgr2=0x7fb198197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1980ff620 0x7fb198197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 -- 172.21.15.139:0/1142210070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1981056b0 msgr2=0x7fb198198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1981056b0 0x7fb198198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 -- 172.21.15.139:0/1142210070 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940095f0 con 0x7fb1980fffe0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb19d875700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb1940095c0 tx=0x7fb19400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19401d070 con 0x7fb1980fffe0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1981a3270 con 0x7fb1980fffe0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1940054f0 con 0x7fb1980fffe0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194004c40 con 0x7fb1980fffe0 2023-10-08T13:27:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.830+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1981a3750 con 0x7fb1980fffe0 2023-10-08T13:27:14.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.831+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198107c30 con 0x7fb1980fffe0 2023-10-08T13:27:14.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.832+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb19400fc30 con 0x7fb1980fffe0 2023-10-08T13:27:14.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.833+0000 7fb18f7fe700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 0x7fb1840a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:14.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.833+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb1940ce400 con 0x7fb1980fffe0 2023-10-08T13:27:14.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.833+0000 7fb19e076700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 0x7fb1840a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:14.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.833+0000 7fb19e076700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 0x7fb1840a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb188005950 tx=0x7fb1880058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:14.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:14.836+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb194097690 con 0x7fb1980fffe0 2023-10-08T13:27:15.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.026+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb198067df0 con 0x7fb1980fffe0 2023-10-08T13:27:15.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.026+0000 7fb18f7fe700 1 -- 172.21.15.139:0/1142210070 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb19409acb0 con 0x7fb1980fffe0 2023-10-08T13:27:15.027 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:27:15.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 msgr2=0x7fb1840a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 0x7fb1840a3990 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb188005950 tx=0x7fb1880058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 msgr2=0x7fb198197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb1940095c0 tx=0x7fb19400f740 comp rx=0 tx=0).stop 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 shutdown_connections 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb1840a14d0 0x7fb1840a3990 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1981056b0 0x7fb198198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1980ff620 0x7fb198197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 --2- 172.21.15.139:0/1142210070 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1980fffe0 0x7fb198197f40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 >> 172.21.15.139:0/1142210070 conn(0x7fb198076780 msgr2=0x7fb1980fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 shutdown_connections 2023-10-08T13:27:15.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.028+0000 7fb1a02da700 1 -- 172.21.15.139:0/1142210070 wait complete. 2023-10-08T13:27:15.040 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:14 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/951081536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:15.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:14 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3173657449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:14 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1398452667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.042 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:27:15.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:14 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/951081536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:15.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:14 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3173657449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:14 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1398452667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.168 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 -- 172.21.15.139:0/1153043047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ffa70 msgr2=0x7fb6ec10bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1153043047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec10bc80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400b0d0 tx=0x7fb6e400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 -- 172.21.15.139:0/1153043047 shutdown_connections 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1153043047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec10bc80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1153043047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec103df0 0x7fb6ec1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1153043047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 -- 172.21.15.139:0/1153043047 >> 172.21.15.139:0/1153043047 conn(0x7fb6ec074940 msgr2=0x7fb6ec074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 -- 172.21.15.139:0/1153043047 shutdown_connections 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.165+0000 7fb6f1388700 1 -- 172.21.15.139:0/1153043047 wait complete. 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 Processor -- start 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 -- start start 2023-10-08T13:27:15.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec103df0 0x7fb6ec195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec196080 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1961f0 con 0x7fb6ec103df0 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6f1388700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec1963b0 con 0x7fb6ec0ffa70 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6eaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6eaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39762/0 (socket says 172.21.15.139:39762) 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.166+0000 7fb6eaffd700 1 -- 172.21.15.139:0/1807163126 learned_addr learned my addr 172.21.15.139:0/1807163126 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6ea7fc700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eb7fe700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec103df0 0x7fb6ec195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 -- 172.21.15.139:0/1807163126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 msgr2=0x7fb6ec19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 -- 172.21.15.139:0/1807163126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec103df0 msgr2=0x7fb6ec195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec103df0 0x7fb6ec195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 -- 172.21.15.139:0/1807163126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009d00 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6ea7fc700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6eaffd700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d980 tx=0x7fb6dc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00bb60 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec196690 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec1a2890 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6dc007620 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.167+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc01b6b0 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.168+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc0052f0 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.169+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fb6dc00bcc0 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.170+0000 7fb6e3fff700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 0x7fb6d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.170+0000 7fb6ea7fc700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 0x7fb6d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.170+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb6dc0cd0f0 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.170+0000 7fb6ea7fc700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 0x7fb6d80a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4005950 tx=0x7fb6d40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.174+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb6dc099d80 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:14 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/951081536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:15.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:14 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3173657449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:14 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1398452667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:15.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.366+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6cc005b20 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.366+0000 7fb6e3fff700 1 -- 172.21.15.139:0/1807163126 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb6dc00de60 con 0x7fb6ec0ff0b0 2023-10-08T13:27:15.367 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:15.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 msgr2=0x7fb6d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 0x7fb6d80a3990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4005950 tx=0x7fb6d40058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 msgr2=0x7fb6ec19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00d980 tx=0x7fb6dc00dd40 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 shutdown_connections 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6d80a14d0 0x7fb6d80a3990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6ec103df0 0x7fb6ec195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb6ec0ff0b0 0x7fb6ec19b8a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 --2- 172.21.15.139:0/1807163126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6ec0ffa70 0x7fb6ec19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 >> 172.21.15.139:0/1807163126 conn(0x7fb6ec074940 msgr2=0x7fb6ec0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 shutdown_connections 2023-10-08T13:27:15.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.368+0000 7fb6f1388700 1 -- 172.21.15.139:0/1807163126 wait complete. 2023-10-08T13:27:15.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:27:15.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- 172.21.15.139:0/3405659535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57180ff620 msgr2=0x7f57180ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 --2- 172.21.15.139:0/3405659535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57180ff620 0x7f57180ffaa0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f570c009990 tx=0x7f570c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- 172.21.15.139:0/3405659535 shutdown_connections 2023-10-08T13:27:15.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 --2- 172.21.15.139:0/3405659535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 0x7f571810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 --2- 172.21.15.139:0/3405659535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57181056b0 0x7f5718105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 --2- 172.21.15.139:0/3405659535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57180ff620 0x7f57180ffaa0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- 172.21.15.139:0/3405659535 >> 172.21.15.139:0/3405659535 conn(0x7f5718076780 msgr2=0x7f5718076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- 172.21.15.139:0/3405659535 shutdown_connections 2023-10-08T13:27:15.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- 172.21.15.139:0/3405659535 wait complete. 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 Processor -- start 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.506+0000 7f571ccae700 1 -- start start 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57180ff620 0x7f57181012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 0x7f57181017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57181a4e90 con 0x7f57181056b0 2023-10-08T13:27:15.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57181a5000 con 0x7f57180ff620 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57181a51c0 con 0x7f57180fffe0 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39780/0 (socket says 172.21.15.139:39780) 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 -- 172.21.15.139:0/4216468349 learned_addr learned my addr 172.21.15.139:0/4216468349 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5715d9b700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 0x7f57181017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571659c700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57180ff620 0x7f57181012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 -- 172.21.15.139:0/4216468349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 msgr2=0x7f57181017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 0x7f57181017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 -- 172.21.15.139:0/4216468349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57180ff620 msgr2=0x7f57181012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57180ff620 0x7f57181012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 -- 172.21.15.139:0/4216468349 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0095f0 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f5716d9d700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f571000ef30 tx=0x7f571000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710018070 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f571000f040 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57181a5440 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.507+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000cd00 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.508+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57181a58d0 con 0x7f57181056b0 2023-10-08T13:27:15.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.509+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5718100d50 con 0x7f57181056b0 2023-10-08T13:27:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.510+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5710003a00 con 0x7f57181056b0 2023-10-08T13:27:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.510+0000 7f57077fe700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 0x7f57000a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.510+0000 7f571659c700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 0x7f57000a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.510+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f57100ccd30 con 0x7f57181056b0 2023-10-08T13:27:15.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.511+0000 7f571659c700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 0x7f57000a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5718077ab0 tx=0x7f5708007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.515+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5710095fc0 con 0x7f57181056b0 2023-10-08T13:27:15.705 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.704+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5718102810 con 0x7f57181056b0 2023-10-08T13:27:15.706 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.705+0000 7f57077fe700 1 -- 172.21.15.139:0/4216468349 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57100995e0 con 0x7f57181056b0 2023-10-08T13:27:15.706 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:27:15.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 msgr2=0x7f57000a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 0x7f57000a3990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5718077ab0 tx=0x7f5708007400 comp rx=0 tx=0).stop 2023-10-08T13:27:15.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 msgr2=0x7f5718101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f571000ef30 tx=0x7f571000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 shutdown_connections 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f57000a14d0 0x7f57000a3990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f57181056b0 0x7f5718101d30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57180ff620 0x7f57181012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 --2- 172.21.15.139:0/4216468349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57180fffe0 0x7f57181017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 >> 172.21.15.139:0/4216468349 conn(0x7f5718076780 msgr2=0x7f57180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 shutdown_connections 2023-10-08T13:27:15.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.707+0000 7f571ccae700 1 -- 172.21.15.139:0/4216468349 wait complete. 2023-10-08T13:27:15.720 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 -- 172.21.15.139:0/3295338280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c80ff320 msgr2=0x7f15c80ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 --2- 172.21.15.139:0/3295338280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c80ff320 0x7f15c80ff700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009990 tx=0x7f15b8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 -- 172.21.15.139:0/3295338280 shutdown_connections 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 --2- 172.21.15.139:0/3295338280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c8105b30 0x7f15c810d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 --2- 172.21.15.139:0/3295338280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c80ff320 0x7f15c80ff700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 --2- 172.21.15.139:0/3295338280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c80ffcd0 0x7f15c8105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 -- 172.21.15.139:0/3295338280 >> 172.21.15.139:0/3295338280 conn(0x7f15c8074940 msgr2=0x7f15c8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 -- 172.21.15.139:0/3295338280 shutdown_connections 2023-10-08T13:27:15.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.844+0000 7f15cd427700 1 -- 172.21.15.139:0/3295338280 wait complete. 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 Processor -- start 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 -- start start 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 0x7f15c8100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c8105b30 0x7f15c81007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c81a5450 con 0x7f15c8100d10 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c81a55c0 con 0x7f15c8105b30 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15cd427700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c81a5780 con 0x7f15c80ff320 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15c77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15c77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39794/0 (socket says 172.21.15.139:39794) 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.845+0000 7f15c77fe700 1 -- 172.21.15.139:0/1672042224 learned_addr learned my addr 172.21.15.139:0/1672042224 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:15.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c67fc700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c8105b30 0x7f15c81007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c6ffd700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 0x7f15c8100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 -- 172.21.15.139:0/1672042224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 msgr2=0x7f15c8100290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 0x7f15c8100290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 -- 172.21.15.139:0/1672042224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c8105b30 msgr2=0x7f15c81007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c8105b30 0x7f15c81007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 -- 172.21.15.139:0/1672042224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80095f0 con 0x7f15c8100d10 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c6ffd700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 0x7f15c8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15c77fe700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f15c0007ee0 tx=0x7f15c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000ddd0 con 0x7f15c8100d10 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c81a5a60 con 0x7f15c8100d10 2023-10-08T13:27:15.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15c000f040 con 0x7f15c8100d10 2023-10-08T13:27:15.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0015400 con 0x7f15c8100d10 2023-10-08T13:27:15.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.846+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c81a5f70 con 0x7f15c8100d10 2023-10-08T13:27:15.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.847+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c8108d20 con 0x7f15c8100d10 2023-10-08T13:27:15.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.848+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f15c0004000 con 0x7f15c8100d10 2023-10-08T13:27:15.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.849+0000 7f15bffff700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 0x7f15b40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:15.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.849+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f15c00cd2e0 con 0x7f15c8100d10 2023-10-08T13:27:15.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.849+0000 7f15c6ffd700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 0x7f15b40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:15.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.849+0000 7f15c6ffd700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 0x7f15b40a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15b8000c00 tx=0x7f15b8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:15.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:15.852+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f15c00964e0 con 0x7f15c8100d10 2023-10-08T13:27:16.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.043+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15c80687c0 con 0x7f15c8100d10 2023-10-08T13:27:16.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.043+0000 7f15bffff700 1 -- 172.21.15.139:0/1672042224 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15c00230a0 con 0x7f15c8100d10 2023-10-08T13:27:16.045 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 msgr2=0x7f15b40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 0x7f15b40a3990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f15b8000c00 tx=0x7f15b8005fb0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 msgr2=0x7f15c81a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f15c0007ee0 tx=0x7f15c000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 shutdown_connections 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f15b40a14d0 0x7f15b40a3990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c8100d10 0x7f15c81a4e80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f15c80ff320 0x7f15c8100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 --2- 172.21.15.139:0/1672042224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15c8105b30 0x7f15c81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 >> 172.21.15.139:0/1672042224 conn(0x7f15c8074940 msgr2=0x7f15c80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 shutdown_connections 2023-10-08T13:27:16.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.046+0000 7f15cd427700 1 -- 172.21.15.139:0/1672042224 wait complete. 2023-10-08T13:27:16.058 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:15 smithi139 ceph-mon[99506]: pgmap v292: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 10 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:16.058 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1142210070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.058 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1807163126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.058 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:15 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4216468349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:27:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:15 smithi155 ceph-mon[103467]: pgmap v292: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 10 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1142210070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1807163126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:15 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4216468349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3066044961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 msgr2=0x7fc9a010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3066044961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a010c3c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc99800b0d0 tx=0x7fc99800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3066044961 shutdown_connections 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3066044961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a010c3c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3066044961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 0x7fc9a01059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3066044961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 0x7fc9a00ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3066044961 >> 172.21.15.139:0/3066044961 conn(0x7fc9a00fb030 msgr2=0x7fc9a00fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3066044961 shutdown_connections 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.180+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3066044961 wait complete. 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 Processor -- start 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 -- start start 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 0x7fc9a01957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 0x7fc9a0196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01a4ee0 con 0x7fc9a00fff00 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01a5050 con 0x7fc9a0105600 2023-10-08T13:27:16.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a7ada700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01a5210 con 0x7fc9a00ff540 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39806/0 (socket says 172.21.15.139:39806) 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5876700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 0x7fc9a01957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 -- 172.21.15.139:0/3288179572 learned_addr learned my addr 172.21.15.139:0/3288179572 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a6077700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 0x7fc9a0196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 -- 172.21.15.139:0/3288179572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 msgr2=0x7fc9a01957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 0x7fc9a01957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 -- 172.21.15.139:0/3288179572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 msgr2=0x7fc9a0196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 0x7fc9a0196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 -- 172.21.15.139:0/3288179572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009d00 con 0x7fc9a00fff00 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc9a5075700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00c920 tx=0x7fc99c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.181+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c004a30 con 0x7fc9a00fff00 2023-10-08T13:27:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.182+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc99c0054e0 con 0x7fc9a00fff00 2023-10-08T13:27:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.182+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c007bd0 con 0x7fc9a00fff00 2023-10-08T13:27:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.182+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a01a54f0 con 0x7fc9a00fff00 2023-10-08T13:27:16.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.182+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a01a5a00 con 0x7fc9a00fff00 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.182+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0107aa0 con 0x7fc9a00fff00 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.184+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc99c007d50 con 0x7fc9a00fff00 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.184+0000 7fc996ffd700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 0x7fc98c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.184+0000 7fc9a5876700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 0x7fc98c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.184+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc99c0cd050 con 0x7fc9a00fff00 2023-10-08T13:27:16.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.185+0000 7fc9a5876700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 0x7fc98c0a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc990005950 tx=0x7fc99000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.188+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc99c0962d0 con 0x7fc9a00fff00 2023-10-08T13:27:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:15 smithi187 ceph-mon[104336]: pgmap v292: 129 pgs: 1 peering, 128 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 511 B/s wr, 10 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1142210070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1807163126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:15 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4216468349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:16.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.420+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a0100c60 con 0x7fc9a00fff00 2023-10-08T13:27:16.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.421+0000 7fc996ffd700 1 -- 172.21.15.139:0/3288179572 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7fc99c01d070 con 0x7fc9a00fff00 2023-10-08T13:27:16.422 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:16.422 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 msgr2=0x7fc98c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 0x7fc98c0a3a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc990005950 tx=0x7fc99000a300 comp rx=0 tx=0).stop 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 msgr2=0x7fc9a0195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00c920 tx=0x7fc99c00cc30 comp rx=0 tx=0).stop 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 shutdown_connections 2023-10-08T13:27:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc98c0a1550 0x7fc98c0a3a10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9a0105600 0x7fc9a0196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a00ff540 0x7fc9a01957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 --2- 172.21.15.139:0/3288179572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a00fff00 0x7fc9a0195d10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 >> 172.21.15.139:0/3288179572 conn(0x7fc9a00fb030 msgr2=0x7fc9a00fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 shutdown_connections 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.423+0000 7fc9a7ada700 1 -- 172.21.15.139:0/3288179572 wait complete. 2023-10-08T13:27:16.425 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:27:16.436 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:16.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- 172.21.15.139:0/3035202607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80ff550 msgr2=0x7f05e80ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- 172.21.15.139:0/3035202607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80ff550 0x7f05e80ff9d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f05d40099c0 tx=0x7f05d4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- 172.21.15.139:0/3035202607 shutdown_connections 2023-10-08T13:27:16.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- 172.21.15.139:0/3035202607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e80fff10 0x7f05e810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- 172.21.15.139:0/3035202607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e8105610 0x7f05e81059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- 172.21.15.139:0/3035202607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80ff550 0x7f05e80ff9d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- 172.21.15.139:0/3035202607 >> 172.21.15.139:0/3035202607 conn(0x7f05e80fb060 msgr2=0x7f05e80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- 172.21.15.139:0/3035202607 shutdown_connections 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- 172.21.15.139:0/3035202607 wait complete. 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 Processor -- start 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 -- start start 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e80ff550 0x7f05e819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.557+0000 7f05eee78700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05eee78700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8105610 0x7f05e8196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05eee78700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8196f70 con 0x7f05e80fff10 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05eee78700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81970e0 con 0x7f05e8105610 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05eee78700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81972a0 con 0x7f05e80ff550 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39820/0 (socket says 172.21.15.139:39820) 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 -- 172.21.15.139:0/3698344688 learned_addr learned my addr 172.21.15.139:0/3698344688 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05ed415700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8105610 0x7f05e8196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05ecc14700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e80ff550 0x7f05e819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 -- 172.21.15.139:0/3698344688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e80ff550 msgr2=0x7f05e819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e80ff550 0x7f05e819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 -- 172.21.15.139:0/3698344688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8105610 msgr2=0x7f05e8196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8105610 0x7f05e8196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 -- 172.21.15.139:0/3698344688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40095f0 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e7fff700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009990 tx=0x7f05d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d401d070 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05d400fb30 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8197520 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.558+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4003ee0 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.559+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81a37d0 con 0x7f05e80fff10 2023-10-08T13:27:16.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.559+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e8100c70 con 0x7f05e80fff10 2023-10-08T13:27:16.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.560+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f05d400fca0 con 0x7f05e80fff10 2023-10-08T13:27:16.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.561+0000 7f05e5ffb700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 0x7f05d80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.561+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f05d40ce210 con 0x7f05e80fff10 2023-10-08T13:27:16.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.561+0000 7f05ecc14700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 0x7f05d80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.561+0000 7f05ecc14700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 0x7f05d80a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005fd0 tx=0x7f05dc00a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.564+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05d40974a0 con 0x7f05e80fff10 2023-10-08T13:27:16.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.760+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05e80678a0 con 0x7f05e80fff10 2023-10-08T13:27:16.767 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.766+0000 7f05e5ffb700 1 -- 172.21.15.139:0/3698344688 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7f05d409aac0 con 0x7f05e80fff10 2023-10-08T13:27:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:16.767 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 msgr2=0x7f05d80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 0x7f05d80a3990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005fd0 tx=0x7f05dc00a560 comp rx=0 tx=0).stop 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 msgr2=0x7f05e819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009990 tx=0x7f05d4004730 comp rx=0 tx=0).stop 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 shutdown_connections 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f05d80a14d0 0x7f05d80a3990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8105610 0x7f05e8196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05e80ff550 0x7f05e819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 --2- 172.21.15.139:0/3698344688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05e80fff10 0x7f05e819cd20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 >> 172.21.15.139:0/3698344688 conn(0x7f05e80fb060 msgr2=0x7f05e80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 shutdown_connections 2023-10-08T13:27:16.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.769+0000 7f05eee78700 1 -- 172.21.15.139:0/3698344688 wait complete. 2023-10-08T13:27:16.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T13:25:33.853946+0000', 'modified': '2023-10-08T13:26:04.411259+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24628, 'mds_1': 24607, 'mds_2': 24599, 'mds_3': 24595, 'mds_4': 24566}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14772': {'gid': 14772, 'name': 'd', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6837/2085954073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2085954073}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2085954073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14826': {'gid': 14826, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6839/4169446012', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 4169446012}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 4169446012}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14838': {'gid': 14838, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6841/3823660758', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6840', 'nonce': 3823660758}, {'type': 'v1', 'addr': '172.21.15.139:6841', 'nonce': 3823660758}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24518': {'gid': 24518, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6833/3719268095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 3719268095}, {'type': 'v1', 'addr': '172.21.15.155:6833', 'nonce': 3719268095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24542': {'gid': 24542, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/4262434274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 4262434274}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 4262434274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24566': {'gid': 24566, 'name': 'h', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.155:6837/4218841185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 4218841185}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 4218841185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24595': {'gid': 24595, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.187:6835/3167078820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 3167078820}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 3167078820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.155:6839/4212065890', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 4212065890}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 4212065890}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24607': {'gid': 24607, 'name': 'c', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.187:6837/3566030950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 3566030950}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 3566030950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24628': {'gid': 24628, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.187:6839/3909111900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 3909111900}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 3909111900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T13:27:16.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T13:27:16.783 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 -- 172.21.15.139:0/2688015204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f80105630 msgr2=0x7f0f80105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 --2- 172.21.15.139:0/2688015204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f80105630 0x7f0f80105a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009990 tx=0x7f0f74009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 -- 172.21.15.139:0/2688015204 shutdown_connections 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 --2- 172.21.15.139:0/2688015204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80100000 0x7f0f8010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 --2- 172.21.15.139:0/2688015204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f80105630 0x7f0f80105a10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 --2- 172.21.15.139:0/2688015204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f800ff640 0x7f0f800ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 -- 172.21.15.139:0/2688015204 >> 172.21.15.139:0/2688015204 conn(0x7f0f80076790 msgr2=0x7f0f80076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 -- 172.21.15.139:0/2688015204 shutdown_connections 2023-10-08T13:27:16.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.905+0000 7f0f86d76700 1 -- 172.21.15.139:0/2688015204 wait complete. 2023-10-08T13:27:16.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 Processor -- start 2023-10-08T13:27:16.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 -- start start 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 0x7f0f8019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80105630 0x7f0f801958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80195f40 con 0x7f0f800ff640 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f801960b0 con 0x7f0f80105630 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f86d76700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f80196270 con 0x7f0f80100000 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f84b12700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f84b12700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39832/0 (socket says 172.21.15.139:39832) 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.906+0000 7f0f84b12700 1 -- 172.21.15.139:0/3709809674 learned_addr learned my addr 172.21.15.139:0/3709809674 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 0x7f0f8019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f85313700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80105630 0x7f0f801958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 -- 172.21.15.139:0/3709809674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 msgr2=0x7f0f8019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 0x7f0f8019bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 -- 172.21.15.139:0/3709809674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80105630 msgr2=0x7f0f801958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80105630 0x7f0f801958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 -- 172.21.15.139:0/3709809674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740095f0 con 0x7f0f800ff640 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 0x7f0f8019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:16.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f84b12700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f740095c0 tx=0x7f0f7400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f7dffb700 1 -- 172.21.15.139:0/3709809674 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7401d070 con 0x7f0f800ff640 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f7dffb700 1 -- 172.21.15.139:0/3709809674 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f740054f0 con 0x7f0f800ff640 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f801964f0 con 0x7f0f800ff640 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f7dffb700 1 -- 172.21.15.139:0/3709809674 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74004c40 con 0x7f0f800ff640 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.907+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f801a27a0 con 0x7f0f800ff640 2023-10-08T13:27:16.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.909+0000 7f0f7dffb700 1 -- 172.21.15.139:0/3709809674 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0f7400fc30 con 0x7f0f800ff640 2023-10-08T13:27:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.910+0000 7f0f7dffb700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 0x7f0f700a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.910+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 0x7f0f700a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.910+0000 7f0f7dffb700 1 -- 172.21.15.139:0/3709809674 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0f740cdfe0 con 0x7f0f800ff640 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 0x7f0f700a3990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c005950 tx=0x7f0f6c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 Processor -- start 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 -- start start 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 0x55a35253c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a35253c600 0x55a35253e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35249a410 con 0x55a352530e30 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35248bbd0 con 0x55a352531750 2023-10-08T13:27:16.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3524894f0 con 0x55a35253c600 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f84b12700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f84b12700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39840/0 (socket says 172.21.15.139:39840) 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.911+0000 7f0f84b12700 1 -- 172.21.15.139:0/1858688818 learned_addr learned my addr 172.21.15.139:0/1858688818 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 0x55a35253c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 -- 172.21.15.139:0/1858688818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a35253c600 msgr2=0x55a35253e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a35253c600 0x55a35253e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 -- 172.21.15.139:0/1858688818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 msgr2=0x55a35253c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 0x55a35253c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 -- 172.21.15.139:0/1858688818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3522afd90 con 0x55a352530e30 2023-10-08T13:27:16.920 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 0x55a35253c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f74097430 tx=0x7f0f7409a910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91807450caa97335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f6affd700 1 -- 172.21.15.139:0/1858688818 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7409b630 con 0x55a352530e30 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f6affd700 1 -- 172.21.15.139:0/1858688818 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f7409af30 con 0x55a352530e30 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.912+0000 7f0f6affd700 1 -- 172.21.15.139:0/1858688818 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7409a680 con 0x55a352530e30 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1858688818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 msgr2=0x55a352531210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f74097430 tx=0x7f0f7409a910 comp rx=0 tx=0).stop 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1858688818 shutdown_connections 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a35253c600 0x55a35253e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1858688818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352531750 0x55a35253c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1858688818 >> 172.21.15.139:0/1858688818 conn(0x55a3524a6210 msgr2=0x55a35252d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1858688818 shutdown_connections 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1858688818 wait complete. 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 -- start start 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 Processor -- start 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.913+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a35253c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352484de0 con 0x55a352531750 2023-10-08T13:27:16.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3524216c0 con 0x55a35253c600 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352421360 con 0x55a352530e30 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 10 client.0 _ll_register_callbacks cb 0x55a35227e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39848/0 (socket says 172.21.15.139:39848) 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 -- 172.21.15.139:0/4071539279 learned_addr learned my addr 172.21.15.139:0/4071539279 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f84b12700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a35253c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 -- 172.21.15.139:0/4071539279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 msgr2=0x55a35253c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a35253c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f85313700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 -- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 msgr2=0x55a35253d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 -- 172.21.15.139:0/4071539279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f801a27a0 con 0x55a352531750 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f84b12700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a35253c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f85313700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c010000 tx=0x7f0f6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d846c330bae989 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c017040 con 0x55a352531750 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0f6c003a90 con 0x55a352531750 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a35244ce60 con 0x55a352531750 2023-10-08T13:27:16.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f6c003c50 con 0x55a352531750 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 10 client.15633 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.914+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a352298c10 con 0x55a352531750 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a35244ce60 con 0x55a352531750 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f6c01f430 con 0x55a352531750 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 10 client.15633 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 10 client.15633 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 20 client.15633 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a35254be50 0x55a35254a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 4 client.15633 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:16.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a35247ddc0 con 0x55a35254be50 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.915+0000 7f0f84b12700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a35254be50 0x55a35254a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.916+0000 7f0f5ffff700 10 client.15633 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.916+0000 7f0f84b12700 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a35254be50 0x55a35254a8c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea6402faee73101e server_cookie=5c44f1a37395e901 in_seq=0 out_seq=0 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.916+0000 7f0f5ffff700 1 -- 172.21.15.139:0/4071539279 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a35247ddc0 con 0x55a35254be50 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.916+0000 7f0f5ffff700 10 client.15633 handle_command_reply: tid=0 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.916+0000 7f0f92f5fb80 1 client.15633 shutdown 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 msgr2=0x55a35253cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c010000 tx=0x7f0f6c004750 comp rx=0 tx=0).stop 2023-10-08T13:27:16.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 shutdown_connections 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a35254be50 0x55a35254a8c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a35253c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/4071539279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a35253cf20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f5ffff700 0 client.15633 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 >> 172.21.15.139:0/4071539279 conn(0x55a3524a6210 msgr2=0x55a35252ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 shutdown_connections 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/4071539279 wait complete. 2023-10-08T13:27:16.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.917+0000 7f0f92f5fb80 20 client.15633 trim_cache size 0 max 16384 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 Processor -- start 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 -- start start 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3523058d0 con 0x55a352531750 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352480ed0 con 0x55a35253c600 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.934+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35242b4d0 con 0x55a352530e30 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39856/0 (socket says 172.21.15.139:39856) 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 -- 172.21.15.139:0/3637162363 learned_addr learned my addr 172.21.15.139:0/3637162363 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f84b12700 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 -- 172.21.15.139:0/3637162363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 msgr2=0x55a352531210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 -- 172.21.15.139:0/3637162363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 msgr2=0x55a35253b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 -- 172.21.15.139:0/3637162363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3522d6200 con 0x55a352531750 2023-10-08T13:27:16.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01f760 tx=0x7f0f6c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8ba2d768b20bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f6b7fe700 1 -- 172.21.15.139:0/3637162363 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00ba00 con 0x55a352531750 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f6b7fe700 1 -- 172.21.15.139:0/3637162363 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f6c004470 con 0x55a352531750 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.935+0000 7f0f6b7fe700 1 -- 172.21.15.139:0/3637162363 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0119a0 con 0x55a352531750 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/3637162363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 msgr2=0x55a3525547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c01f760 tx=0x7f0f6c00b4c0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/3637162363 shutdown_connections 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a35253c600 0x55a35253b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352530e30 0x55a352531210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/3637162363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a352531750 0x55a3525547d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/3637162363 >> 172.21.15.139:0/3637162363 conn(0x55a3524a6210 msgr2=0x55a352535f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/3637162363 shutdown_connections 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/3637162363 wait complete. 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 -- start start 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.936+0000 7f0f92f5fb80 1 Processor -- start 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 0x55a3525517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352531750 0x55a352551d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352554b30 con 0x55a35253c600 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352554ca0 con 0x55a352530e30 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35259f850 con 0x55a352531750 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 10 client.0 _ll_register_callbacks cb 0x7f0f6c00fbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39864/0 (socket says 172.21.15.139:39864) 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 -- 172.21.15.139:0/1891989243 learned_addr learned my addr 172.21.15.139:0/1891989243 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f7ffff700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352531750 0x55a352551d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 0x55a3525517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 -- 172.21.15.139:0/1891989243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352531750 msgr2=0x55a352551d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352531750 0x55a352551d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 -- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 msgr2=0x55a3525517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 0x55a3525517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 -- 172.21.15.139:0/1891989243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a352298c10 con 0x55a35253c600 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 0x55a3525517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f85313700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f780077b0 tx=0x7f0f78007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bc3d434fc4b104 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:16.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f5ffff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78004bb0 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0f78004d10 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f7409af30 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f78015610 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 10 client.15639 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.937+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a3522ae260 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f7409af30 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f7801eab0 con 0x55a35253c600 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 10 client.15639 resolve_mds: resolved name 'h' to daemon mds.h 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 20 client.15639 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:16.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a3525a4c80 0x55a3525a1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 4 client.15639 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a35247dae0 con 0x55a3525a4c80 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.938+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a3525a4c80 0x55a3525a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f5ffff700 10 client.15639 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f84b12700 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a3525a4c80 0x55a3525a1120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36e78daadc6e300c server_cookie=9bd2a3abd4a6bf19 in_seq=0 out_seq=0 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f5ffff700 1 -- 172.21.15.139:0/1891989243 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55a35247dae0 con 0x55a3525a4c80 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f5ffff700 10 client.15639 handle_command_reply: tid=0 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 client.15639 shutdown 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 msgr2=0x55a352552260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f780077b0 tx=0x7f0f78007b70 comp rx=0 tx=0).stop 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 shutdown_connections 2023-10-08T13:27:16.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35253c600 0x55a352552260 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55a3525a4c80 0x55a3525a1120 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a352530e30 0x55a3525517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 --2- 172.21.15.139:0/1891989243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a352531750 0x55a352551d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f5ffff700 0 client.15639 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 >> 172.21.15.139:0/1891989243 conn(0x55a3524a6210 msgr2=0x55a35253aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 shutdown_connections 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 1 -- 172.21.15.139:0/1891989243 wait complete. 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.939+0000 7f0f92f5fb80 20 client.15639 trim_cache size 0 max 16384 2023-10-08T13:27:16.948 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 4, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24566, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 73.532397080999999, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 91, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:27:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 117.610252301 2023-10-08T13:27:16.950 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:16.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 msgr2=0x7f0f700a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 0x7f0f700a3990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c005950 tx=0x7f0f6c0058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 msgr2=0x7f0f8019b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0f740095c0 tx=0x7f0f7400f740 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 shutdown_connections 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f0f700a14d0 0x7f0f700a3990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f80105630 0x7f0f801958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f800ff640 0x7f0f8019b7b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 --2- 172.21.15.139:0/3709809674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f80100000 0x7f0f8019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 >> 172.21.15.139:0/3709809674 conn(0x7f0f80076790 msgr2=0x7f0f800fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 shutdown_connections 2023-10-08T13:27:16.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:16.940+0000 7f0f86d76700 1 -- 172.21.15.139:0/3709809674 wait complete. 2023-10-08T13:27:16.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T13:27:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 -- 172.21.15.139:0/3980916893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 msgr2=0x7f1154105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 --2- 172.21.15.139:0/3980916893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154105a20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1144009990 tx=0x7f1144009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 -- 172.21.15.139:0/3980916893 shutdown_connections 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 --2- 172.21.15.139:0/3980916893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 0x7f115410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 --2- 172.21.15.139:0/3980916893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154105a20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 --2- 172.21.15.139:0/3980916893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 0x7f11540ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 -- 172.21.15.139:0/3980916893 >> 172.21.15.139:0/3980916893 conn(0x7f11540767f0 msgr2=0x7f1154076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 -- 172.21.15.139:0/3980916893 shutdown_connections 2023-10-08T13:27:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.074+0000 7f115978a700 1 -- 172.21.15.139:0/3980916893 wait complete. 2023-10-08T13:27:17.077 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 Processor -- start 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 -- start start 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 0x7f115419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 0x7f115419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154195ec0 con 0x7f1154105640 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154196030 con 0x7f11540ffff0 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.075+0000 7f115978a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541961f0 con 0x7f11540ff630 2023-10-08T13:27:17.079 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39878/0 (socket says 172.21.15.139:39878) 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 -- 172.21.15.139:0/2743793385 learned_addr learned my addr 172.21.15.139:0/2743793385 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11527fc700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 0x7f115419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 0x7f115419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 -- 172.21.15.139:0/2743793385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 msgr2=0x7f115419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 0x7f115419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 -- 172.21.15.139:0/2743793385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 msgr2=0x7f115419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 0x7f115419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 -- 172.21.15.139:0/2743793385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440095f0 con 0x7f1154105640 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f11537fe700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f114c007d70 tx=0x7f114c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f114bfff700 1 -- 172.21.15.139:0/2743793385 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00ad40 con 0x7f1154105640 2023-10-08T13:27:17.080 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11541964d0 con 0x7f1154105640 2023-10-08T13:27:17.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f114bfff700 1 -- 172.21.15.139:0/2743793385 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f114c0128e0 con 0x7f1154105640 2023-10-08T13:27:17.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f114bfff700 1 -- 172.21.15.139:0/2743793385 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0116b0 con 0x7f1154105640 2023-10-08T13:27:17.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.076+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11541a2710 con 0x7f1154105640 2023-10-08T13:27:17.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.078+0000 7f114bfff700 1 -- 172.21.15.139:0/2743793385 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f114c012420 con 0x7f1154105640 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.079+0000 7f114bfff700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.079+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.079+0000 7f114bfff700 1 -- 172.21.15.139:0/2743793385 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f114c0cd3c0 con 0x7f1154105640 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.079+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 0x7f11400a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f114400b5c0 tx=0x7f114401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 Processor -- start 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 -- start start 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe02210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbe0f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbd6b410 con 0x5619bbe02750 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbd5cbd0 con 0x5619bbe01e30 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1165973b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbd5a4f0 con 0x5619bbe0d600 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f11527fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f11527fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39884/0 (socket says 172.21.15.139:39884) 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f11527fc700 1 -- 172.21.15.139:0/4191318962 learned_addr learned my addr 172.21.15.139:0/4191318962 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f1152ffd700 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe02210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.080+0000 7f11537fe700 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbe0f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 -- 172.21.15.139:0/4191318962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 msgr2=0x5619bbe0f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbe0f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 -- 172.21.15.139:0/4191318962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 msgr2=0x5619bbe02210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe02210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 -- 172.21.15.139:0/4191318962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619bbb80d90 con 0x5619bbe02750 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11527fc700 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f113c00bd30 tx=0x7f113c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8768e171cfb21fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11497fa700 1 -- 172.21.15.139:0/4191318962 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c010e10 con 0x5619bbe02750 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11497fa700 1 -- 172.21.15.139:0/4191318962 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f113c015070 con 0x5619bbe02750 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.081+0000 7f11497fa700 1 -- 172.21.15.139:0/4191318962 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c003df0 con 0x5619bbe02750 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- 172.21.15.139:0/4191318962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 msgr2=0x5619bbe0d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f113c00bd30 tx=0x7f113c0106b0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- 172.21.15.139:0/4191318962 shutdown_connections 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbe0f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe02210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- 172.21.15.139:0/4191318962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe02750 0x5619bbe0d0c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- 172.21.15.139:0/4191318962 >> 172.21.15.139:0/4191318962 conn(0x5619bbd77210 msgr2=0x5619bbdfe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- 172.21.15.139:0/4191318962 shutdown_connections 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- 172.21.15.139:0/4191318962 wait complete. 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- start start 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 Processor -- start 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe0d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe0a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbd55de0 con 0x5619bbe0d600 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbcf26c0 con 0x5619bbe01e30 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbcf2360 con 0x5619bbe02750 2023-10-08T13:27:17.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f1165973b80 10 client.0 _ll_register_callbacks cb 0x5619bbb4f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.082+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39892/0 (socket says 172.21.15.139:39892) 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 -- 172.21.15.139:0/1415878181 learned_addr learned my addr 172.21.15.139:0/1415878181 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f1152ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe0d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 -- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 msgr2=0x5619bbe0a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe0a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 -- 172.21.15.139:0/1415878181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 msgr2=0x5619bbe0d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe0d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 -- 172.21.15.139:0/1415878181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c00b960 con 0x5619bbe0d600 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f11537fe700 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f114c00a740 tx=0x7f114c012a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2323ef7b8f671a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c09a280 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f114c09e3d0 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619bbd1de60 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f114c0a2610 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f1165973b80 10 client.15651 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5619bbb69c10 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619bbd1de60 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f114c099770 con 0x5619bbe0d600 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.083+0000 7f1165973b80 10 client.15651 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1165973b80 10 client.15651 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1165973b80 20 client.15651 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe1d260 0x5619bbe1bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1165973b80 4 client.15651 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619bbd4edc0 con 0x5619bbe1d260 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1152ffd700 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe1d260 0x5619bbe1bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f113a7fc700 10 client.15651 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.084+0000 7f1152ffd700 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe1d260 0x5619bbe1bd10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cefcfebfcb81484f server_cookie=85ee518a2a9f84d0 in_seq=0 out_seq=0 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f113a7fc700 1 -- 172.21.15.139:0/1415878181 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5619bbd4edc0 con 0x5619bbe1d260 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f113a7fc700 10 client.15651 handle_command_reply: tid=0 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 client.15651 shutdown 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 msgr2=0x5619bbe0aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f114c00a740 tx=0x7f114c012a50 comp rx=0 tx=0).stop 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 shutdown_connections 2023-10-08T13:27:17.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe1d260 0x5619bbe1bd10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe0aab0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe0d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f113a7fc700 0 client.15651 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 --2- 172.21.15.139:0/1415878181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe0a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 >> 172.21.15.139:0/1415878181 conn(0x5619bbd77210 msgr2=0x5619bbdfde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 shutdown_connections 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 1 -- 172.21.15.139:0/1415878181 wait complete. 2023-10-08T13:27:17.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.085+0000 7f1165973b80 20 client.15651 trim_cache size 0 max 16384 2023-10-08T13:27:17.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:16 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1672042224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:17.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:16 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3288179572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:17.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 Processor -- start 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 -- start start 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe02750 0x5619bbe0d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbdfdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbbd68d0 con 0x5619bbe01e30 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbd51f10 con 0x5619bbe02750 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1165973b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbbe2de0 con 0x5619bbe0d600 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39896/0 (socket says 172.21.15.139:39896) 2023-10-08T13:27:17.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 -- 172.21.15.139:0/25831537 learned_addr learned my addr 172.21.15.139:0/25831537 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f11527fc700 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe02750 0x5619bbe0d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f11537fe700 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbdfdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 -- 172.21.15.139:0/25831537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 msgr2=0x5619bbdfdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbdfdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 -- 172.21.15.139:0/25831537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe02750 msgr2=0x5619bbe0d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe02750 0x5619bbe0d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.103+0000 7f1152ffd700 1 -- 172.21.15.139:0/25831537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619bbba7200 con 0x5619bbe01e30 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1152ffd700 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f11440098e0 tx=0x7f114401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b71066ca51e746 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1149ffb700 1 -- 172.21.15.139:0/25831537 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114402a040 con 0x5619bbe01e30 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1149ffb700 1 -- 172.21.15.139:0/25831537 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f114402b040 con 0x5619bbe01e30 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1149ffb700 1 -- 172.21.15.139:0/25831537 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114401d040 con 0x5619bbe01e30 2023-10-08T13:27:17.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 -- 172.21.15.139:0/25831537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 msgr2=0x5619bbe0cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f11440098e0 tx=0x7f114401e000 comp rx=0 tx=0).stop 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 -- 172.21.15.139:0/25831537 shutdown_connections 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe0d600 0x5619bbdfdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe01e30 0x5619bbe0cb60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 --2- 172.21.15.139:0/25831537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe02750 0x5619bbe0d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 -- 172.21.15.139:0/25831537 >> 172.21.15.139:0/25831537 conn(0x5619bbd77210 msgr2=0x5619bbdfd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.104+0000 7f1165973b80 1 -- 172.21.15.139:0/25831537 shutdown_connections 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 -- 172.21.15.139:0/25831537 wait complete. 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 -- start start 2023-10-08T13:27:17.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 Processor -- start 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe07190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbe731b0 con 0x5619bbe0d600 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbe732f0 con 0x5619bbe01e30 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619bbe73430 con 0x5619bbe02750 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1165973b80 10 client.0 _ll_register_callbacks cb 0x7f114c099dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39906/0 (socket says 172.21.15.139:39906) 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 -- 172.21.15.139:0/2744329196 learned_addr learned my addr 172.21.15.139:0/2744329196 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe07190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11527fc700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 -- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 msgr2=0x5619bbe076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 -- 172.21.15.139:0/2744329196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 msgr2=0x5619bbe07190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe07190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11537fe700 1 -- 172.21.15.139:0/2744329196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115410ce00 con 0x5619bbe0d600 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.105+0000 7f11527fc700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f11537fe700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f114c007c50 tx=0x7f114c012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6cefed2245a8fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c018d80 con 0x5619bbe0d600 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f114c09e3d0 con 0x5619bbe0d600 2023-10-08T13:27:17.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f113c015070 con 0x5619bbe0d600 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f114c09a280 con 0x5619bbe0d600 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 10 client.15657 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5619bbb7f260 con 0x5619bbe0d600 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f114c07a030 con 0x5619bbe0d600 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f114c0b82a0 con 0x5619bbe0d600 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 10 client.15657 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 20 client.15657 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe78120 0x5619bbe74680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 4 client.15657 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.106+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5619bbd4eae0 con 0x5619bbe78120 2023-10-08T13:27:17.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe78120 0x5619bbe74680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1152ffd700 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe78120 0x5619bbe74680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3f8f61e7be8cc98f server_cookie=e7279fa9182b6118 in_seq=0 out_seq=0 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f113a7fc700 10 client.15657 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f113a7fc700 1 -- 172.21.15.139:0/2744329196 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5619bbd4eae0 con 0x5619bbe78120 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f113a7fc700 10 client.15657 handle_command_reply: tid=0 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 client.15657 shutdown 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 msgr2=0x5619bbe72c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f114c007c50 tx=0x7f114c012b70 comp rx=0 tx=0).stop 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 shutdown_connections 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5619bbe78120 0x5619bbe74680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5619bbe0d600 0x5619bbe72c70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619bbe01e30 0x5619bbe07190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 --2- 172.21.15.139:0/2744329196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5619bbe02750 0x5619bbe076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f113a7fc700 0 client.15657 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 >> 172.21.15.139:0/2744329196 conn(0x5619bbd77210 msgr2=0x5619bbdfdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 shutdown_connections 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.107+0000 7f1165973b80 1 -- 172.21.15.139:0/2744329196 wait complete. 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f1165973b80 20 client.15657 trim_cache size 0 max 16384 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 3, 2023-10-08T13:27:17.116 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24595, 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 74.707301328, 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 91, 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 122.18944262700001 2023-10-08T13:27:17.117 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 msgr2=0x7f11400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 0x7f11400a3990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f114400b5c0 tx=0x7f114401a040 comp rx=0 tx=0).stop 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 msgr2=0x7f1154195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f114c007d70 tx=0x7f114c00a340 comp rx=0 tx=0).stop 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 shutdown_connections 2023-10-08T13:27:17.118 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f11400a14d0 0x7f11400a3990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1154105640 0x7f1154195850 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11540ff630 0x7f115419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 --2- 172.21.15.139:0/2743793385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11540ffff0 0x7f115419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 >> 172.21.15.139:0/2743793385 conn(0x7f11540767f0 msgr2=0x7f11541021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 shutdown_connections 2023-10-08T13:27:17.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.108+0000 7f115978a700 1 -- 172.21.15.139:0/2743793385 wait complete. 2023-10-08T13:27:17.120 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:16 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1672042224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:17.120 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:16 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3288179572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:17.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T13:27:17.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:16 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1672042224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:17.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:16 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3288179572' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/3061585021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d40fffe0 msgr2=0x7fc6d410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/3061585021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d40fffe0 0x7fc6d410c4e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b0a0 tx=0x7fc6cc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/3061585021 shutdown_connections 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/3061585021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d40fffe0 0x7fc6d410c4e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/3061585021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d41056b0 0x7fc6d4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.245 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/3061585021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40ff620 0x7fc6d40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/3061585021 >> 172.21.15.139:0/3061585021 conn(0x7fc6d4076780 msgr2=0x7fc6d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.241+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/3061585021 shutdown_connections 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/3061585021 wait complete. 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 Processor -- start 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 -- start start 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d40ff620 0x7fc6d4197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40fffe0 0x7fc6d4197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.242+0000 7fc6d9ba1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d9ba1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4198730 con 0x7fc6d41056b0 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d9ba1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d41a2ef0 con 0x7fc6d40ff620 2023-10-08T13:27:17.246 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d9ba1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d41a3030 con 0x7fc6d40fffe0 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39918/0 (socket says 172.21.15.139:39918) 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 -- 172.21.15.139:0/2752873818 learned_addr learned my addr 172.21.15.139:0/2752873818 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d40ff620 0x7fc6d4197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40fffe0 0x7fc6d4197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 -- 172.21.15.139:0/2752873818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40fffe0 msgr2=0x7fc6d4197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40fffe0 0x7fc6d4197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 -- 172.21.15.139:0/2752873818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d40ff620 msgr2=0x7fc6d4197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d40ff620 0x7fc6d4197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 -- 172.21.15.139:0/2752873818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc009d00 con 0x7fc6d41056b0 2023-10-08T13:27:17.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b070 tx=0x7fc6cc007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d0ff9700 1 -- 172.21.15.139:0/2752873818 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00e040 con 0x7fc6d41056b0 2023-10-08T13:27:17.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d0ff9700 1 -- 172.21.15.139:0/2752873818 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6cc012e70 con 0x7fc6d41056b0 2023-10-08T13:27:17.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d41a32b0 con 0x7fc6d41056b0 2023-10-08T13:27:17.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d0ff9700 1 -- 172.21.15.139:0/2752873818 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc01c400 con 0x7fc6d41056b0 2023-10-08T13:27:17.248 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.243+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d41a3730 con 0x7fc6d41056b0 2023-10-08T13:27:17.255 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.245+0000 7fc6d0ff9700 1 -- 172.21.15.139:0/2752873818 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc6cc01b6a0 con 0x7fc6d41056b0 2023-10-08T13:27:17.255 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.246+0000 7fc6d0ff9700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 0x7fc6bc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.255 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.246+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 0x7fc6bc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.246+0000 7fc6d0ff9700 1 -- 172.21.15.139:0/2752873818 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc6cc0cec90 con 0x7fc6d41056b0 2023-10-08T13:27:17.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.246+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 0x7fc6bc0a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005950 tx=0x7fc6c40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 Processor -- start 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 -- start start 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c105e30 0x55e04c106210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c1110c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c06f410 con 0x55e04c111600 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c060bd0 con 0x55e04c105e30 2023-10-08T13:27:17.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c05e4f0 con 0x55e04c106750 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39926/0 (socket says 172.21.15.139:39926) 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 -- 172.21.15.139:0/433148948 learned_addr learned my addr 172.21.15.139:0/433148948 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c105e30 0x55e04c106210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c1110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 -- 172.21.15.139:0/433148948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 msgr2=0x55e04c1110c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c1110c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 -- 172.21.15.139:0/433148948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c105e30 msgr2=0x55e04c106210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c105e30 0x55e04c106210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 -- 172.21.15.139:0/433148948 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e04be84d90 con 0x55e04c111600 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.247+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc09bb70 tx=0x7fc6cc01ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05e475f59c99445 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6b9ffb700 1 -- 172.21.15.139:0/433148948 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc09bbe0 con 0x55e04c111600 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6b9ffb700 1 -- 172.21.15.139:0/433148948 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6cc09fd30 con 0x55e04c111600 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6b9ffb700 1 -- 172.21.15.139:0/433148948 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc09be40 con 0x55e04c111600 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/433148948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 msgr2=0x55e04c1139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc09bb70 tx=0x7fc6cc01ba40 comp rx=0 tx=0).stop 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/433148948 shutdown_connections 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c1139f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c105e30 0x55e04c106210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/433148948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c1110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/433148948 >> 172.21.15.139:0/433148948 conn(0x55e04c07b210 msgr2=0x55e04c102280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/433148948 shutdown_connections 2023-10-08T13:27:17.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.248+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/433148948 wait complete. 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 -- start start 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 Processor -- start 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c111f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c059de0 con 0x55e04c105e30 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04bff66c0 con 0x55e04c111600 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.249+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04bff6360 con 0x55e04c106750 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6e5d8ab80 10 client.0 _ll_register_callbacks cb 0x55e04be537b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39928/0 (socket says 172.21.15.139:39928) 2023-10-08T13:27:17.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 -- 172.21.15.139:0/1610851441 learned_addr learned my addr 172.21.15.139:0/1610851441 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c111f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 -- 172.21.15.139:0/1610851441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 msgr2=0x55e04c111f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c111f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 -- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 msgr2=0x55e04c11ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 -- 172.21.15.139:0/1610851441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d41a3730 con 0x55e04c105e30 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c111f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400ff30 tx=0x7fc6c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d2fa0f4ef2f284 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4028670 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc6c4011e40 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e04c021e60 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c40287d0 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6e5d8ab80 10 client.15669 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e04be6dc10 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.250+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e04c021e60 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc6c401fc70 con 0x55e04c105e30 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 10 client.15669 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 20 client.15669 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c120ee0 0x55e04c11f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 4 client.15669 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e04c052dc0 con 0x55e04c120ee0 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c120ee0 0x55e04c11f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6b2ffd700 10 client.15669 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.251+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c120ee0 0x55e04c11f980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=548113aafa618db5 server_cookie=c6aebf505a6c9969 in_seq=0 out_seq=0 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/1610851441 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e04c052dc0 con 0x55e04c120ee0 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6b2ffd700 10 client.15669 handle_command_reply: tid=0 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 client.15669 shutdown 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 msgr2=0x55e04c1119e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400ff30 tx=0x7fc6c4004750 comp rx=0 tx=0).stop 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 shutdown_connections 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c120ee0 0x55e04c11f980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6b2ffd700 0 client.15669 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c1119e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/1610851441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c111f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 >> 172.21.15.139:0/1610851441 conn(0x55e04c07b210 msgr2=0x55e04c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 shutdown_connections 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/1610851441 wait complete. 2023-10-08T13:27:17.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.252+0000 7fc6e5d8ab80 20 client.15669 trim_cache size 0 max 16384 2023-10-08T13:27:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 Processor -- start 2023-10-08T13:27:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 -- start start 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c110560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04beda8d0 con 0x55e04c105e30 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04bee6de0 con 0x55e04c111600 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c11e510 con 0x55e04c106750 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39936/0 (socket says 172.21.15.139:39936) 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 -- 172.21.15.139:0/3331835115 learned_addr learned my addr 172.21.15.139:0/3331835115 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c110560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 -- 172.21.15.139:0/3331835115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 msgr2=0x55e04c110560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c110560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 -- 172.21.15.139:0/3331835115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 msgr2=0x55e04c11f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 -- 172.21.15.139:0/3331835115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e04c0fe230 con 0x55e04c105e30 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:17.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.270+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401e7b0 tx=0x7fc6c401e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429802ed097d364 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6ba7fc700 1 -- 172.21.15.139:0/3331835115 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c401ead0 con 0x55e04c105e30 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6ba7fc700 1 -- 172.21.15.139:0/3331835115 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6c4011ab0 con 0x55e04c105e30 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6ba7fc700 1 -- 172.21.15.139:0/3331835115 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c401fbe0 con 0x55e04c105e30 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3331835115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 msgr2=0x55e04c110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc6c401e7b0 tx=0x7fc6c401e4d0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3331835115 shutdown_connections 2023-10-08T13:27:17.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c111600 0x55e04c11f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c105e30 0x55e04c110020 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3331835115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c106750 0x55e04c110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3331835115 >> 172.21.15.139:0/3331835115 conn(0x55e04c07b210 msgr2=0x55e04c11c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3331835115 shutdown_connections 2023-10-08T13:27:17.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.271+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3331835115 wait complete. 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 -- start start 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 Processor -- start 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c105e30 0x55e04c129780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 0x55e04c125c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c126820 con 0x55e04c111600 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c126990 con 0x55e04c106750 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e04c1748e0 con 0x55e04c105e30 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6e5d8ab80 10 client.0 _ll_register_callbacks cb 0x7fc6c400fb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39946/0 (socket says 172.21.15.139:39946) 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 -- 172.21.15.139:0/3227746781 learned_addr learned my addr 172.21.15.139:0/3227746781 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 0x55e04c125c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c105e30 0x55e04c129780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 -- 172.21.15.139:0/3227746781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c105e30 msgr2=0x55e04c129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c105e30 0x55e04c129780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 -- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 msgr2=0x55e04c125c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 0x55e04c125c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d3fff700 1 -- 172.21.15.139:0/3227746781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e04be6dc10 con 0x55e04c111600 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.272+0000 7fc6d2ffd700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 0x55e04c125c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6d3fff700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cc380 tx=0x7fc6cc09bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1572eb6001ae5a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc02c500 con 0x55e04c111600 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc6cc09b0d0 con 0x55e04c111600 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e04c052ae0 con 0x55e04c111600 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6cc09b290 con 0x55e04c111600 2023-10-08T13:27:17.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 10 client.15675 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e04beab200 con 0x55e04c111600 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e04c052ae0 con 0x55e04c111600 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc6cc0a3a50 con 0x55e04c111600 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 10 client.15675 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 20 client.15675 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c179680 0x55e04c175b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 4 client.15675 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.273+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e04bea5f20 con 0x55e04c179680 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c179680 0x55e04c175b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6b2ffd700 10 client.15675 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:27:17.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6d37fe700 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c179680 0x55e04c175b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e307e292a93c30dc server_cookie=eca1ed85c35dbdf3 in_seq=0 out_seq=0 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6b2ffd700 1 -- 172.21.15.139:0/3227746781 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e04bea5f20 con 0x55e04c179680 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6b2ffd700 10 client.15675 handle_command_reply: tid=0 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 client.15675 shutdown 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 msgr2=0x55e04c126140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cc380 tx=0x7fc6cc09bd00 comp rx=0 tx=0).stop 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 shutdown_connections 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55e04c179680 0x55e04c175b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e04c111600 0x55e04c126140 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e04c105e30 0x55e04c129780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6b2ffd700 0 client.15675 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:27:17.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 --2- 172.21.15.139:0/3227746781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e04c106750 0x55e04c125c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 >> 172.21.15.139:0/3227746781 conn(0x55e04c07b210 msgr2=0x55e04c11c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 shutdown_connections 2023-10-08T13:27:17.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.274+0000 7fc6e5d8ab80 1 -- 172.21.15.139:0/3227746781 wait complete. 2023-10-08T13:27:17.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6e5d8ab80 20 client.15675 trim_cache size 0 max 16384 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 2, 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24599, 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:27:17.291 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 75.877359690000006, 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 91, 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 109.04126503800001 2023-10-08T13:27:17.292 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:17.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 msgr2=0x7fc6bc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 0x7fc6bc0a3990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005950 tx=0x7fc6c40058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 msgr2=0x7fc6d41a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00b070 tx=0x7fc6cc007b70 comp rx=0 tx=0).stop 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 shutdown_connections 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc6bc0a14d0 0x7fc6bc0a3990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6d41056b0 0x7fc6d41a29b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6d40ff620 0x7fc6d4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 --2- 172.21.15.139:0/2752873818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6d40fffe0 0x7fc6d4197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 >> 172.21.15.139:0/2752873818 conn(0x7fc6d4076780 msgr2=0x7fc6d40fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 shutdown_connections 2023-10-08T13:27:17.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.275+0000 7fc6d9ba1700 1 -- 172.21.15.139:0/2752873818 wait complete. 2023-10-08T13:27:17.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T13:27:17.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- 172.21.15.139:0/1142991520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68740fffe0 msgr2=0x7f687410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 --2- 172.21.15.139:0/1142991520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68740fffe0 0x7f687410c4e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f686c00b0a0 tx=0x7f686c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- 172.21.15.139:0/1142991520 shutdown_connections 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 --2- 172.21.15.139:0/1142991520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68740fffe0 0x7f687410c4e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 --2- 172.21.15.139:0/1142991520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68741056b0 0x7f6874105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 --2- 172.21.15.139:0/1142991520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740ff620 0x7f68740ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- 172.21.15.139:0/1142991520 >> 172.21.15.139:0/1142991520 conn(0x7f6874076780 msgr2=0x7f6874076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- 172.21.15.139:0/1142991520 shutdown_connections 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- 172.21.15.139:0/1142991520 wait complete. 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 Processor -- start 2023-10-08T13:27:17.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.417+0000 7f687aa41700 1 -- start start 2023-10-08T13:27:17.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68740ff620 0x7f68741978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740fffe0 0x7f6874197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741986a0 con 0x7f68741056b0 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741a2eb0 con 0x7f68740fffe0 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68741a2ff0 con 0x7f68740ff620 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39960/0 (socket says 172.21.15.139:39960) 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 -- 172.21.15.139:0/2068389526 learned_addr learned my addr 172.21.15.139:0/2068389526 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6873fff700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68740ff620 0x7f68741978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f68737fe700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740fffe0 0x7f6874197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 -- 172.21.15.139:0/2068389526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68740ff620 msgr2=0x7f68741978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68740ff620 0x7f68741978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 -- 172.21.15.139:0/2068389526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740fffe0 msgr2=0x7f6874197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740fffe0 0x7f6874197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 -- 172.21.15.139:0/2068389526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009d00 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f6878fde700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f686c00b070 tx=0x7f686c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f68717fa700 1 -- 172.21.15.139:0/2068389526 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00e040 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.418+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68741a3220 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.419+0000 7f68717fa700 1 -- 172.21.15.139:0/2068389526 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f686c004e60 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.419+0000 7f68717fa700 1 -- 172.21.15.139:0/2068389526 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c005280 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.419+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741a36f0 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.421+0000 7f68717fa700 1 -- 172.21.15.139:0/2068389526 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f686c0054a0 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.421+0000 7f68717fa700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 0x7f685c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.421+0000 7f68717fa700 1 -- 172.21.15.139:0/2068389526 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f686c0ce800 con 0x7f68741056b0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.421+0000 7f6873fff700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 0x7f685c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6873fff700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 0x7f685c0a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6874077ab0 tx=0x7f686400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 Processor -- start 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 -- start start 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c3e30 0x55c8b09c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b092d410 con 0x55c8b09cf600 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b091ebd0 con 0x55c8b09c3e30 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b091c4f0 con 0x55c8b09c4750 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6878fde700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6878fde700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39968/0 (socket says 172.21.15.139:39968) 2023-10-08T13:27:17.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.422+0000 7f6878fde700 1 -- 172.21.15.139:0/121334802 learned_addr learned my addr 172.21.15.139:0/121334802 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6873fff700 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c3e30 0x55c8b09c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 -- 172.21.15.139:0/121334802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 msgr2=0x55c8b09cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 -- 172.21.15.139:0/121334802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c3e30 msgr2=0x55c8b09c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c3e30 0x55c8b09c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 -- 172.21.15.139:0/121334802 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b0742d90 con 0x55c8b09cf600 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6878fde700 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f686c097c50 tx=0x7f686c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8ea22fbe3ce49a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f685a7fc700 1 -- 172.21.15.139:0/121334802 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c011e50 con 0x55c8b09cf600 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f685a7fc700 1 -- 172.21.15.139:0/121334802 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f686c09be50 con 0x55c8b09cf600 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f685a7fc700 1 -- 172.21.15.139:0/121334802 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0860f0 con 0x55c8b09cf600 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 -- 172.21.15.139:0/121334802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 msgr2=0x55c8b09d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f686c097c50 tx=0x7f686c0099e0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 -- 172.21.15.139:0/121334802 shutdown_connections 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09cf600 0x55c8b09d19f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c3e30 0x55c8b09c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.423+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/121334802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- 172.21.15.139:0/121334802 >> 172.21.15.139:0/121334802 conn(0x55c8b0939210 msgr2=0x55c8b09c0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- 172.21.15.139:0/121334802 shutdown_connections 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- 172.21.15.139:0/121334802 wait complete. 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- start start 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 Processor -- start 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b0917de0 con 0x55c8b09c3e30 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b08b46c0 con 0x55c8b09cf600 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b08b4360 con 0x55c8b09c4750 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6886c2ab80 10 client.0 _ll_register_callbacks cb 0x55c8b07117b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.424+0000 7f6873fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.448 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39970/0 (socket says 172.21.15.139:39970) 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 -- 172.21.15.139:0/865597491 learned_addr learned my addr 172.21.15.139:0/865597491 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6878fde700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68737fe700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 -- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 msgr2=0x55c8b09cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 -- 172.21.15.139:0/865597491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 msgr2=0x55c8b09cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 -- 172.21.15.139:0/865597491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68741a36f0 con 0x55c8b09c3e30 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6873fff700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6864011440 tx=0x7f68640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70448d618865f5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.449 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68537fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864011ea0 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8b08dfe60 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6864017070 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6864027670 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6886c2ab80 10 client.15687 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c8b072bc10 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.425+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8b08dfe60 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f686401e9b0 con 0x55c8b09c3e30 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 10 client.15687 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 10 client.15687 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 20 client.15687 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.450 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b09def30 0x55c8b09dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 4 client.15687 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8b0910dc0 con 0x55c8b09def30 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f68737fe700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b09def30 0x55c8b09dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f68737fe700 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b09def30 0x55c8b09dd9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d92e40c67287bc24 server_cookie=4d383ba598c84425 in_seq=0 out_seq=0 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.426+0000 7f68537fe700 10 client.15687 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f68537fe700 1 -- 172.21.15.139:0/865597491 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8b0910dc0 con 0x55c8b09def30 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f68537fe700 10 client.15687 handle_command_reply: tid=0 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 client.15687 shutdown 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 msgr2=0x55c8b09cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6864011440 tx=0x7f68640047c0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.451 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 shutdown_connections 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09cef80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b09def30 0x55c8b09dd9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/865597491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c4750 0x55c8b09cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f68537fe700 0 client.15687 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 >> 172.21.15.139:0/865597491 conn(0x55c8b0939210 msgr2=0x55c8b09bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 shutdown_connections 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 1 -- 172.21.15.139:0/865597491 wait complete. 2023-10-08T13:27:17.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.427+0000 7f6886c2ab80 20 client.15687 trim_cache size 0 max 16384 2023-10-08T13:27:17.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 Processor -- start 2023-10-08T13:27:17.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 -- start start 2023-10-08T13:27:17.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 0x55c8b09cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09cf600 0x55c8b09ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b07988d0 con 0x55c8b09c3e30 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b0913f00 con 0x55c8b09c4750 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b07a4de0 con 0x55c8b09cf600 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6873fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6873fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39978/0 (socket says 172.21.15.139:39978) 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.446+0000 7f6873fff700 1 -- 172.21.15.139:0/2792245790 learned_addr learned my addr 172.21.15.139:0/2792245790 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6878fde700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09cf600 0x55c8b09ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f68737fe700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 0x55c8b09cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 -- 172.21.15.139:0/2792245790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09cf600 msgr2=0x55c8b09ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09cf600 0x55c8b09ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 -- 172.21.15.139:0/2792245790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 msgr2=0x55c8b09cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 0x55c8b09cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 -- 172.21.15.139:0/2792245790 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b0769200 con 0x55c8b09c3e30 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f68737fe700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 0x55c8b09cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f6873fff700 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6864000c00 tx=0x7f686400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f00d497634b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f685affd700 1 -- 172.21.15.139:0/2792245790 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400b9e0 con 0x55c8b09c3e30 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f685affd700 1 -- 172.21.15.139:0/2792245790 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6864015070 con 0x55c8b09c3e30 2023-10-08T13:27:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.447+0000 7f685affd700 1 -- 172.21.15.139:0/2792245790 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686401e7a0 con 0x55c8b09c3e30 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2792245790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 msgr2=0x55c8b09c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6864000c00 tx=0x7f686400b480 comp rx=0 tx=0).stop 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2792245790 shutdown_connections 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09cf600 0x55c8b09ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c3e30 0x55c8b09c6d60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2792245790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09c4750 0x55c8b09cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2792245790 >> 172.21.15.139:0/2792245790 conn(0x55c8b0939210 msgr2=0x55c8b09cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2792245790 shutdown_connections 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2792245790 wait complete. 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 -- start start 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.448+0000 7f6886c2ab80 1 Processor -- start 2023-10-08T13:27:17.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c3e30 0x55c8b09c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b0a32920 con 0x55c8b09c4750 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b0a32a60 con 0x55c8b09cf600 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b0a32c20 con 0x55c8b09c3e30 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 10 client.0 _ll_register_callbacks cb 0x7f6864010c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:39986/0 (socket says 172.21.15.139:39986) 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 -- 172.21.15.139:0/2624655762 learned_addr learned my addr 172.21.15.139:0/2624655762 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6873fff700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c3e30 0x55c8b09c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6878fde700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 -- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c3e30 msgr2=0x55c8b09c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c3e30 0x55c8b09c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 -- 172.21.15.139:0/2624655762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 msgr2=0x55c8b09c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 -- 172.21.15.139:0/2624655762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8b072bc10 con 0x55c8b09c4750 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6878fde700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68737fe700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55c8b09cd840 tx=0x7f686801a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2a989ddc6a5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68537fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868018040 con 0x55c8b09c4750 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6868004520 con 0x55c8b09c4750 2023-10-08T13:27:17.463 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f686c09be50 con 0x55c8b09c4750 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f686801a8d0 con 0x55c8b09c4750 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 10 client.15693 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.449+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c8b0741260 con 0x55c8b09c4750 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f686c09be50 con 0x55c8b09c4750 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6868004850 con 0x55c8b09c4750 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 10 client.15693 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 20 client.15693 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b0a380a0 0x55c8b0a34500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 4 client.15693 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c8b0910ae0 con 0x55c8b0a380a0 2023-10-08T13:27:17.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6873fff700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b0a380a0 0x55c8b0a34500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f68537fe700 10 client.15693 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.450+0000 7f6873fff700 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b0a380a0 0x55c8b0a34500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a71f9902fa717c7c server_cookie=6bd49661f469552e in_seq=0 out_seq=0 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f68537fe700 1 -- 172.21.15.139:0/2624655762 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c8b0910ae0 con 0x55c8b0a380a0 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f68537fe700 10 client.15693 handle_command_reply: tid=0 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 client.15693 shutdown 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 msgr2=0x55c8b09c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55c8b09cd840 tx=0x7f686801a220 comp rx=0 tx=0).stop 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 shutdown_connections 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8b09cf600 0x55c8b09c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55c8b0a380a0 0x55c8b0a34500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c8b09c3e30 0x55c8b09c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 --2- 172.21.15.139:0/2624655762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c8b09c4750 0x55c8b09c9280 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f68537fe700 0 client.15693 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 >> 172.21.15.139:0/2624655762 conn(0x55c8b0939210 msgr2=0x55c8b09cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 shutdown_connections 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 1 -- 172.21.15.139:0/2624655762 wait complete. 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f6886c2ab80 20 client.15693 trim_cache size 0 max 16384 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:17.466 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 1, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24607, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 77.075350080999996, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 91, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 120.376092765 2023-10-08T13:27:17.467 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:17.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 msgr2=0x7f685c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 0x7f685c0a3990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6874077ab0 tx=0x7f686400b410 comp rx=0 tx=0).stop 2023-10-08T13:27:17.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 msgr2=0x7f68741a2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.469 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.451+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f686c00b070 tx=0x7f686c007870 comp rx=0 tx=0).stop 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 shutdown_connections 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f685c0a14d0 0x7f685c0a3990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68741056b0 0x7f68741a2970 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68740ff620 0x7f68741978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 --2- 172.21.15.139:0/2068389526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68740fffe0 0x7f6874197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 >> 172.21.15.139:0/2068389526 conn(0x7f6874076780 msgr2=0x7f68740fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 shutdown_connections 2023-10-08T13:27:17.470 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.452+0000 7f687aa41700 1 -- 172.21.15.139:0/2068389526 wait complete. 2023-10-08T13:27:17.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T13:27:17.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 -- 172.21.15.139:0/872067449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 msgr2=0x7f54c0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 --2- 172.21.15.139:0/872067449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c0106b30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009990 tx=0x7f54bc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 -- 172.21.15.139:0/872067449 shutdown_connections 2023-10-08T13:27:17.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 --2- 172.21.15.139:0/872067449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 0x7f54c010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 --2- 172.21.15.139:0/872067449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c0106b30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 --2- 172.21.15.139:0/872067449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 0x7f54c0100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 -- 172.21.15.139:0/872067449 >> 172.21.15.139:0/872067449 conn(0x7f54c00fc230 msgr2=0x7f54c00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 -- 172.21.15.139:0/872067449 shutdown_connections 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.593+0000 7f54c825d700 1 -- 172.21.15.139:0/872067449 wait complete. 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 Processor -- start 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 -- start start 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 0x7f54c019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 0x7f54c019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c0197000 con 0x7f54c0106750 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c0197170 con 0x7f54c0101100 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c825d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c0197330 con 0x7f54c0100740 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40002/0 (socket says 172.21.15.139:40002) 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c57f8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 0x7f54c019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 -- 172.21.15.139:0/2719219092 learned_addr learned my addr 172.21.15.139:0/2719219092 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 0x7f54c019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 -- 172.21.15.139:0/2719219092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 msgr2=0x7f54c019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 0x7f54c019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 -- 172.21.15.139:0/2719219092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 msgr2=0x7f54c019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 0x7f54c019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.594+0000 7f54c67fa700 1 -- 172.21.15.139:0/2719219092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0095f0 con 0x7f54c0106750 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54c67fa700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f54b800ef30 tx=0x7f54b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54b6ffd700 1 -- 172.21.15.139:0/2719219092 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8018070 con 0x7f54c0106750 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54b6ffd700 1 -- 172.21.15.139:0/2719219092 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54b800f040 con 0x7f54c0106750 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c01975b0 con 0x7f54c0106750 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54b6ffd700 1 -- 172.21.15.139:0/2719219092 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800cdb0 con 0x7f54c0106750 2023-10-08T13:27:17.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.595+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c01a3860 con 0x7f54c0106750 2023-10-08T13:27:17.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.597+0000 7f54b6ffd700 1 -- 172.21.15.139:0/2719219092 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f54b8003a00 con 0x7f54c0106750 2023-10-08T13:27:17.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.597+0000 7f54b6ffd700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 0x7f54ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.598+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 0x7f54ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.598+0000 7f54b6ffd700 1 -- 172.21.15.139:0/2719219092 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f54b80ccde0 con 0x7f54c0106750 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.598+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 0x7f54ac0a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc00b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.598+0000 7f54d4446b80 1 Processor -- start 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 -- start start 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfec600 0x56510dfee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510df4a410 con 0x56510dfe0e30 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510df3bbd0 con 0x56510dfec600 2023-10-08T13:27:17.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54d4446b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510df394f0 con 0x56510dfe1750 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40006/0 (socket says 172.21.15.139:40006) 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 -- 172.21.15.139:0/757301441 learned_addr learned my addr 172.21.15.139:0/757301441 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c57f8700 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c67fa700 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfec600 0x56510dfee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 -- 172.21.15.139:0/757301441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 msgr2=0x56510dfec0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfec0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 -- 172.21.15.139:0/757301441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfec600 msgr2=0x56510dfee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfec600 0x56510dfee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 -- 172.21.15.139:0/757301441 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56510dd5fd90 con 0x56510dfe0e30 2023-10-08T13:27:17.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.599+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005f00 tx=0x7f54bc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592d12bad79e7d20 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54abfff700 1 -- 172.21.15.139:0/757301441 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc02b070 con 0x56510dfe0e30 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54abfff700 1 -- 172.21.15.139:0/757301441 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54bc01e040 con 0x56510dfe0e30 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54abfff700 1 -- 172.21.15.139:0/757301441 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc004dc0 con 0x56510dfe0e30 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 -- 172.21.15.139:0/757301441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 msgr2=0x56510dfe1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005f00 tx=0x7f54bc01f000 comp rx=0 tx=0).stop 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 -- 172.21.15.139:0/757301441 shutdown_connections 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfec600 0x56510dfee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfe0e30 0x56510dfe1210 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 --2- 172.21.15.139:0/757301441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfec0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 -- 172.21.15.139:0/757301441 >> 172.21.15.139:0/757301441 conn(0x56510df56210 msgr2=0x56510dfdd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 -- 172.21.15.139:0/757301441 shutdown_connections 2023-10-08T13:27:17.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.600+0000 7f54d4446b80 1 -- 172.21.15.139:0/757301441 wait complete. 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 -- start start 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 Processor -- start 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfec070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510dfe92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510df34de0 con 0x56510dfec600 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510ded16c0 con 0x56510dfe1750 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510ded1360 con 0x56510dfe0e30 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54d4446b80 10 client.0 _ll_register_callbacks cb 0x56510dd2e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40016/0 (socket says 172.21.15.139:40016) 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54c67fa700 1 -- 172.21.15.139:0/324449434 learned_addr learned my addr 172.21.15.139:0/324449434 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.601+0000 7f54c57f8700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510dfe92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 -- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 msgr2=0x56510dfec070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfec070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 -- 172.21.15.139:0/324449434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 msgr2=0x56510dfe92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510dfe92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 -- 172.21.15.139:0/324449434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c010df10 con 0x56510dfec600 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54c67fa700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ca420 tx=0x7f54b8099720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b6f92c1065e6bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80993c0 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f54b801b320 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56510defce60 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54b809a3d0 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54d4446b80 10 client.15705 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56510dd48c10 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56510defce60 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54b8084070 con 0x56510dfec600 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.602+0000 7f54d4446b80 10 client.15705 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54d4446b80 10 client.15705 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54d4446b80 20 client.15705 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510dffc1f0 0x56510dfface0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54d4446b80 4 client.15705 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56510df2ddc0 con 0x56510dffc1f0 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510dffc1f0 0x56510dfface0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54a97fa700 10 client.15705 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.603+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510dffc1f0 0x56510dfface0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfc16b48a7e4444 server_cookie=92f4c644bc39013b in_seq=0 out_seq=0 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54a97fa700 1 -- 172.21.15.139:0/324449434 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56510df2ddc0 con 0x56510dffc1f0 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54a97fa700 10 client.15705 handle_command_reply: tid=0 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 client.15705 shutdown 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 msgr2=0x56510dfe99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ca420 tx=0x7f54b8099720 comp rx=0 tx=0).stop 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 shutdown_connections 2023-10-08T13:27:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe99e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfec070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510dffc1f0 0x56510dfface0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 --2- 172.21.15.139:0/324449434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510dfe92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54a97fa700 0 client.15705 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 >> 172.21.15.139:0/324449434 conn(0x56510df56210 msgr2=0x56510dfdce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 shutdown_connections 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 1 -- 172.21.15.139:0/324449434 wait complete. 2023-10-08T13:27:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.604+0000 7f54d4446b80 20 client.15705 trim_cache size 0 max 16384 2023-10-08T13:27:17.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 Processor -- start 2023-10-08T13:27:17.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 -- start start 2023-10-08T13:27:17.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfe9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.628 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510e004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510ddb58d0 con 0x56510dfec600 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510ddc1de0 con 0x56510dfe1750 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54d4446b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510def3590 con 0x56510dfe0e30 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40024/0 (socket says 172.21.15.139:40024) 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 -- 172.21.15.139:0/1770232871 learned_addr learned my addr 172.21.15.139:0/1770232871 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c57f8700 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510e004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfe9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 -- 172.21.15.139:0/1770232871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 msgr2=0x56510dfe9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.629 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfe9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 -- 172.21.15.139:0/1770232871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 msgr2=0x56510e004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510e004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 -- 172.21.15.139:0/1770232871 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56510dd86200 con 0x56510dfec600 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.622+0000 7f54c67fa700 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f54b80961d0 tx=0x7f54b8098280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cef6c62e1e60fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54b4ff9700 1 -- 172.21.15.139:0/1770232871 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b24d0 con 0x56510dfec600 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54b4ff9700 1 -- 172.21.15.139:0/1770232871 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54b80b9040 con 0x56510dfec600 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54b4ff9700 1 -- 172.21.15.139:0/1770232871 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8099420 con 0x56510dfec600 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- 172.21.15.139:0/1770232871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 msgr2=0x56510dfebba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f54b80961d0 tx=0x7f54b8098280 comp rx=0 tx=0).stop 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- 172.21.15.139:0/1770232871 shutdown_connections 2023-10-08T13:27:17.630 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfebba0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe0e30 0x56510dfe9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 --2- 172.21.15.139:0/1770232871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe1750 0x56510e004b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- 172.21.15.139:0/1770232871 >> 172.21.15.139:0/1770232871 conn(0x56510df56210 msgr2=0x56510dfe8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- 172.21.15.139:0/1770232871 shutdown_connections 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- 172.21.15.139:0/1770232871 wait complete. 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.623+0000 7f54d4446b80 1 -- start start 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 Processor -- start 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe0e30 0x56510dfe5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfe6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510e04fc70 con 0x56510dfec600 2023-10-08T13:27:17.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510e04fde0 con 0x56510dfe0e30 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56510e04ffa0 con 0x56510dfe1750 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54d4446b80 10 client.0 _ll_register_callbacks cb 0x7f54b8099b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54c67fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40030/0 (socket says 172.21.15.139:40030) 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54c67fa700 1 -- 172.21.15.139:0/3308274041 learned_addr learned my addr 172.21.15.139:0/3308274041 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe0e30 0x56510dfe5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.624+0000 7f54c57f8700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfe6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 -- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 msgr2=0x56510dfe6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfe6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 -- 172.21.15.139:0/3308274041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe0e30 msgr2=0x56510dfe5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:17.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe0e30 0x56510dfe5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 -- 172.21.15.139:0/3308274041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56510dd48c10 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54c67fa700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f54b80a1aa0 tx=0x7f54b8004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a410779cd9fa5e37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b801b320 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f54b809a3d0 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54bc01e040 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54b8099cd0 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 10 client.15711 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56510dd5e260 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54bc01e040 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54b8084040 con 0x56510dfec600 2023-10-08T13:27:17.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 10 client.15711 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 20 client.15711 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510e054e50 0x56510e0512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 4 client.15711 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.625+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56510df2dae0 con 0x56510e054e50 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510e054e50 0x56510e0512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54c5ff9700 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510e054e50 0x56510e0512e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921c5de840438020 server_cookie=e392be8a5fef6d75 in_seq=0 out_seq=0 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54a97fa700 10 client.15711 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54a97fa700 1 -- 172.21.15.139:0/3308274041 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x56510df2dae0 con 0x56510e054e50 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54a97fa700 10 client.15711 handle_command_reply: tid=0 2023-10-08T13:27:17.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54d4446b80 1 client.15711 shutdown 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 msgr2=0x56510dfe6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.626+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f54b80a1aa0 tx=0x7f54b8004dc0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 shutdown_connections 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510dfec600 0x56510dfe6980 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56510e054e50 0x56510e0512e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56510dfe0e30 0x56510dfe5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54a97fa700 0 client.15711 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 --2- 172.21.15.139:0/3308274041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56510dfe1750 0x56510dfe6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 >> 172.21.15.139:0/3308274041 conn(0x56510df56210 msgr2=0x56510dfface0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 shutdown_connections 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 1 -- 172.21.15.139:0/3308274041 wait complete. 2023-10-08T13:27:17.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54d4446b80 20 client.15711 trim_cache size 0 max 16384 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "cluster_fsid": "0585722a-65dd-11ee-8db5-212e2dc638e7", 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "whoami": 0, 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 24628, 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "want_state": "up:active", 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "state": "up:active", 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs", 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "rank_uptime": 103.203051754, 2023-10-08T13:27:17.636 INFO:teuthology.orchestra.run.smithi139.stdout: "mdsmap_epoch": 26, 2023-10-08T13:27:17.637 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch": 91, 2023-10-08T13:27:17.637 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_epoch_barrier": 87, 2023-10-08T13:27:17.637 INFO:teuthology.orchestra.run.smithi139.stdout: "uptime": 116.143793089 2023-10-08T13:27:17.637 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:17.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 msgr2=0x7f54ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 0x7f54ac0a3990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc00b260 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 msgr2=0x7f54c01969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f54b800ef30 tx=0x7f54b800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 shutdown_connections 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f54ac0a14d0 0x7f54ac0a3990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54c0106750 0x7f54c01969a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54c0100740 0x7f54c019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 --2- 172.21.15.139:0/2719219092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54c0101100 0x7f54c019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 >> 172.21.15.139:0/2719219092 conn(0x7f54c00fc230 msgr2=0x7f54c00fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 shutdown_connections 2023-10-08T13:27:17.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:17.627+0000 7f54c825d700 1 -- 172.21.15.139:0/2719219092 wait complete. 2023-10-08T13:27:17.640 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T13:27:17.653 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T13:27:17.654 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-08T13:27:17.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:17.654 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-10-08T13:27:17.671 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-08T13:27:17.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:17.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-08T13:27:17.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:17.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2023-10-08T13:27:17.862 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-10-08T13:27:17.862 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T13:27:17.862 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:17.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T13:27:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:17 smithi155 ceph-mon[103467]: pgmap v293: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:17 smithi155 ceph-mon[103467]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-08T13:27:18.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:17 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:27:18.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:17 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3698344688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:17 smithi139 ceph-mon[99506]: pgmap v293: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:17 smithi139 ceph-mon[99506]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-08T13:27:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:17 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:27:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:17 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3698344688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:17 smithi187 ceph-mon[104336]: pgmap v293: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 9 op/s; 16 B/s, 1 objects/s recovering 2023-10-08T13:27:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:17 smithi187 ceph-mon[104336]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2023-10-08T13:27:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:17 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:27:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:17 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3698344688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:18.422 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:27:19.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/1235167296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 msgr2=0x7fa0e8104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:19.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/1235167296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e8104b00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009990 tx=0x7fa0d8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/1235167296 shutdown_connections 2023-10-08T13:27:19.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/1235167296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 0x7fa0e810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/1235167296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e8104b00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/1235167296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 0x7fa0e8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/1235167296 >> 172.21.15.139:0/1235167296 conn(0x7fa0e8074a10 msgr2=0x7fa0e8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/1235167296 shutdown_connections 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.679+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/1235167296 wait complete. 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 Processor -- start 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 -- start start 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 0x7fa0e819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 0x7fa0e819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8196150 con 0x7fa0e8104720 2023-10-08T13:27:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81962c0 con 0x7fa0e81002a0 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ef3e8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8196480 con 0x7fa0e8100c60 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40042/0 (socket says 172.21.15.139:40042) 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 -- 172.21.15.139:0/2989365987 learned_addr learned my addr 172.21.15.139:0/2989365987 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed184700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 0x7fa0e819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ec983700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 0x7fa0e819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 -- 172.21.15.139:0/2989365987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 msgr2=0x7fa0e819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 0x7fa0e819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 -- 172.21.15.139:0/2989365987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 msgr2=0x7fa0e819b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 0x7fa0e819b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.680+0000 7fa0ed985700 1 -- 172.21.15.139:0/2989365987 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80095f0 con 0x7fa0e8104720 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0ed985700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0007ee0 tx=0x7fa0e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0017070 con 0x7fa0e8104720 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0e000f040 con 0x7fa0e8104720 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0005740 con 0x7fa0e8104720 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e8196760 con 0x7fa0e8104720 2023-10-08T13:27:19.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.681+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e81a2870 con 0x7fa0e8104720 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.682+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e8107c80 con 0x7fa0e8104720 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.683+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa0e000dc60 con 0x7fa0e8104720 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.683+0000 7fa0de7fc700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 0x7fa0d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.684+0000 7fa0ed184700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 0x7fa0d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.684+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa0e00ccf40 con 0x7fa0e8104720 2023-10-08T13:27:19.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.684+0000 7fa0ed184700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 0x7fa0d40a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b2e0 tx=0x7fa0d8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:19.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.687+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0e0096140 con 0x7fa0e8104720 2023-10-08T13:27:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.921+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa0e8196e80 con 0x7fa0e8104720 2023-10-08T13:27:19.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.921+0000 7fa0de7fc700 1 -- 172.21.15.139:0/2989365987 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa0e0099760 con 0x7fa0e8104720 2023-10-08T13:27:19.923 INFO:teuthology.orchestra.run.smithi139.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 msgr2=0x7fa0d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 0x7fa0d40a3990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b2e0 tx=0x7fa0d8005960 comp rx=0 tx=0).stop 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 msgr2=0x7fa0e81959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0007ee0 tx=0x7fa0e000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 shutdown_connections 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0d40a14d0 0x7fa0d40a3990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0e8104720 0x7fa0e81959a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e81002a0 0x7fa0e819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 --2- 172.21.15.139:0/2989365987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0e8100c60 0x7fa0e819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 >> 172.21.15.139:0/2989365987 conn(0x7fa0e8074a10 msgr2=0x7fa0e80fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 shutdown_connections 2023-10-08T13:27:19.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:19.923+0000 7fa0ef3e8700 1 -- 172.21.15.139:0/2989365987 wait complete. 2023-10-08T13:27:20.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:19 smithi139 ceph-mon[99506]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 460 B/s wr, 11 op/s; 15 B/s, 1 objects/s recovering 2023-10-08T13:27:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:19 smithi155 ceph-mon[103467]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 460 B/s wr, 11 op/s; 15 B/s, 1 objects/s recovering 2023-10-08T13:27:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:19 smithi187 ceph-mon[104336]: pgmap v294: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 460 B/s wr, 11 op/s; 15 B/s, 1 objects/s recovering 2023-10-08T13:27:20.282 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T13:27:20.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T13:27:20.283 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T13:27:20.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.283 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2023-10-08T13:27:20.302 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:27:20.303 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 41816sec preferred_lft 41816sec 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::96c3:5485:c6ea:316f/64 scope link noprefixroute 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2023-10-08T13:27:20.304 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T13:27:20.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.304 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:27:20.304 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:27:20.304 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2023-10-08T13:27:20.305 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2023-10-08T13:27:20.305 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2023-10-08T13:27:20.305 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T13:27:20.305 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:27:20.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.423 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T13:27:20.449 INFO:teuthology.orchestra.run.smithi139.stdout:1 2023-10-08T13:27:20.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.451 DEBUG:teuthology.orchestra.run.smithi139:> route 2023-10-08T13:27:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2023-10-08T13:27:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T13:27:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T13:27:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T13:27:20.510 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T13:27:20.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T13:27:20.511 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:27:20.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.617 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-10-08T13:27:20.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.634 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2023-10-08T13:27:20.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.691 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:27:20.691 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:27:20.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T13:27:20.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T13:27:20.691 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:27:20.786 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T13:27:20.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T13:27:20.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T13:27:20.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T13:27:20.787 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:27:20.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:20 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2989365987' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:27:20.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:20.970 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec bash -c ' 2023-10-08T13:27:20.970 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2023-10-08T13:27:20.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2023-10-08T13:27:20.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T13:27:20.970 DEBUG:teuthology.orchestra.run.smithi139:> ') 2023-10-08T13:27:21.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:27:21.082 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:21.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:20 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2989365987' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:27:21.104 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T13:27:21.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T13:27:21.105 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:21.161 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-10-08T13:27:21.161 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-10-08T13:27:21.162 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587 2023-10-08T13:27:21.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.162 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-08T13:27:21.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:20 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2989365987' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T13:27:21.247 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-08T13:27:21.247 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync". 2023-10-08T13:27:21.247 INFO:teuthology.orchestra.run.smithi139.stdout:invalid new device string format 2023-10-08T13:27:21.464 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync 2023-10-08T13:27:21.464 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync". 2023-10-08T13:27:21.465 INFO:teuthology.orchestra.run.smithi139.stdout:invalid new device string format 2023-10-08T13:27:21.465 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.139:3300,172.21.15.155:3300,172.21.15.187:3300" 2023-10-08T13:27:21.465 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.139:3300,172.21.15.155:3300,172.21.15.187:3300:/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587 2023-10-08T13:27:21.465 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,nowsync,key=0,fsid=0585722a-65dd-11ee-8db5-212e2dc638e7" will pass to kernel 2023-10-08T13:27:21.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T13:27:21.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.468 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:21.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.497 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:27:21.569 INFO:teuthology.orchestra.run.smithi139.stdout:client25304 2023-10-08T13:27:21.570 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:27:21.570 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:27:21.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.628 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:27:21.700 INFO:teuthology.orchestra.run.smithi139.stdout:client25304 2023-10-08T13:27:21.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.701 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-08T13:27:21.774 INFO:teuthology.orchestra.run.smithi139.stdout:client25304 2023-10-08T13:27:21.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:27:21.775 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7.client25304/status') 2023-10-08T13:27:21.855 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.25304 (3)172.21.15.139:0/1834224431 2023-10-08T13:27:21.856 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2023-10-08T13:27:21.856 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2023-10-08T13:27:21.856 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2023-10-08T13:27:21.856 INFO:teuthology.orchestra.run.smithi139.stderr:72 bytes copied, 2.209e-05 s, 3.3 MB/s 2023-10-08T13:27:21.857 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T13:27:21.868 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-08T13:27:21.878 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:22.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.018+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2112856308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c40ff550 msgr2=0x7f69c40ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.018+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2112856308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c40ff550 0x7f69c40ff9d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f69b40099c0 tx=0x7f69b4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2112856308 shutdown_connections 2023-10-08T13:27:22.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2112856308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40fff10 0x7f69c410c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2112856308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c4105610 0x7f69c41059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2112856308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c40ff550 0x7f69c40ff9d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2112856308 >> 172.21.15.139:0/2112856308 conn(0x7f69c40fb060 msgr2=0x7f69c40fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2112856308 shutdown_connections 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2112856308 wait complete. 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 Processor -- start 2023-10-08T13:27:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.019+0000 7f69c9dc9700 1 -- start start 2023-10-08T13:27:22.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 0x7f69c419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 0x7f69c419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4195eb0 con 0x7f69c4105610 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4196020 con 0x7f69c40fff10 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41961e0 con 0x7f69c40ff550 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40060/0 (socket says 172.21.15.139:40060) 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 -- 172.21.15.139:0/2343618471 learned_addr learned my addr 172.21.15.139:0/2343618471 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c37fe700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 0x7f69c419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c2ffd700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 0x7f69c419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 -- 172.21.15.139:0/2343618471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 msgr2=0x7f69c419b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 0x7f69c419b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 -- 172.21.15.139:0/2343618471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 msgr2=0x7f69c419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 0x7f69c419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 -- 172.21.15.139:0/2343618471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40095f0 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c37fe700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 0x7f69c419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c2ffd700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 0x7f69c419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c3fff700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f69bc007ee0 tx=0x7f69bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc017070 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c41964c0 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69bc00f040 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc005740 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.020+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c41a2700 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.021+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4107ab0 con 0x7f69c4105610 2023-10-08T13:27:22.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.022+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f69bc0058a0 con 0x7f69c4105610 2023-10-08T13:27:22.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.023+0000 7f69c0ff9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 0x7f69b00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.023+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f69bc0cd080 con 0x7f69c4105610 2023-10-08T13:27:22.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.023+0000 7f69c37fe700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 0x7f69b00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.023+0000 7f69c37fe700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 0x7f69b00a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005950 tx=0x7f69ac005f50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.027+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f69bc096280 con 0x7f69c4105610 2023-10-08T13:27:22.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:21 smithi155 ceph-mon[103467]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 10 op/s; 13 B/s, 1 objects/s recovering 2023-10-08T13:27:22.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:21 smithi139 ceph-mon[99506]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 10 op/s; 13 B/s, 1 objects/s recovering 2023-10-08T13:27:22.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.222+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69c4100c70 con 0x7f69c4105610 2023-10-08T13:27:22.224 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.224+0000 7f69c0ff9700 1 -- 172.21.15.139:0/2343618471 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7f69bc0998a0 con 0x7f69c4105610 2023-10-08T13:27:22.225 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:22.225 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:22.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:21 smithi187 ceph-mon[104336]: pgmap v295: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 409 B/s wr, 10 op/s; 13 B/s, 1 objects/s recovering 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 msgr2=0x7f69b00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 0x7f69b00a3990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69ac005950 tx=0x7f69ac005f50 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 msgr2=0x7f69c4195840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f69bc007ee0 tx=0x7f69bc00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 shutdown_connections 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69b00a14d0 0x7f69b00a3990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69c4105610 0x7f69c4195840 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69c40ff550 0x7f69c419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 --2- 172.21.15.139:0/2343618471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69c40fff10 0x7f69c419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 >> 172.21.15.139:0/2343618471 conn(0x7f69c40fb060 msgr2=0x7f69c40fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 shutdown_connections 2023-10-08T13:27:22.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.226+0000 7f69c9dc9700 1 -- 172.21.15.139:0/2343618471 wait complete. 2023-10-08T13:27:22.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:27:22.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:27:22.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 -- 172.21.15.139:0/3500965202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c101180 msgr2=0x7f2f1c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 --2- 172.21.15.139:0/3500965202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c101180 0x7f2f1c10d690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2f1400b0a0 tx=0x7f2f1400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 -- 172.21.15.139:0/3500965202 shutdown_connections 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 --2- 172.21.15.139:0/3500965202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c101180 0x7f2f1c10d690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 --2- 172.21.15.139:0/3500965202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 --2- 172.21.15.139:0/3500965202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f1c1007c0 0x7f2f1c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 -- 172.21.15.139:0/3500965202 >> 172.21.15.139:0/3500965202 conn(0x7f2f1c0fc290 msgr2=0x7f2f1c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 -- 172.21.15.139:0/3500965202 shutdown_connections 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.363+0000 7f2f21375700 1 -- 172.21.15.139:0/3500965202 wait complete. 2023-10-08T13:27:22.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 Processor -- start 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 -- start start 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f1c1007c0 0x7f2f1c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 0x7f2f1c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1971c0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c197330 con 0x7f2f1c101180 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f21375700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1974f0 con 0x7f2f1c1007c0 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40072/0 (socket says 172.21.15.139:40072) 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 -- 172.21.15.139:0/298824588 learned_addr learned my addr 172.21.15.139:0/298824588 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1a7fc700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 0x7f2f1c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 -- 172.21.15.139:0/298824588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f1c1007c0 msgr2=0x7f2f1c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f1c1007c0 0x7f2f1c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 -- 172.21.15.139:0/298824588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 msgr2=0x7f2f1c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.364+0000 7f2f1b7fe700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 0x7f2f1c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f1b7fe700 1 -- 172.21.15.139:0/298824588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14009d00 con 0x7f2f1c1067d0 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f1a7fc700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 0x7f2f1c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f1b7fe700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007b60 tx=0x7f2f14005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400e040 con 0x7f2f1c1067d0 2023-10-08T13:27:22.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f1401d480 con 0x7f2f1c1067d0 2023-10-08T13:27:22.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c197770 con 0x7f2f1c1067d0 2023-10-08T13:27:22.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1401b6b0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.365+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c1a38d0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.366+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c108dc0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.367+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f2f1401d5f0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.368+0000 7f2f03fff700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 0x7f2f040a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.368+0000 7f2f1affd700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 0x7f2f040a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.368+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2f140cf7e0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.368+0000 7f2f1affd700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 0x7f2f040a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a8f0 tx=0x7f2f10005bf0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.372+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f14098a70 con 0x7f2f1c1067d0 2023-10-08T13:27:22.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.566+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f1c197ed0 con 0x7f2f1c1067d0 2023-10-08T13:27:22.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.566+0000 7f2f03fff700 1 -- 172.21.15.139:0/298824588 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f1409c090 con 0x7f2f1c1067d0 2023-10-08T13:27:22.567 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 msgr2=0x7f2f040a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 0x7f2f040a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a8f0 tx=0x7f2f10005bf0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 msgr2=0x7f2f1c1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007b60 tx=0x7f2f14005b10 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 shutdown_connections 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2f040a1550 0x7f2f040a3a10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f1c1067d0 0x7f2f1c1969f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f1c1007c0 0x7f2f1c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 --2- 172.21.15.139:0/298824588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f1c101180 0x7f2f1c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 >> 172.21.15.139:0/298824588 conn(0x7f2f1c0fc290 msgr2=0x7f2f1c0fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 shutdown_connections 2023-10-08T13:27:22.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.568+0000 7f2f21375700 1 -- 172.21.15.139:0/298824588 wait complete. 2023-10-08T13:27:22.582 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:27:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 -- 172.21.15.139:0/2891868258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b00ff320 msgr2=0x7f00b00ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 --2- 172.21.15.139:0/2891868258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b00ff320 0x7f00b00ff700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009990 tx=0x7f00a0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 -- 172.21.15.139:0/2891868258 shutdown_connections 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 --2- 172.21.15.139:0/2891868258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b0105b30 0x7f00b010d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 --2- 172.21.15.139:0/2891868258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b00ff320 0x7f00b00ff700 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 --2- 172.21.15.139:0/2891868258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b00ffcd0 0x7f00b0105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 -- 172.21.15.139:0/2891868258 >> 172.21.15.139:0/2891868258 conn(0x7f00b0074940 msgr2=0x7f00b0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 -- 172.21.15.139:0/2891868258 shutdown_connections 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.706+0000 7f00b5890700 1 -- 172.21.15.139:0/2891868258 wait complete. 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 Processor -- start 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 -- start start 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b00ff320 0x7f00b019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b0196b70 0x7f00b0197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01975f0 con 0x7f00b0105b30 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0197760 con 0x7f00b00ff320 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00b5890700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0197920 con 0x7f00b0196b70 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00ae7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00ae7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40084/0 (socket says 172.21.15.139:40084) 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00ae7fc700 1 -- 172.21.15.139:0/2691237175 learned_addr learned my addr 172.21.15.139:0/2691237175 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00aeffd700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b00ff320 0x7f00b019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.707+0000 7f00af7fe700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b0196b70 0x7f00b0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 -- 172.21.15.139:0/2691237175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b0196b70 msgr2=0x7f00b0197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b0196b70 0x7f00b0197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 -- 172.21.15.139:0/2691237175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b00ff320 msgr2=0x7f00b019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b00ff320 0x7f00b019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 -- 172.21.15.139:0/2691237175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00095f0 con 0x7f00b0105b30 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00ae7fc700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e9f0 tx=0x7f00a400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4009750 con 0x7f00b0105b30 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a400c7c0 con 0x7f00b0105b30 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01a38c0 con 0x7f00b0105b30 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a40054d0 con 0x7f00b0105b30 2023-10-08T13:27:22.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.708+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01a3d50 con 0x7f00b0105b30 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.709+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0108d20 con 0x7f00b0105b30 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.710+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f00a400c930 con 0x7f00b0105b30 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.710+0000 7f00b488e700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 0x7f00980a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.711+0000 7f00aeffd700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 0x7f00980a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.711+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f00a4014070 con 0x7f00b0105b30 2023-10-08T13:27:22.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.711+0000 7f00aeffd700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 0x7f00980a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00a000b2e0 tx=0x7f00a0005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:22.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.715+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f00a4096580 con 0x7f00b0105b30 2023-10-08T13:27:22.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.910+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00b0197fe0 con 0x7f00b0105b30 2023-10-08T13:27:22.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.910+0000 7f00b488e700 1 -- 172.21.15.139:0/2691237175 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00a4099ba0 con 0x7f00b0105b30 2023-10-08T13:27:22.911 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:22.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 msgr2=0x7f00980a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 0x7f00980a3990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f00a000b2e0 tx=0x7f00a0005960 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 msgr2=0x7f00b019cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f00a400e9f0 tx=0x7f00a400ed00 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 shutdown_connections 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f00980a14d0 0x7f00980a3990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00b0196b70 0x7f00b0197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b00ff320 0x7f00b019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 --2- 172.21.15.139:0/2691237175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00b0105b30 0x7f00b019cf30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 >> 172.21.15.139:0/2691237175 conn(0x7f00b0074940 msgr2=0x7f00b00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:22.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 shutdown_connections 2023-10-08T13:27:22.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:22.912+0000 7f00b5890700 1 -- 172.21.15.139:0/2691237175 wait complete. 2023-10-08T13:27:22.924 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:22 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2343618471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:22.925 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:22 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/298824588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:22.926 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 -- 172.21.15.139:0/1591686503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f40ff640 msgr2=0x7f30f40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 --2- 172.21.15.139:0/1591686503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f40ff640 0x7f30f40ffac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009990 tx=0x7f30f0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 -- 172.21.15.139:0/1591686503 shutdown_connections 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 --2- 172.21.15.139:0/1591686503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f4100000 0x7f30f410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 --2- 172.21.15.139:0/1591686503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 0x7f30f4105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 --2- 172.21.15.139:0/1591686503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f40ff640 0x7f30f40ffac0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 -- 172.21.15.139:0/1591686503 >> 172.21.15.139:0/1591686503 conn(0x7f30f4076790 msgr2=0x7f30f4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 -- 172.21.15.139:0/1591686503 shutdown_connections 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.049+0000 7f30fc747700 1 -- 172.21.15.139:0/1591686503 wait complete. 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 Processor -- start 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 -- start start 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f40ff640 0x7f30f41011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 0x7f30f4101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a4f40 con 0x7f30f4100000 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a50b0 con 0x7f30f4105630 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fc747700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41a5270 con 0x7f30f40ff640 2023-10-08T13:27:23.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40098/0 (socket says 172.21.15.139:40098) 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 -- 172.21.15.139:0/1430191373 learned_addr learned my addr 172.21.15.139:0/1430191373 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30face4700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 0x7f30f4101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30fa4e3700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f40ff640 0x7f30f41011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 -- 172.21.15.139:0/1430191373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f40ff640 msgr2=0x7f30f41011f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f40ff640 0x7f30f41011f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 -- 172.21.15.139:0/1430191373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 msgr2=0x7f30f4101c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 0x7f30f4101c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 -- 172.21.15.139:0/1430191373 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00095f0 con 0x7f30f4100000 2023-10-08T13:27:23.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30f9ce2700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.050+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f001d070 con 0x7f30f4100000 2023-10-08T13:27:23.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.051+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f41a54f0 con 0x7f30f4100000 2023-10-08T13:27:23.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.051+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30f0022470 con 0x7f30f4100000 2023-10-08T13:27:23.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.051+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f0017650 con 0x7f30f4100000 2023-10-08T13:27:23.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.051+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f41a59d0 con 0x7f30f4100000 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.051+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f4108c50 con 0x7f30f4100000 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.052+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f30f00225e0 con 0x7f30f4100000 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.053+0000 7f30eb7fe700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 0x7f30e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.053+0000 7f30fa4e3700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 0x7f30e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.053+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f30f00ce930 con 0x7f30f4100000 2023-10-08T13:27:23.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.054+0000 7f30fa4e3700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 0x7f30e00a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007b60 tx=0x7f30e40073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.058 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.057+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f30f0097bc0 con 0x7f30f4100000 2023-10-08T13:27:23.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:22 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2343618471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:23.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:22 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/298824588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:23.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:22 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2343618471' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:23.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:22 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/298824588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:23.250 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.249+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30f41026d0 con 0x7f30f4100000 2023-10-08T13:27:23.251 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.250+0000 7f30eb7fe700 1 -- 172.21.15.139:0/1430191373 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30f009b1e0 con 0x7f30f4100000 2023-10-08T13:27:23.251 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:27:23.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 msgr2=0x7f30e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 0x7f30e00a3990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f30e4007b60 tx=0x7f30e40073d0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 msgr2=0x7f30f4101730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0004730 comp rx=0 tx=0).stop 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 shutdown_connections 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f30e00a14d0 0x7f30e00a3990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30f4105630 0x7f30f4101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30f40ff640 0x7f30f41011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 --2- 172.21.15.139:0/1430191373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30f4100000 0x7f30f4101730 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 >> 172.21.15.139:0/1430191373 conn(0x7f30f4076790 msgr2=0x7f30f4068e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 shutdown_connections 2023-10-08T13:27:23.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.252+0000 7f30fc747700 1 -- 172.21.15.139:0/1430191373 wait complete. 2023-10-08T13:27:23.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:27:23.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 -- 172.21.15.139:0/865257226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ff4c0 msgr2=0x7f5eb40ff940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 --2- 172.21.15.139:0/865257226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb40ff940 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40099c0 tx=0x7f5ea4009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 -- 172.21.15.139:0/865257226 shutdown_connections 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 --2- 172.21.15.139:0/865257226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb40ffe80 0x7f5eb410c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 --2- 172.21.15.139:0/865257226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb4105580 0x7f5eb4105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 --2- 172.21.15.139:0/865257226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb40ff940 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 -- 172.21.15.139:0/865257226 >> 172.21.15.139:0/865257226 conn(0x7f5eb40faf90 msgr2=0x7f5eb40fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 -- 172.21.15.139:0/865257226 shutdown_connections 2023-10-08T13:27:23.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.389+0000 7f5eb359e700 1 -- 172.21.15.139:0/865257226 wait complete. 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 Processor -- start 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 -- start start 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb4105580 0x7f5eb4196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4196e80 con 0x7f5eb40ffe80 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4196ff0 con 0x7f5eb40ff4c0 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb359e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb41971b0 con 0x7f5eb4105580 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40112/0 (socket says 172.21.15.139:40112) 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 -- 172.21.15.139:0/4258131603 learned_addr learned my addr 172.21.15.139:0/4258131603 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb259c700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb2d9d700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb4105580 0x7f5eb4196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 -- 172.21.15.139:0/4258131603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb4105580 msgr2=0x7f5eb4196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb4105580 0x7f5eb4196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 -- 172.21.15.139:0/4258131603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb40ff4c0 msgr2=0x7f5eb419c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb419c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.390+0000 7f5eb1d9b700 1 -- 172.21.15.139:0/4258131603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40095f0 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5eb1d9b700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400b580 tx=0x7f5ea400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea401c070 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb4197430 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ea400fe30 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4022d40 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.391+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb41a36d0 con 0x7f5eb40ffe80 2023-10-08T13:27:23.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.392+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4107a20 con 0x7f5eb40ffe80 2023-10-08T13:27:23.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.393+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f5ea4020070 con 0x7f5eb40ffe80 2023-10-08T13:27:23.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.393+0000 7f5ea37fe700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 0x7f5e9c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.393+0000 7f5eb259c700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 0x7f5e9c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.393+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5ea40ce130 con 0x7f5eb40ffe80 2023-10-08T13:27:23.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.394+0000 7f5eb259c700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 0x7f5e9c0a3a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800ac50 tx=0x7f5ea800a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.397+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5ea4097360 con 0x7f5eb40ffe80 2023-10-08T13:27:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.589+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5eb4197cd0 con 0x7f5eb40ffe80 2023-10-08T13:27:23.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.589+0000 7f5ea37fe700 1 -- 172.21.15.139:0/4258131603 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5ea409a980 con 0x7f5eb40ffe80 2023-10-08T13:27:23.590 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:23.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 msgr2=0x7f5e9c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 0x7f5e9c0a3a10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800ac50 tx=0x7f5ea800a380 comp rx=0 tx=0).stop 2023-10-08T13:27:23.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 msgr2=0x7f5eb419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400b580 tx=0x7f5ea400f690 comp rx=0 tx=0).stop 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 shutdown_connections 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5e9c0a1550 0x7f5e9c0a3a10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eb4105580 0x7f5eb4196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5eb40ff4c0 0x7f5eb419c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 --2- 172.21.15.139:0/4258131603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb40ffe80 0x7f5eb419cc20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 >> 172.21.15.139:0/4258131603 conn(0x7f5eb40faf90 msgr2=0x7f5eb40fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 shutdown_connections 2023-10-08T13:27:23.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.592+0000 7f5eb359e700 1 -- 172.21.15.139:0/4258131603 wait complete. 2023-10-08T13:27:23.605 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- 172.21.15.139:0/1454626966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee8105600 msgr2=0x7f1ee81059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/1454626966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee8105600 0x7f1ee81059e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80099c0 tx=0x7f1ed8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- 172.21.15.139:0/1454626966 shutdown_connections 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/1454626966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee80fff00 0x7f1ee810c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/1454626966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee8105600 0x7f1ee81059e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/1454626966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80ff540 0x7f1ee80ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- 172.21.15.139:0/1454626966 >> 172.21.15.139:0/1454626966 conn(0x7f1ee80fb030 msgr2=0x7f1ee80fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- 172.21.15.139:0/1454626966 shutdown_connections 2023-10-08T13:27:23.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- 172.21.15.139:0/1454626966 wait complete. 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 Processor -- start 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.726+0000 7f1ef04c1700 1 -- start start 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80fff00 0x7f1ee81016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee8105600 0x7f1ee8101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee81a4e30 con 0x7f1ee80ff540 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee81a4fa0 con 0x7f1ee8105600 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee81a5160 con 0x7f1ee80fff00 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40124/0 (socket says 172.21.15.139:40124) 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 -- 172.21.15.139:0/61796833 learned_addr learned my addr 172.21.15.139:0/61796833 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eeda5c700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80fff00 0x7f1ee81016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 -- 172.21.15.139:0/61796833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80fff00 msgr2=0x7f1ee81016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80fff00 0x7f1ee81016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 -- 172.21.15.139:0/61796833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee8105600 msgr2=0x7f1ee8101c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee8105600 0x7f1ee8101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 -- 172.21.15.139:0/61796833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80095f0 con 0x7f1ee80ff540 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1eee25d700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b580 tx=0x7f1ed8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed801d070 con 0x7f1ee80ff540 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee81a53e0 con 0x7f1ee80ff540 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ed800fc30 con 0x7f1ee80ff540 2023-10-08T13:27:23.731 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8022df0 con 0x7f1ee80ff540 2023-10-08T13:27:23.732 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.727+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee81a5860 con 0x7f1ee80ff540 2023-10-08T13:27:23.732 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.728+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee8100c60 con 0x7f1ee80ff540 2023-10-08T13:27:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.729+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1ed8022500 con 0x7f1ee80ff540 2023-10-08T13:27:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.730+0000 7f1edf7fe700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 0x7f1ed40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.730+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1ed80ce2f0 con 0x7f1ee80ff540 2023-10-08T13:27:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.730+0000 7f1eeda5c700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 0x7f1ed40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:23.733 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.730+0000 7f1eeda5c700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 0x7f1ed40a3990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4005950 tx=0x7f1ee40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:23.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.734+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1ed805d100 con 0x7f1ee80ff540 2023-10-08T13:27:23.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.927+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ee810f460 con 0x7f1ee80ff540 2023-10-08T13:27:23.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.929+0000 7f1edf7fe700 1 -- 172.21.15.139:0/61796833 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7f1ed8097580 con 0x7f1ee80ff540 2023-10-08T13:27:23.930 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:23.930 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 msgr2=0x7f1ed40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 0x7f1ed40a3990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4005950 tx=0x7f1ee40058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 msgr2=0x7f1ee81011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b580 tx=0x7f1ed8005e80 comp rx=0 tx=0).stop 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 shutdown_connections 2023-10-08T13:27:23.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1ed40a14d0 0x7f1ed40a3990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ee8105600 0x7f1ee8101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ee80ff540 0x7f1ee81011b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 --2- 172.21.15.139:0/61796833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ee80fff00 0x7f1ee81016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 >> 172.21.15.139:0/61796833 conn(0x7f1ee80fb030 msgr2=0x7f1ee80fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 shutdown_connections 2023-10-08T13:27:23.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:23.931+0000 7f1ef04c1700 1 -- 172.21.15.139:0/61796833 wait complete. 2023-10-08T13:27:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:23 smithi139 ceph-mon[99506]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 430 B/s wr, 10 op/s; 11 B/s, 1 objects/s recovering 2023-10-08T13:27:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:23 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2691237175' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:23 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1430191373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:23 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4258131603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:23.945 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:27:23.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.069+0000 7f29c6490700 1 -- 172.21.15.139:0/4091115299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 msgr2=0x7f29c0069200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.069+0000 7f29c6490700 1 --2- 172.21.15.139:0/4091115299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c0069200 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009990 tx=0x7f29b0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 -- 172.21.15.139:0/4091115299 shutdown_connections 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 --2- 172.21.15.139:0/4091115299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0069740 0x7f29c010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 --2- 172.21.15.139:0/4091115299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0106750 0x7f29c0106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 --2- 172.21.15.139:0/4091115299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c0069200 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 -- 172.21.15.139:0/4091115299 >> 172.21.15.139:0/4091115299 conn(0x7f29c00767f0 msgr2=0x7f29c0076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 -- 172.21.15.139:0/4091115299 shutdown_connections 2023-10-08T13:27:24.073 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 -- 172.21.15.139:0/4091115299 wait complete. 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 Processor -- start 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.070+0000 7f29c6490700 1 -- start start 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0069740 0x7f29c00ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0106750 0x7f29c01000e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c01a4f00 con 0x7f29c0068d80 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c01a5070 con 0x7f29c0106750 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c01a5230 con 0x7f29c0069740 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40138/0 (socket says 172.21.15.139:40138) 2023-10-08T13:27:24.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 -- 172.21.15.139:0/3372968457 learned_addr learned my addr 172.21.15.139:0/3372968457 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bf7fe700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0069740 0x7f29c00ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 -- 172.21.15.139:0/3372968457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0069740 msgr2=0x7f29c00ffba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0069740 0x7f29c00ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 -- 172.21.15.139:0/3372968457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0106750 msgr2=0x7f29c01000e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c4a2d700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0106750 0x7f29c01000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0106750 0x7f29c01000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 -- 172.21.15.139:0/3372968457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00095f0 con 0x7f29c0068d80 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bffff700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f29b400d980 tx=0x7f29b400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4009b40 con 0x7f29c0068d80 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c01a5510 con 0x7f29c0068d80 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29b400de60 con 0x7f29c0068d80 2023-10-08T13:27:24.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4005580 con 0x7f29c0068d80 2023-10-08T13:27:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.071+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c01a5a20 con 0x7f29c0068d80 2023-10-08T13:27:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.072+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0108d60 con 0x7f29c0068d80 2023-10-08T13:27:24.076 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.073+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f29b4004750 con 0x7f29c0068d80 2023-10-08T13:27:24.077 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.074+0000 7f29bd7fa700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 0x7f29a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.077 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.074+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f29b40cd350 con 0x7f29c0068d80 2023-10-08T13:27:24.077 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.074+0000 7f29bf7fe700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 0x7f29a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.077 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.074+0000 7f29bf7fe700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 0x7f29a80a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b0003730 tx=0x7f29b00036c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.078 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.078+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29b4096550 con 0x7f29c0068d80 2023-10-08T13:27:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:23 smithi155 ceph-mon[103467]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 430 B/s wr, 10 op/s; 11 B/s, 1 objects/s recovering 2023-10-08T13:27:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:23 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2691237175' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:23 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1430191373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:23 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4258131603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:23 smithi187 ceph-mon[104336]: pgmap v296: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 430 B/s wr, 10 op/s; 11 B/s, 1 objects/s recovering 2023-10-08T13:27:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:23 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2691237175' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:23 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1430191373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:23 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4258131603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.270 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.269+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29c0100b40 con 0x7f29c0068d80 2023-10-08T13:27:24.271 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.270+0000 7f29bd7fa700 1 -- 172.21.15.139:0/3372968457 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29b4017020 con 0x7f29c0068d80 2023-10-08T13:27:24.271 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:27:24.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 msgr2=0x7f29a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 0x7f29a80a3990 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b0003730 tx=0x7f29b00036c0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 msgr2=0x7f29c00ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f29b400d980 tx=0x7f29b400dd40 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 shutdown_connections 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f29a80a14d0 0x7f29a80a3990 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29c0106750 0x7f29c01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29c0068d80 0x7f29c00ff660 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 --2- 172.21.15.139:0/3372968457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29c0069740 0x7f29c00ffba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 >> 172.21.15.139:0/3372968457 conn(0x7f29c00767f0 msgr2=0x7f29c00fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 shutdown_connections 2023-10-08T13:27:24.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.272+0000 7f29c6490700 1 -- 172.21.15.139:0/3372968457 wait complete. 2023-10-08T13:27:24.285 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:27:24.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 -- 172.21.15.139:0/4175386585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c101100 msgr2=0x7f068c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 --2- 172.21.15.139:0/4175386585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c101100 0x7f068c10d610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f068400b0a0 tx=0x7f068400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 -- 172.21.15.139:0/4175386585 shutdown_connections 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 --2- 172.21.15.139:0/4175386585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c101100 0x7f068c10d610 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 --2- 172.21.15.139:0/4175386585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 0x7f068c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 --2- 172.21.15.139:0/4175386585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f068c100740 0x7f068c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 -- 172.21.15.139:0/4175386585 >> 172.21.15.139:0/4175386585 conn(0x7f068c0fc230 msgr2=0x7f068c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 -- 172.21.15.139:0/4175386585 shutdown_connections 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.409+0000 7f0692c5b700 1 -- 172.21.15.139:0/4175386585 wait complete. 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 Processor -- start 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 -- start start 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.413 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f068c101100 0x7f068c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 0x7f068c1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c197070 con 0x7f068c100740 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1971e0 con 0x7f068c106750 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f0692c5b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1973a0 con 0x7f068c101100 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f06909f7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f06909f7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40150/0 (socket says 172.21.15.139:40150) 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.410+0000 7f06909f7700 1 -- 172.21.15.139:0/3823553030 learned_addr learned my addr 172.21.15.139:0/3823553030 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06911f8700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 0x7f068c1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 -- 172.21.15.139:0/3823553030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f068c101100 msgr2=0x7f068c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f068c101100 0x7f068c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 -- 172.21.15.139:0/3823553030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 msgr2=0x7f068c1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 0x7f068c1968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 -- 172.21.15.139:0/3823553030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009d00 con 0x7f068c100740 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f06909f7700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f068000d980 tx=0x7f068000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680009b40 con 0x7f068c100740 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f068000de60 con 0x7f068c100740 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c197680 con 0x7f068c100740 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680005580 con 0x7f068c100740 2023-10-08T13:27:24.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.411+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c1a3780 con 0x7f068c100740 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.412+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c108cd0 con 0x7f068c100740 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.413+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f0680004750 con 0x7f068c100740 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.414+0000 7f0689ffb700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 0x7f067c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.414+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f06800cd190 con 0x7f068c100740 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.414+0000 7f068bfff700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 0x7f067c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.414+0000 7f068bfff700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 0x7f067c0a3a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0678005fd0 tx=0x7f0678005d00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.418+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0680096330 con 0x7f068c100740 2023-10-08T13:27:24.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.614+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f068c197d80 con 0x7f068c100740 2023-10-08T13:27:24.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.615+0000 7f0689ffb700 1 -- 172.21.15.139:0/3823553030 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0680099950 con 0x7f068c100740 2023-10-08T13:27:24.616 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:24.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 msgr2=0x7f067c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 0x7f067c0a3a10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0678005fd0 tx=0x7f0678005d00 comp rx=0 tx=0).stop 2023-10-08T13:27:24.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 msgr2=0x7f068c19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f068000d980 tx=0x7f068000dd40 comp rx=0 tx=0).stop 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 shutdown_connections 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f067c0a1550 0x7f067c0a3a10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f068c106750 0x7f068c1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f068c100740 0x7f068c19c800 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 --2- 172.21.15.139:0/3823553030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f068c101100 0x7f068c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 >> 172.21.15.139:0/3823553030 conn(0x7f068c0fc230 msgr2=0x7f068c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 shutdown_connections 2023-10-08T13:27:24.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.617+0000 7f0692c5b700 1 -- 172.21.15.139:0/3823553030 wait complete. 2023-10-08T13:27:24.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:27:24.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 -- 172.21.15.139:0/802909489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 msgr2=0x7fe744100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 --2- 172.21.15.139:0/802909489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744100ba0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe738009990 tx=0x7fe738009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 -- 172.21.15.139:0/802909489 shutdown_connections 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 --2- 172.21.15.139:0/802909489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7441010e0 0x7fe74410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 --2- 172.21.15.139:0/802909489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe744106730 0x7fe744106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 --2- 172.21.15.139:0/802909489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744100ba0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 -- 172.21.15.139:0/802909489 >> 172.21.15.139:0/802909489 conn(0x7fe7440fc230 msgr2=0x7fe7440fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.754+0000 7fe749a59700 1 -- 172.21.15.139:0/802909489 shutdown_connections 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 -- 172.21.15.139:0/802909489 wait complete. 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 Processor -- start 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 -- start start 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 0x7fe744073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe744106730 0x7fe744073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441a4f20 con 0x7fe744100720 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441a5090 con 0x7fe7441010e0 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe749a59700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441a5250 con 0x7fe744106730 2023-10-08T13:27:24.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.755+0000 7fe742ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40164/0 (socket says 172.21.15.139:40164) 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 -- 172.21.15.139:0/1327324958 learned_addr learned my addr 172.21.15.139:0/1327324958 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe7427fc700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 0x7fe744073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 -- 172.21.15.139:0/1327324958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe744106730 msgr2=0x7fe744073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe744106730 0x7fe744073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 -- 172.21.15.139:0/1327324958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 msgr2=0x7fe744073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 0x7fe744073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 -- 172.21.15.139:0/1327324958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380095f0 con 0x7fe744100720 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe7427fc700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 0x7fe744073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe742ffd700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe73400d950 tx=0x7fe73400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734009b40 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe734009ca0 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7441a5530 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400f620 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.756+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7441a5a40 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.757+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744108cb0 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.758+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fe734010460 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.759+0000 7fe748a57700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 0x7fe72c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.759+0000 7fe7427fc700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 0x7fe72c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.759+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe7340cd510 con 0x7fe744100720 2023-10-08T13:27:24.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.759+0000 7fe7427fc700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 0x7fe72c0a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe73800b5c0 tx=0x7fe738005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:24.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.762+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe734096710 con 0x7fe744100720 2023-10-08T13:27:24.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:24 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/61796833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:24.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:24 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3372968457' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:24 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3823553030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:24.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.958+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe744073fd0 con 0x7fe744100720 2023-10-08T13:27:24.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.958+0000 7fe748a57700 1 -- 172.21.15.139:0/1327324958 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe734099d30 con 0x7fe744100720 2023-10-08T13:27:24.959 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 msgr2=0x7fe72c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 0x7fe72c0a3990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe73800b5c0 tx=0x7fe738005fb0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 msgr2=0x7fe744072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe73400d950 tx=0x7fe73400dd10 comp rx=0 tx=0).stop 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 shutdown_connections 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe72c0a14d0 0x7fe72c0a3990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe744106730 0x7fe744073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.960+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe744100720 0x7fe744072af0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.961+0000 7fe749a59700 1 --2- 172.21.15.139:0/1327324958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7441010e0 0x7fe744073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.961+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 >> 172.21.15.139:0/1327324958 conn(0x7fe7440fc230 msgr2=0x7fe7440fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.961+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 shutdown_connections 2023-10-08T13:27:24.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:24.961+0000 7fe749a59700 1 -- 172.21.15.139:0/1327324958 wait complete. 2023-10-08T13:27:24.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:27:25.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:24 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/61796833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:25.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:24 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3372968457' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:25.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:24 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3823553030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.097+0000 7fd0491fd700 1 -- 172.21.15.139:0/451270043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0441046a0 msgr2=0x7fd044104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.097+0000 7fd0491fd700 1 --2- 172.21.15.139:0/451270043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0441046a0 0x7fd044104a80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd038009990 tx=0x7fd038009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 -- 172.21.15.139:0/451270043 shutdown_connections 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 --2- 172.21.15.139:0/451270043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd044100b80 0x7fd04410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 --2- 172.21.15.139:0/451270043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0441046a0 0x7fd044104a80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 --2- 172.21.15.139:0/451270043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441001c0 0x7fd044100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 -- 172.21.15.139:0/451270043 >> 172.21.15.139:0/451270043 conn(0x7fd044074940 msgr2=0x7fd044074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:25.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 -- 172.21.15.139:0/451270043 shutdown_connections 2023-10-08T13:27:25.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 -- 172.21.15.139:0/451270043 wait complete. 2023-10-08T13:27:25.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.098+0000 7fd0491fd700 1 Processor -- start 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 -- start start 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0441001c0 0x7fd04419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441046a0 0x7fd0441969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044197050 con 0x7fd044100b80 2023-10-08T13:27:25.102 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0441971c0 con 0x7fd0441001c0 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd0491fd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd044197380 con 0x7fd0441046a0 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40180/0 (socket says 172.21.15.139:40180) 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 -- 172.21.15.139:0/3020672313 learned_addr learned my addr 172.21.15.139:0/3020672313 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04359e700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441046a0 0x7fd0441969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd042d9d700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0441001c0 0x7fd04419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 -- 172.21.15.139:0/3020672313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441046a0 msgr2=0x7fd0441969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441046a0 0x7fd0441969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 -- 172.21.15.139:0/3020672313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0441001c0 msgr2=0x7fd04419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0441001c0 0x7fd04419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 -- 172.21.15.139:0/3020672313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0380095f0 con 0x7fd044100b80 2023-10-08T13:27:25.103 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd04259c700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c920 tx=0x7fd03400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.099+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034007b00 con 0x7fd044100b80 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.100+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044197660 con 0x7fd044100b80 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.100+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd03400ce70 con 0x7fd044100b80 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.100+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034005460 con 0x7fd044100b80 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.100+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0441a3860 con 0x7fd044100b80 2023-10-08T13:27:25.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.100+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044108c00 con 0x7fd044100b80 2023-10-08T13:27:25.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.102+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fd0340055c0 con 0x7fd044100b80 2023-10-08T13:27:25.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.103+0000 7fd02bfff700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 0x7fd02c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.103+0000 7fd042d9d700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 0x7fd02c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.103+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd0340cd1d0 con 0x7fd044100b80 2023-10-08T13:27:25.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.103+0000 7fd042d9d700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 0x7fd02c0a3990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd038005850 tx=0x7fd03801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.106+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd0340963d0 con 0x7fd044100b80 2023-10-08T13:27:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:24 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/61796833' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:24 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3372968457' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:25.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:24 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3823553030' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:25.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.296+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd044197e60 con 0x7fd044100b80 2023-10-08T13:27:25.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.296+0000 7fd02bfff700 1 -- 172.21.15.139:0/3020672313 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd03401d020 con 0x7fd044100b80 2023-10-08T13:27:25.298 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:25.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.298+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 msgr2=0x7fd02c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.298+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 0x7fd02c0a3990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd038005850 tx=0x7fd03801a040 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.298+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 msgr2=0x7fd04419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.298+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd03400c920 tx=0x7fd03400cc30 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 shutdown_connections 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd02c0a14d0 0x7fd02c0a3990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0441046a0 0x7fd0441969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0441001c0 0x7fd04419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 --2- 172.21.15.139:0/3020672313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd044100b80 0x7fd04419cdb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 >> 172.21.15.139:0/3020672313 conn(0x7fd044074940 msgr2=0x7fd0440ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 shutdown_connections 2023-10-08T13:27:25.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.299+0000 7fd0491fd700 1 -- 172.21.15.139:0/3020672313 wait complete. 2023-10-08T13:27:25.312 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-08T13:27:25.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 -- 172.21.15.139:0/2631287621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 msgr2=0x7f9b5c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 --2- 172.21.15.139:0/2631287621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c0ff9c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9b440099c0 tx=0x7f9b44009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 -- 172.21.15.139:0/2631287621 shutdown_connections 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 --2- 172.21.15.139:0/2631287621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 0x7f9b5c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 --2- 172.21.15.139:0/2631287621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 0x7f9b5c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 --2- 172.21.15.139:0/2631287621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c0ff9c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 -- 172.21.15.139:0/2631287621 >> 172.21.15.139:0/2631287621 conn(0x7f9b5c0fb030 msgr2=0x7f9b5c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:25.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 -- 172.21.15.139:0/2631287621 shutdown_connections 2023-10-08T13:27:25.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.432+0000 7f9b621d2700 1 -- 172.21.15.139:0/2631287621 wait complete. 2023-10-08T13:27:25.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 Processor -- start 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 -- start start 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 0x7f9b5c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 0x7f9b5c195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c195df0 con 0x7f9b5c0ff540 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c195f60 con 0x7f9b5c105600 2023-10-08T13:27:25.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.433+0000 7f9b621d2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c196120 con 0x7f9b5c0fff00 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40192/0 (socket says 172.21.15.139:40192) 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 -- 172.21.15.139:0/3358282877 learned_addr learned my addr 172.21.15.139:0/3358282877 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5affd700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 0x7f9b5c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5bfff700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 0x7f9b5c195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 -- 172.21.15.139:0/3358282877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 msgr2=0x7f9b5c19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 0x7f9b5c19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 -- 172.21.15.139:0/3358282877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 msgr2=0x7f9b5c195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 0x7f9b5c195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 -- 172.21.15.139:0/3358282877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440095f0 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b5b7fe700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d950 tx=0x7f9b4c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00f890 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b4c010460 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c196400 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00e610 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.434+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c1a2640 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.435+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c107aa0 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.436+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9b4c0108d0 con 0x7f9b5c0ff540 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.437+0000 7f9b58ff9700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 0x7f9b480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.437+0000 7f9b5affd700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 0x7f9b480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.437+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9b4c0ccf90 con 0x7f9b5c0ff540 2023-10-08T13:27:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.438+0000 7f9b5affd700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 0x7f9b480a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009990 tx=0x7f9b44003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.442 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.441+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9b4c096190 con 0x7f9b5c0ff540 2023-10-08T13:27:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.678+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b5c196ce0 con 0x7f9b5c0ff540 2023-10-08T13:27:25.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.678+0000 7f9b58ff9700 1 -- 172.21.15.139:0/3358282877 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f9b4c016090 con 0x7f9b5c0ff540 2023-10-08T13:27:25.679 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:25.680 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.680+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 msgr2=0x7f9b480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.680+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 0x7f9b480a3990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009990 tx=0x7f9b44003680 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.680+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 msgr2=0x7f9b5c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.680+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00d950 tx=0x7f9b4c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 shutdown_connections 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b480a14d0 0x7f9b480a3990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b5c105600 0x7f9b5c195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b5c0ff540 0x7f9b5c19b650 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 --2- 172.21.15.139:0/3358282877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b5c0fff00 0x7f9b5c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 >> 172.21.15.139:0/3358282877 conn(0x7f9b5c0fb030 msgr2=0x7f9b5c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:25.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 shutdown_connections 2023-10-08T13:27:25.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.681+0000 7f9b621d2700 1 -- 172.21.15.139:0/3358282877 wait complete. 2023-10-08T13:27:25.683 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:27:25.694 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-08T13:27:25.694 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-08T13:27:25.695 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:27:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 -- 172.21.15.139:0/2202956058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3844105600 msgr2=0x7f38441059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 --2- 172.21.15.139:0/2202956058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3844105600 0x7f38441059e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f38380099c0 tx=0x7f3838009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 -- 172.21.15.139:0/2202956058 shutdown_connections 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 --2- 172.21.15.139:0/2202956058 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 0x7f384410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 --2- 172.21.15.139:0/2202956058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3844105600 0x7f38441059e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 --2- 172.21.15.139:0/2202956058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f38440ff540 0x7f38440ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 -- 172.21.15.139:0/2202956058 >> 172.21.15.139:0/2202956058 conn(0x7f38440fb030 msgr2=0x7f38440fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 -- 172.21.15.139:0/2202956058 shutdown_connections 2023-10-08T13:27:25.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.816+0000 7f384bc4e700 1 -- 172.21.15.139:0/2202956058 wait complete. 2023-10-08T13:27:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 Processor -- start 2023-10-08T13:27:25.820 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 -- start start 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 0x7f384419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844105600 0x7f3844195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844195ce0 con 0x7f38440ff540 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844195e50 con 0x7f3844105600 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384bc4e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844196010 con 0x7f38440fff00 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38499ea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38499ea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40206/0 (socket says 172.21.15.139:40206) 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38499ea700 1 -- 172.21.15.139:0/1497554281 learned_addr learned my addr 172.21.15.139:0/1497554281 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:25.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38491e9700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 0x7f384419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f384a1eb700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844105600 0x7f3844195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38499ea700 1 -- 172.21.15.139:0/1497554281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 msgr2=0x7f384419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.817+0000 7f38499ea700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 0x7f384419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f38499ea700 1 -- 172.21.15.139:0/1497554281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844105600 msgr2=0x7f3844195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f38499ea700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844105600 0x7f3844195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f38499ea700 1 -- 172.21.15.139:0/1497554281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380095f0 con 0x7f38440ff540 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f38499ea700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f38380098e0 tx=0x7f3838005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383801f070 con 0x7f38440ff540 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3844196290 con 0x7f38440ff540 2023-10-08T13:27:25.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f383801abd0 con 0x7f38440ff540 2023-10-08T13:27:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383800fdc0 con 0x7f38440ff540 2023-10-08T13:27:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.818+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844067a10 con 0x7f38440ff540 2023-10-08T13:27:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.819+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844100c60 con 0x7f38440ff540 2023-10-08T13:27:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.820+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3838023070 con 0x7f38440ff540 2023-10-08T13:27:25.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.820+0000 7f3836ffd700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 0x7f38300a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.820+0000 7f38491e9700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 0x7f38300a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.820+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f38380d0250 con 0x7f38440ff540 2023-10-08T13:27:25.824 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.821+0000 7f38491e9700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 0x7f38300a3990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3844196d90 tx=0x7f384000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:25.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:25.825+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38380994e0 con 0x7f38440ff540 2023-10-08T13:27:26.013 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.012+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3844196bf0 con 0x7f38300a14d0 2023-10-08T13:27:26.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.024+0000 7f3836ffd700 1 -- 172.21.15.139:0/1497554281 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427066 (secure 0 0 0) 0x7f3844196bf0 con 0x7f38300a14d0 2023-10-08T13:27:26.030 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:26.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 msgr2=0x7f38300a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 0x7f38300a3990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3844196d90 tx=0x7f384000a380 comp rx=0 tx=0).stop 2023-10-08T13:27:26.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 msgr2=0x7f384419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f38380098e0 tx=0x7f3838005740 comp rx=0 tx=0).stop 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 shutdown_connections 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f38300a14d0 0x7f38300a3990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3844105600 0x7f3844195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38440ff540 0x7f384419b550 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 --2- 172.21.15.139:0/1497554281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38440fff00 0x7f384419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 >> 172.21.15.139:0/1497554281 conn(0x7f38440fb030 msgr2=0x7f38440fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 shutdown_connections 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.028+0000 7f384bc4e700 1 -- 172.21.15.139:0/1497554281 wait complete. 2023-10-08T13:27:26.034 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:27:26.040 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:25 smithi139 ceph-mon[99506]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:26.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:25 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1327324958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:25 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3020672313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.041 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:25 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3358282877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:26.042 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-10-08T13:27:24.622354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656625,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":952,"num_read_kb":603,"num_write":426,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180993,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336668,"kb_used_data":12380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605156,"statfs":{"total":1151940427776,"available":1151595679744,"internally_reserved":0,"allocated":12677120,"data_stored":8229438,"data_compressed":424908,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":475,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":72,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739636+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:27:09.739636+0000","last_peered":"2023-10-08T13:27:09.739636+0000","last_clean":"2023-10-08T13:27:09.739636+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:27:09.739636+0000","last_undegraded":"2023-10-08T13:27:09.739636+0000","last_fullsized":"2023-10-08T13:27:09.739636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737982+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:27:09.737982+0000","last_peered":"2023-10-08T13:27:09.737982+0000","last_clean":"2023-10-08T13:27:09.737982+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:27:09.737982+0000","last_undegraded":"2023-10-08T13:27:09.737982+0000","last_fullsized":"2023-10-08T13:27:09.737982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737882+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:27:09.737882+0000","last_peered":"2023-10-08T13:27:09.737882+0000","last_clean":"2023-10-08T13:27:09.737882+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:27:09.737882+0000","last_undegraded":"2023-10-08T13:27:09.737882+0000","last_fullsized":"2023-10-08T13:27:09.737882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736599+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:27:09.736599+0000","last_peered":"2023-10-08T13:27:09.736599+0000","last_clean":"2023-10-08T13:27:09.736599+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:27:09.736599+0000","last_undegraded":"2023-10-08T13:27:09.736599+0000","last_fullsized":"2023-10-08T13:27:09.736599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736798+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:27:09.736798+0000","last_peered":"2023-10-08T13:27:09.736798+0000","last_clean":"2023-10-08T13:27:09.736798+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:27:09.736798+0000","last_undegraded":"2023-10-08T13:27:09.736798+0000","last_fullsized":"2023-10-08T13:27:09.736798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781660+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:27:09.781660+0000","last_peered":"2023-10-08T13:27:09.781660+0000","last_clean":"2023-10-08T13:27:09.781660+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:27:09.781660+0000","last_undegraded":"2023-10-08T13:27:09.781660+0000","last_fullsized":"2023-10-08T13:27:09.781660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732887+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:27:09.732887+0000","last_peered":"2023-10-08T13:27:09.732887+0000","last_clean":"2023-10-08T13:27:09.732887+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:27:09.732887+0000","last_undegraded":"2023-10-08T13:27:09.732887+0000","last_fullsized":"2023-10-08T13:27:09.732887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781053+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:27:09.781053+0000","last_peered":"2023-10-08T13:27:09.781053+0000","last_clean":"2023-10-08T13:27:09.781053+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:27:09.781053+0000","last_undegraded":"2023-10-08T13:27:09.781053+0000","last_fullsized":"2023-10-08T13:27:09.781053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737421+0000","last_change":"2023-10-08T13:26:09.727548+0000","last_active":"2023-10-08T13:27:09.737421+0000","last_peered":"2023-10-08T13:27:09.737421+0000","last_clean":"2023-10-08T13:27:09.737421+0000","last_became_active":"2023-10-08T13:26:09.727158+0000","last_became_peered":"2023-10-08T13:26:09.727158+0000","last_unstale":"2023-10-08T13:27:09.737421+0000","last_undegraded":"2023-10-08T13:27:09.737421+0000","last_fullsized":"2023-10-08T13:27:09.737421+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:37.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782064+0000","last_change":"2023-10-08T13:26:09.765316+0000","last_active":"2023-10-08T13:27:09.782064+0000","last_peered":"2023-10-08T13:27:09.782064+0000","last_clean":"2023-10-08T13:27:09.782064+0000","last_became_active":"2023-10-08T13:26:09.764968+0000","last_became_peered":"2023-10-08T13:26:09.764968+0000","last_unstale":"2023-10-08T13:27:09.782064+0000","last_undegraded":"2023-10-08T13:27:09.782064+0000","last_fullsized":"2023-10-08T13:27:09.782064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:40.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733393+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:27:09.733393+0000","last_peered":"2023-10-08T13:27:09.733393+0000","last_clean":"2023-10-08T13:27:09.733393+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:27:09.733393+0000","last_undegraded":"2023-10-08T13:27:09.733393+0000","last_fullsized":"2023-10-08T13:27:09.733393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736200+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:27:09.736200+0000","last_peered":"2023-10-08T13:27:09.736200+0000","last_clean":"2023-10-08T13:27:09.736200+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:27:09.736200+0000","last_undegraded":"2023-10-08T13:27:09.736200+0000","last_fullsized":"2023-10-08T13:27:09.736200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781483+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:27:09.781483+0000","last_peered":"2023-10-08T13:27:09.781483+0000","last_clean":"2023-10-08T13:27:09.781483+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:27:09.781483+0000","last_undegraded":"2023-10-08T13:27:09.781483+0000","last_fullsized":"2023-10-08T13:27:09.781483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735623+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:27:09.735623+0000","last_peered":"2023-10-08T13:27:09.735623+0000","last_clean":"2023-10-08T13:27:09.735623+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:27:09.735623+0000","last_undegraded":"2023-10-08T13:27:09.735623+0000","last_fullsized":"2023-10-08T13:27:09.735623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739508+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:27:09.739508+0000","last_peered":"2023-10-08T13:27:09.739508+0000","last_clean":"2023-10-08T13:27:09.739508+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:27:09.739508+0000","last_undegraded":"2023-10-08T13:27:09.739508+0000","last_fullsized":"2023-10-08T13:27:09.739508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782096+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:27:09.782096+0000","last_peered":"2023-10-08T13:27:09.782096+0000","last_clean":"2023-10-08T13:27:09.782096+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:27:09.782096+0000","last_undegraded":"2023-10-08T13:27:09.782096+0000","last_fullsized":"2023-10-08T13:27:09.782096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739100+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:27:09.739100+0000","last_peered":"2023-10-08T13:27:09.739100+0000","last_clean":"2023-10-08T13:27:09.739100+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:27:09.739100+0000","last_undegraded":"2023-10-08T13:27:09.739100+0000","last_fullsized":"2023-10-08T13:27:09.739100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737214+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:27:09.737214+0000","last_peered":"2023-10-08T13:27:09.737214+0000","last_clean":"2023-10-08T13:27:09.737214+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:27:09.737214+0000","last_undegraded":"2023-10-08T13:27:09.737214+0000","last_fullsized":"2023-10-08T13:27:09.737214+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":113,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:20.527553+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:27:20.527553+0000","last_peered":"2023-10-08T13:27:20.527553+0000","last_clean":"2023-10-08T13:27:20.527553+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:27:20.527553+0000","last_undegraded":"2023-10-08T13:27:20.527553+0000","last_fullsized":"2023-10-08T13:27:20.527553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782523+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:27:09.782523+0000","last_peered":"2023-10-08T13:27:09.782523+0000","last_clean":"2023-10-08T13:27:09.782523+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:27:09.782523+0000","last_undegraded":"2023-10-08T13:27:09.782523+0000","last_fullsized":"2023-10-08T13:27:09.782523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735909+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:27:09.735909+0000","last_peered":"2023-10-08T13:27:09.735909+0000","last_clean":"2023-10-08T13:27:09.735909+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:27:09.735909+0000","last_undegraded":"2023-10-08T13:27:09.735909+0000","last_fullsized":"2023-10-08T13:27:09.735909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782569+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:27:09.782569+0000","last_peered":"2023-10-08T13:27:09.782569+0000","last_clean":"2023-10-08T13:27:09.782569+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:27:09.782569+0000","last_undegraded":"2023-10-08T13:27:09.782569+0000","last_fullsized":"2023-10-08T13:27:09.782569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737765+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:27:09.737765+0000","last_peered":"2023-10-08T13:27:09.737765+0000","last_clean":"2023-10-08T13:27:09.737765+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:27:09.737765+0000","last_undegraded":"2023-10-08T13:27:09.737765+0000","last_fullsized":"2023-10-08T13:27:09.737765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736199+0000","last_change":"2023-10-08T13:26:09.765180+0000","last_active":"2023-10-08T13:27:09.736199+0000","last_peered":"2023-10-08T13:27:09.736199+0000","last_clean":"2023-10-08T13:27:09.736199+0000","last_became_active":"2023-10-08T13:26:09.764692+0000","last_became_peered":"2023-10-08T13:26:09.764692+0000","last_unstale":"2023-10-08T13:27:09.736199+0000","last_undegraded":"2023-10-08T13:27:09.736199+0000","last_fullsized":"2023-10-08T13:27:09.736199+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:15.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736865+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:27:09.736865+0000","last_peered":"2023-10-08T13:27:09.736865+0000","last_clean":"2023-10-08T13:27:09.736865+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:27:09.736865+0000","last_undegraded":"2023-10-08T13:27:09.736865+0000","last_fullsized":"2023-10-08T13:27:09.736865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736922+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:27:09.736922+0000","last_peered":"2023-10-08T13:27:09.736922+0000","last_clean":"2023-10-08T13:27:09.736922+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:27:09.736922+0000","last_undegraded":"2023-10-08T13:27:09.736922+0000","last_fullsized":"2023-10-08T13:27:09.736922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735990+0000","last_change":"2023-10-08T13:26:09.765527+0000","last_active":"2023-10-08T13:27:09.735990+0000","last_peered":"2023-10-08T13:27:09.735990+0000","last_clean":"2023-10-08T13:27:09.735990+0000","last_became_active":"2023-10-08T13:26:09.764823+0000","last_became_peered":"2023-10-08T13:26:09.764823+0000","last_unstale":"2023-10-08T13:27:09.735990+0000","last_undegraded":"2023-10-08T13:27:09.735990+0000","last_fullsized":"2023-10-08T13:27:09.735990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:28:41.632170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736470+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:27:09.736470+0000","last_peered":"2023-10-08T13:27:09.736470+0000","last_clean":"2023-10-08T13:27:09.736470+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:27:09.736470+0000","last_undegraded":"2023-10-08T13:27:09.736470+0000","last_fullsized":"2023-10-08T13:27:09.736470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741593+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:27:09.741593+0000","last_peered":"2023-10-08T13:27:09.741593+0000","last_clean":"2023-10-08T13:27:09.741593+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:27:09.741593+0000","last_undegraded":"2023-10-08T13:27:09.741593+0000","last_fullsized":"2023-10-08T13:27:09.741593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738840+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:27:09.738840+0000","last_peered":"2023-10-08T13:27:09.738840+0000","last_clean":"2023-10-08T13:27:09.738840+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:27:09.738840+0000","last_undegraded":"2023-10-08T13:27:09.738840+0000","last_fullsized":"2023-10-08T13:27:09.738840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'7","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:19.527956+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:27:19.527956+0000","last_peered":"2023-10-08T13:27:19.527956+0000","last_clean":"2023-10-08T13:27:19.527956+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:27:19.527956+0000","last_undegraded":"2023-10-08T13:27:19.527956+0000","last_fullsized":"2023-10-08T13:27:19.527956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736810+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:27:09.736810+0000","last_peered":"2023-10-08T13:27:09.736810+0000","last_clean":"2023-10-08T13:27:09.736810+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:27:09.736810+0000","last_undegraded":"2023-10-08T13:27:09.736810+0000","last_fullsized":"2023-10-08T13:27:09.736810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738971+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:27:09.738971+0000","last_peered":"2023-10-08T13:27:09.738971+0000","last_clean":"2023-10-08T13:27:09.738971+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:27:09.738971+0000","last_undegraded":"2023-10-08T13:27:09.738971+0000","last_fullsized":"2023-10-08T13:27:09.738971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781654+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:27:09.781654+0000","last_peered":"2023-10-08T13:27:09.781654+0000","last_clean":"2023-10-08T13:27:09.781654+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:27:09.781654+0000","last_undegraded":"2023-10-08T13:27:09.781654+0000","last_fullsized":"2023-10-08T13:27:09.781654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741675+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:27:09.741675+0000","last_peered":"2023-10-08T13:27:09.741675+0000","last_clean":"2023-10-08T13:27:09.741675+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:27:09.741675+0000","last_undegraded":"2023-10-08T13:27:09.741675+0000","last_fullsized":"2023-10-08T13:27:09.741675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739462+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:27:09.739462+0000","last_peered":"2023-10-08T13:27:09.739462+0000","last_clean":"2023-10-08T13:27:09.739462+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:27:09.739462+0000","last_undegraded":"2023-10-08T13:27:09.739462+0000","last_fullsized":"2023-10-08T13:27:09.739462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781165+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:27:09.781165+0000","last_peered":"2023-10-08T13:27:09.781165+0000","last_clean":"2023-10-08T13:27:09.781165+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:27:09.781165+0000","last_undegraded":"2023-10-08T13:27:09.781165+0000","last_fullsized":"2023-10-08T13:27:09.781165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780962+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:27:09.780962+0000","last_peered":"2023-10-08T13:27:09.780962+0000","last_clean":"2023-10-08T13:27:09.780962+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:27:09.780962+0000","last_undegraded":"2023-10-08T13:27:09.780962+0000","last_fullsized":"2023-10-08T13:27:09.780962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737865+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:27:09.737865+0000","last_peered":"2023-10-08T13:27:09.737865+0000","last_clean":"2023-10-08T13:27:09.737865+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:27:09.737865+0000","last_undegraded":"2023-10-08T13:27:09.737865+0000","last_fullsized":"2023-10-08T13:27:09.737865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741169+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:27:09.741169+0000","last_peered":"2023-10-08T13:27:09.741169+0000","last_clean":"2023-10-08T13:27:09.741169+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:27:09.741169+0000","last_undegraded":"2023-10-08T13:27:09.741169+0000","last_fullsized":"2023-10-08T13:27:09.741169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781742+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:27:09.781742+0000","last_peered":"2023-10-08T13:27:09.781742+0000","last_clean":"2023-10-08T13:27:09.781742+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:27:09.781742+0000","last_undegraded":"2023-10-08T13:27:09.781742+0000","last_fullsized":"2023-10-08T13:27:09.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781544+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:27:09.781544+0000","last_peered":"2023-10-08T13:27:09.781544+0000","last_clean":"2023-10-08T13:27:09.781544+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:27:09.781544+0000","last_undegraded":"2023-10-08T13:27:09.781544+0000","last_fullsized":"2023-10-08T13:27:09.781544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531560+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:27:22.531560+0000","last_peered":"2023-10-08T13:27:22.531560+0000","last_clean":"2023-10-08T13:27:22.531560+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:27:22.531560+0000","last_undegraded":"2023-10-08T13:27:22.531560+0000","last_fullsized":"2023-10-08T13:27:22.531560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737319+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:27:09.737319+0000","last_peered":"2023-10-08T13:27:09.737319+0000","last_clean":"2023-10-08T13:27:09.737319+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:27:09.737319+0000","last_undegraded":"2023-10-08T13:27:09.737319+0000","last_fullsized":"2023-10-08T13:27:09.737319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781429+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:27:09.781429+0000","last_peered":"2023-10-08T13:27:09.781429+0000","last_clean":"2023-10-08T13:27:09.781429+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:27:09.781429+0000","last_undegraded":"2023-10-08T13:27:09.781429+0000","last_fullsized":"2023-10-08T13:27:09.781429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.759323+0000","last_change":"2023-10-08T13:27:10.759323+0000","last_active":"2023-10-08T13:27:10.759323+0000","last_peered":"2023-10-08T13:27:10.759323+0000","last_clean":"2023-10-08T13:27:10.759323+0000","last_became_active":"2023-10-08T13:27:10.744684+0000","last_became_peered":"2023-10-08T13:27:10.744684+0000","last_unstale":"2023-10-08T13:27:10.759323+0000","last_undegraded":"2023-10-08T13:27:10.759323+0000","last_fullsized":"2023-10-08T13:27:10.759323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:26.169261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737905+0000","last_change":"2023-10-08T13:26:09.730654+0000","last_active":"2023-10-08T13:27:09.737905+0000","last_peered":"2023-10-08T13:27:09.737905+0000","last_clean":"2023-10-08T13:27:09.737905+0000","last_became_active":"2023-10-08T13:26:09.730372+0000","last_became_peered":"2023-10-08T13:26:09.730372+0000","last_unstale":"2023-10-08T13:27:09.737905+0000","last_undegraded":"2023-10-08T13:27:09.737905+0000","last_fullsized":"2023-10-08T13:27:09.737905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:10:09.821192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736469+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:27:09.736469+0000","last_peered":"2023-10-08T13:27:09.736469+0000","last_clean":"2023-10-08T13:27:09.736469+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:27:09.736469+0000","last_undegraded":"2023-10-08T13:27:09.736469+0000","last_fullsized":"2023-10-08T13:27:09.736469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741923+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:27:09.741923+0000","last_peered":"2023-10-08T13:27:09.741923+0000","last_clean":"2023-10-08T13:27:09.741923+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:27:09.741923+0000","last_undegraded":"2023-10-08T13:27:09.741923+0000","last_fullsized":"2023-10-08T13:27:09.741923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737113+0000","last_change":"2023-10-08T13:26:09.724775+0000","last_active":"2023-10-08T13:27:09.737113+0000","last_peered":"2023-10-08T13:27:09.737113+0000","last_clean":"2023-10-08T13:27:09.737113+0000","last_became_active":"2023-10-08T13:26:09.724388+0000","last_became_peered":"2023-10-08T13:26:09.724388+0000","last_unstale":"2023-10-08T13:27:09.737113+0000","last_undegraded":"2023-10-08T13:27:09.737113+0000","last_fullsized":"2023-10-08T13:27:09.737113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:17.186799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781804+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:27:09.781804+0000","last_peered":"2023-10-08T13:27:09.781804+0000","last_clean":"2023-10-08T13:27:09.781804+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:27:09.781804+0000","last_undegraded":"2023-10-08T13:27:09.781804+0000","last_fullsized":"2023-10-08T13:27:09.781804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'37","reported_seq":223,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531836+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:27:22.531836+0000","last_peered":"2023-10-08T13:27:22.531836+0000","last_clean":"2023-10-08T13:27:22.531836+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:27:22.531836+0000","last_undegraded":"2023-10-08T13:27:22.531836+0000","last_fullsized":"2023-10-08T13:27:22.531836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":140,"num_write":39,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736425+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:27:09.736425+0000","last_peered":"2023-10-08T13:27:09.736425+0000","last_clean":"2023-10-08T13:27:09.736425+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:27:09.736425+0000","last_undegraded":"2023-10-08T13:27:09.736425+0000","last_fullsized":"2023-10-08T13:27:09.736425+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741783+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:27:09.741783+0000","last_peered":"2023-10-08T13:27:09.741783+0000","last_clean":"2023-10-08T13:27:09.741783+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:27:09.741783+0000","last_undegraded":"2023-10-08T13:27:09.741783+0000","last_fullsized":"2023-10-08T13:27:09.741783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739315+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:27:09.739315+0000","last_peered":"2023-10-08T13:27:09.739315+0000","last_clean":"2023-10-08T13:27:09.739315+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:27:09.739315+0000","last_undegraded":"2023-10-08T13:27:09.739315+0000","last_fullsized":"2023-10-08T13:27:09.739315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781253+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:27:09.781253+0000","last_peered":"2023-10-08T13:27:09.781253+0000","last_clean":"2023-10-08T13:27:09.781253+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:27:09.781253+0000","last_undegraded":"2023-10-08T13:27:09.781253+0000","last_fullsized":"2023-10-08T13:27:09.781253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738562+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:27:09.738562+0000","last_peered":"2023-10-08T13:27:09.738562+0000","last_clean":"2023-10-08T13:27:09.738562+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:27:09.738562+0000","last_undegraded":"2023-10-08T13:27:09.738562+0000","last_fullsized":"2023-10-08T13:27:09.738562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741489+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:27:09.741489+0000","last_peered":"2023-10-08T13:27:09.741489+0000","last_clean":"2023-10-08T13:27:09.741489+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:27:09.741489+0000","last_undegraded":"2023-10-08T13:27:09.741489+0000","last_fullsized":"2023-10-08T13:27:09.741489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733295+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:27:09.733295+0000","last_peered":"2023-10-08T13:27:09.733295+0000","last_clean":"2023-10-08T13:27:09.733295+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:27:09.733295+0000","last_undegraded":"2023-10-08T13:27:09.733295+0000","last_fullsized":"2023-10-08T13:27:09.733295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782207+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:27:09.782207+0000","last_peered":"2023-10-08T13:27:09.782207+0000","last_clean":"2023-10-08T13:27:09.782207+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:27:09.782207+0000","last_undegraded":"2023-10-08T13:27:09.782207+0000","last_fullsized":"2023-10-08T13:27:09.782207+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:19.526960+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:27:19.526960+0000","last_peered":"2023-10-08T13:27:19.526960+0000","last_clean":"2023-10-08T13:27:19.526960+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:27:19.526960+0000","last_undegraded":"2023-10-08T13:27:19.526960+0000","last_fullsized":"2023-10-08T13:27:19.526960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732939+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:27:09.732939+0000","last_peered":"2023-10-08T13:27:09.732939+0000","last_clean":"2023-10-08T13:27:09.732939+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:27:09.732939+0000","last_undegraded":"2023-10-08T13:27:09.732939+0000","last_fullsized":"2023-10-08T13:27:09.732939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781639+0000","last_change":"2023-10-08T13:26:09.765328+0000","last_active":"2023-10-08T13:27:09.781639+0000","last_peered":"2023-10-08T13:27:09.781639+0000","last_clean":"2023-10-08T13:27:09.781639+0000","last_became_active":"2023-10-08T13:26:09.764889+0000","last_became_peered":"2023-10-08T13:26:09.764889+0000","last_unstale":"2023-10-08T13:27:09.781639+0000","last_undegraded":"2023-10-08T13:27:09.781639+0000","last_fullsized":"2023-10-08T13:27:09.781639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:54.280258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.756068+0000","last_change":"2023-10-08T13:27:10.756068+0000","last_active":"2023-10-08T13:27:10.756068+0000","last_peered":"2023-10-08T13:27:10.756068+0000","last_clean":"2023-10-08T13:27:10.756068+0000","last_became_active":"2023-10-08T13:27:10.742701+0000","last_became_peered":"2023-10-08T13:27:10.742701+0000","last_unstale":"2023-10-08T13:27:10.756068+0000","last_undegraded":"2023-10-08T13:27:10.756068+0000","last_fullsized":"2023-10-08T13:27:10.756068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:44:20.540492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741532+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:27:09.741532+0000","last_peered":"2023-10-08T13:27:09.741532+0000","last_clean":"2023-10-08T13:27:09.741532+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:27:09.741532+0000","last_undegraded":"2023-10-08T13:27:09.741532+0000","last_fullsized":"2023-10-08T13:27:09.741532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741286+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:27:09.741286+0000","last_peered":"2023-10-08T13:27:09.741286+0000","last_clean":"2023-10-08T13:27:09.741286+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:27:09.741286+0000","last_undegraded":"2023-10-08T13:27:09.741286+0000","last_fullsized":"2023-10-08T13:27:09.741286+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.750176+0000","last_change":"2023-10-08T13:27:10.749693+0000","last_active":"2023-10-08T13:27:10.750176+0000","last_peered":"2023-10-08T13:27:10.750176+0000","last_clean":"2023-10-08T13:27:10.750176+0000","last_became_active":"2023-10-08T13:27:10.744809+0000","last_became_peered":"2023-10-08T13:27:10.744809+0000","last_unstale":"2023-10-08T13:27:10.750176+0000","last_undegraded":"2023-10-08T13:27:10.750176+0000","last_fullsized":"2023-10-08T13:27:10.750176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:13.914394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739047+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:27:09.739047+0000","last_peered":"2023-10-08T13:27:09.739047+0000","last_clean":"2023-10-08T13:27:09.739047+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:27:09.739047+0000","last_undegraded":"2023-10-08T13:27:09.739047+0000","last_fullsized":"2023-10-08T13:27:09.739047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736900+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:27:09.736900+0000","last_peered":"2023-10-08T13:27:09.736900+0000","last_clean":"2023-10-08T13:27:09.736900+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:27:09.736900+0000","last_undegraded":"2023-10-08T13:27:09.736900+0000","last_fullsized":"2023-10-08T13:27:09.736900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782110+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:27:09.782110+0000","last_peered":"2023-10-08T13:27:09.782110+0000","last_clean":"2023-10-08T13:27:09.782110+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:27:09.782110+0000","last_undegraded":"2023-10-08T13:27:09.782110+0000","last_fullsized":"2023-10-08T13:27:09.782110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781996+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:27:09.781996+0000","last_peered":"2023-10-08T13:27:09.781996+0000","last_clean":"2023-10-08T13:27:09.781996+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:27:09.781996+0000","last_undegraded":"2023-10-08T13:27:09.781996+0000","last_fullsized":"2023-10-08T13:27:09.781996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782909+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:27:09.782909+0000","last_peered":"2023-10-08T13:27:09.782909+0000","last_clean":"2023-10-08T13:27:09.782909+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:27:09.782909+0000","last_undegraded":"2023-10-08T13:27:09.782909+0000","last_fullsized":"2023-10-08T13:27:09.782909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:18.525468+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:27:18.525468+0000","last_peered":"2023-10-08T13:27:18.525468+0000","last_clean":"2023-10-08T13:27:18.525468+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:27:18.525468+0000","last_undegraded":"2023-10-08T13:27:18.525468+0000","last_fullsized":"2023-10-08T13:27:18.525468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781800+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:27:09.781800+0000","last_peered":"2023-10-08T13:27:09.781800+0000","last_clean":"2023-10-08T13:27:09.781800+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:27:09.781800+0000","last_undegraded":"2023-10-08T13:27:09.781800+0000","last_fullsized":"2023-10-08T13:27:09.781800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781334+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:27:09.781334+0000","last_peered":"2023-10-08T13:27:09.781334+0000","last_clean":"2023-10-08T13:27:09.781334+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:27:09.781334+0000","last_undegraded":"2023-10-08T13:27:09.781334+0000","last_fullsized":"2023-10-08T13:27:09.781334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741292+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:27:09.741292+0000","last_peered":"2023-10-08T13:27:09.741292+0000","last_clean":"2023-10-08T13:27:09.741292+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:27:09.741292+0000","last_undegraded":"2023-10-08T13:27:09.741292+0000","last_fullsized":"2023-10-08T13:27:09.741292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.530346+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:27:22.530346+0000","last_peered":"2023-10-08T13:27:22.530346+0000","last_clean":"2023-10-08T13:27:22.530346+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:27:22.530346+0000","last_undegraded":"2023-10-08T13:27:22.530346+0000","last_fullsized":"2023-10-08T13:27:22.530346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733299+0000","last_change":"2023-10-08T13:26:09.734878+0000","last_active":"2023-10-08T13:27:09.733299+0000","last_peered":"2023-10-08T13:27:09.733299+0000","last_clean":"2023-10-08T13:27:09.733299+0000","last_became_active":"2023-10-08T13:26:09.730200+0000","last_became_peered":"2023-10-08T13:26:09.730200+0000","last_unstale":"2023-10-08T13:27:09.733299+0000","last_undegraded":"2023-10-08T13:27:09.733299+0000","last_fullsized":"2023-10-08T13:27:09.733299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:33.060346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781752+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:27:09.781752+0000","last_peered":"2023-10-08T13:27:09.781752+0000","last_clean":"2023-10-08T13:27:09.781752+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:27:09.781752+0000","last_undegraded":"2023-10-08T13:27:09.781752+0000","last_fullsized":"2023-10-08T13:27:09.781752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736317+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:27:09.736317+0000","last_peered":"2023-10-08T13:27:09.736317+0000","last_clean":"2023-10-08T13:27:09.736317+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:27:09.736317+0000","last_undegraded":"2023-10-08T13:27:09.736317+0000","last_fullsized":"2023-10-08T13:27:09.736317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":324,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732798+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:27:09.732798+0000","last_peered":"2023-10-08T13:27:09.732798+0000","last_clean":"2023-10-08T13:27:09.732798+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:27:09.732798+0000","last_undegraded":"2023-10-08T13:27:09.732798+0000","last_fullsized":"2023-10-08T13:27:09.732798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741629+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:27:09.741629+0000","last_peered":"2023-10-08T13:27:09.741629+0000","last_clean":"2023-10-08T13:27:09.741629+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:27:09.741629+0000","last_undegraded":"2023-10-08T13:27:09.741629+0000","last_fullsized":"2023-10-08T13:27:09.741629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780968+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:27:09.780968+0000","last_peered":"2023-10-08T13:27:09.780968+0000","last_clean":"2023-10-08T13:27:09.780968+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:27:09.780968+0000","last_undegraded":"2023-10-08T13:27:09.780968+0000","last_fullsized":"2023-10-08T13:27:09.780968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732943+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:27:09.732943+0000","last_peered":"2023-10-08T13:27:09.732943+0000","last_clean":"2023-10-08T13:27:09.732943+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:27:09.732943+0000","last_undegraded":"2023-10-08T13:27:09.732943+0000","last_fullsized":"2023-10-08T13:27:09.732943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738569+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:27:09.738569+0000","last_peered":"2023-10-08T13:27:09.738569+0000","last_clean":"2023-10-08T13:27:09.738569+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:27:09.738569+0000","last_undegraded":"2023-10-08T13:27:09.738569+0000","last_fullsized":"2023-10-08T13:27:09.738569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736536+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:27:09.736536+0000","last_peered":"2023-10-08T13:27:09.736536+0000","last_clean":"2023-10-08T13:27:09.736536+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:27:09.736536+0000","last_undegraded":"2023-10-08T13:27:09.736536+0000","last_fullsized":"2023-10-08T13:27:09.736536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782820+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:27:09.782820+0000","last_peered":"2023-10-08T13:27:09.782820+0000","last_clean":"2023-10-08T13:27:09.782820+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:27:09.782820+0000","last_undegraded":"2023-10-08T13:27:09.782820+0000","last_fullsized":"2023-10-08T13:27:09.782820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780955+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:27:09.780955+0000","last_peered":"2023-10-08T13:27:09.780955+0000","last_clean":"2023-10-08T13:27:09.780955+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:27:09.780955+0000","last_undegraded":"2023-10-08T13:27:09.780955+0000","last_fullsized":"2023-10-08T13:27:09.780955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:11.489730+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:27:11.489730+0000","last_peered":"2023-10-08T13:27:11.489730+0000","last_clean":"2023-10-08T13:27:11.489730+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:27:11.489730+0000","last_undegraded":"2023-10-08T13:27:11.489730+0000","last_fullsized":"2023-10-08T13:27:11.489730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782391+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:27:09.782391+0000","last_peered":"2023-10-08T13:27:09.782391+0000","last_clean":"2023-10-08T13:27:09.782391+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:27:09.782391+0000","last_undegraded":"2023-10-08T13:27:09.782391+0000","last_fullsized":"2023-10-08T13:27:09.782391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737106+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:27:09.737106+0000","last_peered":"2023-10-08T13:27:09.737106+0000","last_clean":"2023-10-08T13:27:09.737106+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:27:09.737106+0000","last_undegraded":"2023-10-08T13:27:09.737106+0000","last_fullsized":"2023-10-08T13:27:09.737106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736980+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:27:09.736980+0000","last_peered":"2023-10-08T13:27:09.736980+0000","last_clean":"2023-10-08T13:27:09.736980+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:27:09.736980+0000","last_undegraded":"2023-10-08T13:27:09.736980+0000","last_fullsized":"2023-10-08T13:27:09.736980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738015+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:27:09.738015+0000","last_peered":"2023-10-08T13:27:09.738015+0000","last_clean":"2023-10-08T13:27:09.738015+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:27:09.738015+0000","last_undegraded":"2023-10-08T13:27:09.738015+0000","last_fullsized":"2023-10-08T13:27:09.738015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736655+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:27:09.736655+0000","last_peered":"2023-10-08T13:27:09.736655+0000","last_clean":"2023-10-08T13:27:09.736655+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:27:09.736655+0000","last_undegraded":"2023-10-08T13:27:09.736655+0000","last_fullsized":"2023-10-08T13:27:09.736655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735735+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:27:09.735735+0000","last_peered":"2023-10-08T13:27:09.735735+0000","last_clean":"2023-10-08T13:27:09.735735+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:27:09.735735+0000","last_undegraded":"2023-10-08T13:27:09.735735+0000","last_fullsized":"2023-10-08T13:27:09.735735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735869+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:27:09.735869+0000","last_peered":"2023-10-08T13:27:09.735869+0000","last_clean":"2023-10-08T13:27:09.735869+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:27:09.735869+0000","last_undegraded":"2023-10-08T13:27:09.735869+0000","last_fullsized":"2023-10-08T13:27:09.735869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782360+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:27:09.782360+0000","last_peered":"2023-10-08T13:27:09.782360+0000","last_clean":"2023-10-08T13:27:09.782360+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:27:09.782360+0000","last_undegraded":"2023-10-08T13:27:09.782360+0000","last_fullsized":"2023-10-08T13:27:09.782360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781395+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:27:09.781395+0000","last_peered":"2023-10-08T13:27:09.781395+0000","last_clean":"2023-10-08T13:27:09.781395+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:27:09.781395+0000","last_undegraded":"2023-10-08T13:27:09.781395+0000","last_fullsized":"2023-10-08T13:27:09.781395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737259+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:27:09.737259+0000","last_peered":"2023-10-08T13:27:09.737259+0000","last_clean":"2023-10-08T13:27:09.737259+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:27:09.737259+0000","last_undegraded":"2023-10-08T13:27:09.737259+0000","last_fullsized":"2023-10-08T13:27:09.737259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735940+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:27:09.735940+0000","last_peered":"2023-10-08T13:27:09.735940+0000","last_clean":"2023-10-08T13:27:09.735940+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:27:09.735940+0000","last_undegraded":"2023-10-08T13:27:09.735940+0000","last_fullsized":"2023-10-08T13:27:09.735940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739206+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:27:09.739206+0000","last_peered":"2023-10-08T13:27:09.739206+0000","last_clean":"2023-10-08T13:27:09.739206+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:27:09.739206+0000","last_undegraded":"2023-10-08T13:27:09.739206+0000","last_fullsized":"2023-10-08T13:27:09.739206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781680+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:27:09.781680+0000","last_peered":"2023-10-08T13:27:09.781680+0000","last_clean":"2023-10-08T13:27:09.781680+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:27:09.781680+0000","last_undegraded":"2023-10-08T13:27:09.781680+0000","last_fullsized":"2023-10-08T13:27:09.781680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736305+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:27:09.736305+0000","last_peered":"2023-10-08T13:27:09.736305+0000","last_clean":"2023-10-08T13:27:09.736305+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:27:09.736305+0000","last_undegraded":"2023-10-08T13:27:09.736305+0000","last_fullsized":"2023-10-08T13:27:09.736305+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.753812+0000","last_change":"2023-10-08T13:27:10.753399+0000","last_active":"2023-10-08T13:27:10.753812+0000","last_peered":"2023-10-08T13:27:10.753812+0000","last_clean":"2023-10-08T13:27:10.753812+0000","last_became_active":"2023-10-08T13:27:10.745101+0000","last_became_peered":"2023-10-08T13:27:10.745101+0000","last_unstale":"2023-10-08T13:27:10.753812+0000","last_undegraded":"2023-10-08T13:27:10.753812+0000","last_fullsized":"2023-10-08T13:27:10.753812+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:43.743911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733014+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:27:09.733014+0000","last_peered":"2023-10-08T13:27:09.733014+0000","last_clean":"2023-10-08T13:27:09.733014+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:27:09.733014+0000","last_undegraded":"2023-10-08T13:27:09.733014+0000","last_fullsized":"2023-10-08T13:27:09.733014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735936+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:27:09.735936+0000","last_peered":"2023-10-08T13:27:09.735936+0000","last_clean":"2023-10-08T13:27:09.735936+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:27:09.735936+0000","last_undegraded":"2023-10-08T13:27:09.735936+0000","last_fullsized":"2023-10-08T13:27:09.735936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:18.526357+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:27:18.526357+0000","last_peered":"2023-10-08T13:27:18.526357+0000","last_clean":"2023-10-08T13:27:18.526357+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:27:18.526357+0000","last_undegraded":"2023-10-08T13:27:18.526357+0000","last_fullsized":"2023-10-08T13:27:18.526357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733459+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:27:09.733459+0000","last_peered":"2023-10-08T13:27:09.733459+0000","last_clean":"2023-10-08T13:27:09.733459+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:27:09.733459+0000","last_undegraded":"2023-10-08T13:27:09.733459+0000","last_fullsized":"2023-10-08T13:27:09.733459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741660+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:27:09.741660+0000","last_peered":"2023-10-08T13:27:09.741660+0000","last_clean":"2023-10-08T13:27:09.741660+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:27:09.741660+0000","last_undegraded":"2023-10-08T13:27:09.741660+0000","last_fullsized":"2023-10-08T13:27:09.741660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733214+0000","last_change":"2023-10-08T13:26:09.729493+0000","last_active":"2023-10-08T13:27:09.733214+0000","last_peered":"2023-10-08T13:27:09.733214+0000","last_clean":"2023-10-08T13:27:09.733214+0000","last_became_active":"2023-10-08T13:26:09.729238+0000","last_became_peered":"2023-10-08T13:26:09.729238+0000","last_unstale":"2023-10-08T13:27:09.733214+0000","last_undegraded":"2023-10-08T13:27:09.733214+0000","last_fullsized":"2023-10-08T13:27:09.733214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.262086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741059+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:27:09.741059+0000","last_peered":"2023-10-08T13:27:09.741059+0000","last_clean":"2023-10-08T13:27:09.741059+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:27:09.741059+0000","last_undegraded":"2023-10-08T13:27:09.741059+0000","last_fullsized":"2023-10-08T13:27:09.741059+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781723+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:27:09.781723+0000","last_peered":"2023-10-08T13:27:09.781723+0000","last_clean":"2023-10-08T13:27:09.781723+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:27:09.781723+0000","last_undegraded":"2023-10-08T13:27:09.781723+0000","last_fullsized":"2023-10-08T13:27:09.781723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733686+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:27:09.733686+0000","last_peered":"2023-10-08T13:27:09.733686+0000","last_clean":"2023-10-08T13:27:09.733686+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:27:09.733686+0000","last_undegraded":"2023-10-08T13:27:09.733686+0000","last_fullsized":"2023-10-08T13:27:09.733686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737343+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:27:09.737343+0000","last_peered":"2023-10-08T13:27:09.737343+0000","last_clean":"2023-10-08T13:27:09.737343+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:27:09.737343+0000","last_undegraded":"2023-10-08T13:27:09.737343+0000","last_fullsized":"2023-10-08T13:27:09.737343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738392+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:27:09.738392+0000","last_peered":"2023-10-08T13:27:09.738392+0000","last_clean":"2023-10-08T13:27:09.738392+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:27:09.738392+0000","last_undegraded":"2023-10-08T13:27:09.738392+0000","last_fullsized":"2023-10-08T13:27:09.738392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738345+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:27:09.738345+0000","last_peered":"2023-10-08T13:27:09.738345+0000","last_clean":"2023-10-08T13:27:09.738345+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:27:09.738345+0000","last_undegraded":"2023-10-08T13:27:09.738345+0000","last_fullsized":"2023-10-08T13:27:09.738345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737841+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:27:09.737841+0000","last_peered":"2023-10-08T13:27:09.737841+0000","last_clean":"2023-10-08T13:27:09.737841+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:27:09.737841+0000","last_undegraded":"2023-10-08T13:27:09.737841+0000","last_fullsized":"2023-10-08T13:27:09.737841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782767+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:27:09.782767+0000","last_peered":"2023-10-08T13:27:09.782767+0000","last_clean":"2023-10-08T13:27:09.782767+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:27:09.782767+0000","last_undegraded":"2023-10-08T13:27:09.782767+0000","last_fullsized":"2023-10-08T13:27:09.782767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739358+0000","last_change":"2023-10-08T13:26:09.729602+0000","last_active":"2023-10-08T13:27:09.739358+0000","last_peered":"2023-10-08T13:27:09.739358+0000","last_clean":"2023-10-08T13:27:09.739358+0000","last_became_active":"2023-10-08T13:26:09.729112+0000","last_became_peered":"2023-10-08T13:26:09.729112+0000","last_unstale":"2023-10-08T13:27:09.739358+0000","last_undegraded":"2023-10-08T13:27:09.739358+0000","last_fullsized":"2023-10-08T13:27:09.739358+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:29.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739001+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:27:09.739001+0000","last_peered":"2023-10-08T13:27:09.739001+0000","last_clean":"2023-10-08T13:27:09.739001+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:27:09.739001+0000","last_undegraded":"2023-10-08T13:27:09.739001+0000","last_fullsized":"2023-10-08T13:27:09.739001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782672+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:27:09.782672+0000","last_peered":"2023-10-08T13:27:09.782672+0000","last_clean":"2023-10-08T13:27:09.782672+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:27:09.782672+0000","last_undegraded":"2023-10-08T13:27:09.782672+0000","last_fullsized":"2023-10-08T13:27:09.782672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741194+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:27:09.741194+0000","last_peered":"2023-10-08T13:27:09.741194+0000","last_clean":"2023-10-08T13:27:09.741194+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:27:09.741194+0000","last_undegraded":"2023-10-08T13:27:09.741194+0000","last_fullsized":"2023-10-08T13:27:09.741194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781309+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:27:09.781309+0000","last_peered":"2023-10-08T13:27:09.781309+0000","last_clean":"2023-10-08T13:27:09.781309+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:27:09.781309+0000","last_undegraded":"2023-10-08T13:27:09.781309+0000","last_fullsized":"2023-10-08T13:27:09.781309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736159+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:27:09.736159+0000","last_peered":"2023-10-08T13:27:09.736159+0000","last_clean":"2023-10-08T13:27:09.736159+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:27:09.736159+0000","last_undegraded":"2023-10-08T13:27:09.736159+0000","last_fullsized":"2023-10-08T13:27:09.736159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781373+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:27:09.781373+0000","last_peered":"2023-10-08T13:27:09.781373+0000","last_clean":"2023-10-08T13:27:09.781373+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:27:09.781373+0000","last_undegraded":"2023-10-08T13:27:09.781373+0000","last_fullsized":"2023-10-08T13:27:09.781373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738775+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:27:09.738775+0000","last_peered":"2023-10-08T13:27:09.738775+0000","last_clean":"2023-10-08T13:27:09.738775+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:27:09.738775+0000","last_undegraded":"2023-10-08T13:27:09.738775+0000","last_fullsized":"2023-10-08T13:27:09.738775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66011,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":816,"num_read_kb":484,"num_write":243,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":524372,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.5},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89000000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.625},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90900000000000003,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.54900000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.753},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.65800000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93100000000000005,"5min":1.617,"15min":1.617},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.65400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.77700000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.68899999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0900000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.68899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.872}]}]},{"osd":10,"up_from":71,"seq":304942678054,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1159168,"data_stored":1173989,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":9.8559999999999999,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.8759999999999994,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.498}]},{"osd":3,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.32500000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.075,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.57499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.86199999999999999,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.7279999999999998,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2539999999999996,"5min":4.2539999999999996,"15min":4.2539999999999996},"last":0.68100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.628,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.70299999999999996}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":524280,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.53900000000000003,"15min":0.49199999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.315}]},{"osd":1,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":0.77600000000000002,"15min":0.70199999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.339,"5min":11.339,"15min":11.339},"last":0.48099999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.381,"5min":0.77300000000000002,"15min":0.68000000000000005},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":11.218999999999999,"5min":11.218999999999999,"15min":11.218999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.109,"5min":7.109,"15min":7.109},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":11.125,"5min":11.125,"15min":11.125},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":0.78200000000000003,"15min":0.70099999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.308,"5min":11.308,"15min":11.308},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.8799999999999999,"5min":6.8799999999999999,"15min":6.8799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":7.0519999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.81100000000000005,"15min":0.873},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2130000000000001,"5min":2.484,"15min":2.484},"last":0.65100000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":0.86899999999999999,"15min":0.79700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":11.249000000000001,"5min":11.249000000000001,"15min":11.249000000000001},"last":0.433},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.57199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.90600000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":11.278,"5min":11.278,"15min":11.278},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85799999999999998,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.68500000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.628}]}]},{"osd":8,"up_from":58,"seq":249108103214,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":520259,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.64100000000000001,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.438},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68400000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.58999999999999997},"min":{"1min":0.52200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76900000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.45500000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":1.073,"15min":1.073},"last":0.55700000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52500000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.52300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85399999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":1.175,"15min":1.175},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.879,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92500000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85699999999999998,"5min":4.319,"15min":4.319},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.73399999999999999,"15min":0.71299999999999997},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.59299999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.70899999999999996,"15min":0.67900000000000005},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80900000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.63,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.83399999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.85699999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1117199,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.496},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88300000000000001,"5min":0.995,"15min":0.995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.749}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72799999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.53800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.89600000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85999999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59699999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89000000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.872},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94799999999999995,"5min":1.05,"15min":1.05},"last":0.88500000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.748,"15min":0.73199999999999998},"min":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.83599999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.036,"15min":1.036},"last":0.85399999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.91200000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":519784,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.45600000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.41499999999999998},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59699999999999998,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.33700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.499}]},{"osd":4,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.56699999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56699999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.79700000000000004,"15min":0.73699999999999999},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.44}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67800000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.622}]}]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":584080,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.70999999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85999999999999999,"5min":1.427,"15min":1.427},"last":0.82299999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.79300000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88200000000000001,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64000000000000001,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88300000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64000000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.66000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":1.238,"15min":1.238},"last":0.621}]},{"osd":9,"last update":"Sun Oct 8 13:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69499999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79600000000000004}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521240,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79300000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.40699999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.0029999999999999,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.73799999999999999,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.995,"15min":0.68700000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92900000000000005,"5min":45.244,"15min":45.244},"last":0.497}]},{"osd":6,"last update":"Sun Oct 8 13:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.48599999999999999},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.80200000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.35399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67300000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.85199999999999998},"min":{"1min":0.46800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90400000000000003,"5min":3.403,"15min":3.403},"last":0.54700000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66800000000000004,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":1.026,"15min":1.026},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66500000000000004,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97099999999999997,"5min":1.008,"15min":1.008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.57999999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.749}]}]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":584289,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":0.872,"15min":0.872},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81299999999999994,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57599999999999996,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58899999999999997,"15min":0.54700000000000004},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.504},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.499,"15min":0.441},"min":{"1min":0.435,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.62},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.48099999999999998},"min":{"1min":0.33100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.34499999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67500000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.58899999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.75700000000000001,"15min":0.73399999999999999},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.054,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.751}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80200000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":519211,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.52300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36399999999999999,"15min":0.32600000000000001},"min":{"1min":0.26500000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.54800000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.371}]},{"osd":1,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55300000000000005,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80200000000000005,"5min":1.806,"15min":1.806},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.502}]},{"osd":2,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60599999999999998,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.32800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68000000000000005,"5min":1.008,"15min":1.008},"last":0.45300000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.44},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66800000000000004,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.66100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56100000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.88800000000000001,"5min":1.583,"15min":1.583},"last":0.66400000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.625}]}]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":523858,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.436,"15min":0.39400000000000002},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.55500000000000005},"min":{"1min":0.50900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.90800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.69499999999999995,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":1.004,"15min":1.004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97899999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99199999999999999,"5min":1.149,"15min":1.149},"last":0.74099999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.85699999999999998,"5min":1,"15min":1},"last":0.61699999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.131,"15min":1.131},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79400000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1116877,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.873,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.747,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.504,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61599999999999999,"15min":0.57699999999999996},"min":{"1min":0.58299999999999996,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79000000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.40999999999999998,"15min":0.38300000000000001},"min":{"1min":0.35499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.432,"15min":0.40200000000000002},"min":{"1min":0.34799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":1.571,"15min":1.571},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.63400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":1.032,"15min":1.032},"last":0.629}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.63600000000000001,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0209999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69099999999999995,"15min":0.66400000000000003},"min":{"1min":0.59499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.995,"5min":1.615,"15min":1.615},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.57099999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.57299999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":1.069,"15min":1.069},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.55000000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.006,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.73099999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.085,"5min":1.353,"15min":1.353},"last":0.78800000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.746},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.59899999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:27:26.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:27:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:25 smithi155 ceph-mon[103467]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:25 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1327324958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:25 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3020672313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:25 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3358282877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/679972621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b4100660 msgr2=0x7fa7b410c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/679972621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b4100660 0x7fa7b410c360 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b0d0 tx=0x7fa7ac00b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/679972621 shutdown_connections 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/679972621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b4100660 0x7fa7b410c360 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/679972621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 0x7fa7b4105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.206 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/679972621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/679972621 >> 172.21.15.139:0/679972621 conn(0x7fa7b4075a90 msgr2=0x7fa7b40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/679972621 shutdown_connections 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/679972621 wait complete. 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 Processor -- start 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 -- start start 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b4100660 0x7fa7b4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.203+0000 7fa7bbcf8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 0x7fa7b41a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7bbcf8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b41987e0 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7bbcf8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b41a2ff0 con 0x7fa7b4105690 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7bbcf8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b41a3130 con 0x7fa7b4100660 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40220/0 (socket says 172.21.15.139:40220) 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 -- 172.21.15.139:0/3332115155 learned_addr learned my addr 172.21.15.139:0/3332115155 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7ba295700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 0x7fa7b41a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9293700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b4100660 0x7fa7b4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 -- 172.21.15.139:0/3332115155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b4100660 msgr2=0x7fa7b4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b4100660 0x7fa7b4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 -- 172.21.15.139:0/3332115155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 msgr2=0x7fa7b41a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 0x7fa7b41a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 -- 172.21.15.139:0/3332115155 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac009d00 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7b9a94700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c9b0 tx=0x7fa7b000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007b00 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7b0007c60 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0018660 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b41a33c0 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.204+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b41a3880 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.205+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b4107a40 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.206+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa7b0018880 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.207+0000 7fa7aaffd700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 0x7fa7a00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.207+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa7b00cd480 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.207+0000 7fa7b9293700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 0x7fa7a00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.207+0000 7fa7b9293700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 0x7fa7a00a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4005950 tx=0x7fa7a40058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.210+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa7b0096710 con 0x7fa7b40ffcc0 2023-10-08T13:27:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:25 smithi187 ceph-mon[104336]: pgmap v297: 129 pgs: 129 active+clean; 641 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:25 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1327324958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:25 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3020672313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:25 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3358282877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:26.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.396+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7b40ff1e0 con 0x7fa7a00a14d0 2023-10-08T13:27:26.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.408+0000 7fa7aaffd700 1 -- 172.21.15.139:0/3332115155 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427066 (secure 0 0 0) 0x7fa7b40ff1e0 con 0x7fa7a00a14d0 2023-10-08T13:27:26.414 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:26.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 msgr2=0x7fa7a00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 0x7fa7a00a3990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4005950 tx=0x7fa7a40058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 msgr2=0x7fa7b4197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c9b0 tx=0x7fa7b000cd70 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 shutdown_connections 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa7a00a14d0 0x7fa7a00a3990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7b4105690 0x7fa7b41a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7b40ffcc0 0x7fa7b4197a30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 --2- 172.21.15.139:0/3332115155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7b4100660 0x7fa7b4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 >> 172.21.15.139:0/3332115155 conn(0x7fa7b4075a90 msgr2=0x7fa7b40fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 shutdown_connections 2023-10-08T13:27:26.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.412+0000 7fa7bbcf8700 1 -- 172.21.15.139:0/3332115155 wait complete. 2023-10-08T13:27:26.419 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:27:26.425 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2023-10-08T13:27:24.622354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656625,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":952,"num_read_kb":603,"num_write":426,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180993,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336668,"kb_used_data":12380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605156,"statfs":{"total":1151940427776,"available":1151595679744,"internally_reserved":0,"allocated":12677120,"data_stored":8229438,"data_compressed":424908,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":475,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":72,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739636+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:27:09.739636+0000","last_peered":"2023-10-08T13:27:09.739636+0000","last_clean":"2023-10-08T13:27:09.739636+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:27:09.739636+0000","last_undegraded":"2023-10-08T13:27:09.739636+0000","last_fullsized":"2023-10-08T13:27:09.739636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737982+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:27:09.737982+0000","last_peered":"2023-10-08T13:27:09.737982+0000","last_clean":"2023-10-08T13:27:09.737982+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:27:09.737982+0000","last_undegraded":"2023-10-08T13:27:09.737982+0000","last_fullsized":"2023-10-08T13:27:09.737982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737882+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:27:09.737882+0000","last_peered":"2023-10-08T13:27:09.737882+0000","last_clean":"2023-10-08T13:27:09.737882+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:27:09.737882+0000","last_undegraded":"2023-10-08T13:27:09.737882+0000","last_fullsized":"2023-10-08T13:27:09.737882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736599+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:27:09.736599+0000","last_peered":"2023-10-08T13:27:09.736599+0000","last_clean":"2023-10-08T13:27:09.736599+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:27:09.736599+0000","last_undegraded":"2023-10-08T13:27:09.736599+0000","last_fullsized":"2023-10-08T13:27:09.736599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736798+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:27:09.736798+0000","last_peered":"2023-10-08T13:27:09.736798+0000","last_clean":"2023-10-08T13:27:09.736798+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:27:09.736798+0000","last_undegraded":"2023-10-08T13:27:09.736798+0000","last_fullsized":"2023-10-08T13:27:09.736798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781660+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:27:09.781660+0000","last_peered":"2023-10-08T13:27:09.781660+0000","last_clean":"2023-10-08T13:27:09.781660+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:27:09.781660+0000","last_undegraded":"2023-10-08T13:27:09.781660+0000","last_fullsized":"2023-10-08T13:27:09.781660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732887+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:27:09.732887+0000","last_peered":"2023-10-08T13:27:09.732887+0000","last_clean":"2023-10-08T13:27:09.732887+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:27:09.732887+0000","last_undegraded":"2023-10-08T13:27:09.732887+0000","last_fullsized":"2023-10-08T13:27:09.732887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781053+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:27:09.781053+0000","last_peered":"2023-10-08T13:27:09.781053+0000","last_clean":"2023-10-08T13:27:09.781053+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:27:09.781053+0000","last_undegraded":"2023-10-08T13:27:09.781053+0000","last_fullsized":"2023-10-08T13:27:09.781053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737421+0000","last_change":"2023-10-08T13:26:09.727548+0000","last_active":"2023-10-08T13:27:09.737421+0000","last_peered":"2023-10-08T13:27:09.737421+0000","last_clean":"2023-10-08T13:27:09.737421+0000","last_became_active":"2023-10-08T13:26:09.727158+0000","last_became_peered":"2023-10-08T13:26:09.727158+0000","last_unstale":"2023-10-08T13:27:09.737421+0000","last_undegraded":"2023-10-08T13:27:09.737421+0000","last_fullsized":"2023-10-08T13:27:09.737421+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:37.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782064+0000","last_change":"2023-10-08T13:26:09.765316+0000","last_active":"2023-10-08T13:27:09.782064+0000","last_peered":"2023-10-08T13:27:09.782064+0000","last_clean":"2023-10-08T13:27:09.782064+0000","last_became_active":"2023-10-08T13:26:09.764968+0000","last_became_peered":"2023-10-08T13:26:09.764968+0000","last_unstale":"2023-10-08T13:27:09.782064+0000","last_undegraded":"2023-10-08T13:27:09.782064+0000","last_fullsized":"2023-10-08T13:27:09.782064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:40.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733393+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:27:09.733393+0000","last_peered":"2023-10-08T13:27:09.733393+0000","last_clean":"2023-10-08T13:27:09.733393+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:27:09.733393+0000","last_undegraded":"2023-10-08T13:27:09.733393+0000","last_fullsized":"2023-10-08T13:27:09.733393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736200+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:27:09.736200+0000","last_peered":"2023-10-08T13:27:09.736200+0000","last_clean":"2023-10-08T13:27:09.736200+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:27:09.736200+0000","last_undegraded":"2023-10-08T13:27:09.736200+0000","last_fullsized":"2023-10-08T13:27:09.736200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781483+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:27:09.781483+0000","last_peered":"2023-10-08T13:27:09.781483+0000","last_clean":"2023-10-08T13:27:09.781483+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:27:09.781483+0000","last_undegraded":"2023-10-08T13:27:09.781483+0000","last_fullsized":"2023-10-08T13:27:09.781483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735623+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:27:09.735623+0000","last_peered":"2023-10-08T13:27:09.735623+0000","last_clean":"2023-10-08T13:27:09.735623+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:27:09.735623+0000","last_undegraded":"2023-10-08T13:27:09.735623+0000","last_fullsized":"2023-10-08T13:27:09.735623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739508+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:27:09.739508+0000","last_peered":"2023-10-08T13:27:09.739508+0000","last_clean":"2023-10-08T13:27:09.739508+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:27:09.739508+0000","last_undegraded":"2023-10-08T13:27:09.739508+0000","last_fullsized":"2023-10-08T13:27:09.739508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782096+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:27:09.782096+0000","last_peered":"2023-10-08T13:27:09.782096+0000","last_clean":"2023-10-08T13:27:09.782096+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:27:09.782096+0000","last_undegraded":"2023-10-08T13:27:09.782096+0000","last_fullsized":"2023-10-08T13:27:09.782096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739100+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:27:09.739100+0000","last_peered":"2023-10-08T13:27:09.739100+0000","last_clean":"2023-10-08T13:27:09.739100+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:27:09.739100+0000","last_undegraded":"2023-10-08T13:27:09.739100+0000","last_fullsized":"2023-10-08T13:27:09.739100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737214+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:27:09.737214+0000","last_peered":"2023-10-08T13:27:09.737214+0000","last_clean":"2023-10-08T13:27:09.737214+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:27:09.737214+0000","last_undegraded":"2023-10-08T13:27:09.737214+0000","last_fullsized":"2023-10-08T13:27:09.737214+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":113,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:20.527553+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:27:20.527553+0000","last_peered":"2023-10-08T13:27:20.527553+0000","last_clean":"2023-10-08T13:27:20.527553+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:27:20.527553+0000","last_undegraded":"2023-10-08T13:27:20.527553+0000","last_fullsized":"2023-10-08T13:27:20.527553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782523+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:27:09.782523+0000","last_peered":"2023-10-08T13:27:09.782523+0000","last_clean":"2023-10-08T13:27:09.782523+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:27:09.782523+0000","last_undegraded":"2023-10-08T13:27:09.782523+0000","last_fullsized":"2023-10-08T13:27:09.782523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735909+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:27:09.735909+0000","last_peered":"2023-10-08T13:27:09.735909+0000","last_clean":"2023-10-08T13:27:09.735909+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:27:09.735909+0000","last_undegraded":"2023-10-08T13:27:09.735909+0000","last_fullsized":"2023-10-08T13:27:09.735909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782569+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:27:09.782569+0000","last_peered":"2023-10-08T13:27:09.782569+0000","last_clean":"2023-10-08T13:27:09.782569+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:27:09.782569+0000","last_undegraded":"2023-10-08T13:27:09.782569+0000","last_fullsized":"2023-10-08T13:27:09.782569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737765+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:27:09.737765+0000","last_peered":"2023-10-08T13:27:09.737765+0000","last_clean":"2023-10-08T13:27:09.737765+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:27:09.737765+0000","last_undegraded":"2023-10-08T13:27:09.737765+0000","last_fullsized":"2023-10-08T13:27:09.737765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736199+0000","last_change":"2023-10-08T13:26:09.765180+0000","last_active":"2023-10-08T13:27:09.736199+0000","last_peered":"2023-10-08T13:27:09.736199+0000","last_clean":"2023-10-08T13:27:09.736199+0000","last_became_active":"2023-10-08T13:26:09.764692+0000","last_became_peered":"2023-10-08T13:26:09.764692+0000","last_unstale":"2023-10-08T13:27:09.736199+0000","last_undegraded":"2023-10-08T13:27:09.736199+0000","last_fullsized":"2023-10-08T13:27:09.736199+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:15.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736865+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:27:09.736865+0000","last_peered":"2023-10-08T13:27:09.736865+0000","last_clean":"2023-10-08T13:27:09.736865+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:27:09.736865+0000","last_undegraded":"2023-10-08T13:27:09.736865+0000","last_fullsized":"2023-10-08T13:27:09.736865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736922+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:27:09.736922+0000","last_peered":"2023-10-08T13:27:09.736922+0000","last_clean":"2023-10-08T13:27:09.736922+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:27:09.736922+0000","last_undegraded":"2023-10-08T13:27:09.736922+0000","last_fullsized":"2023-10-08T13:27:09.736922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735990+0000","last_change":"2023-10-08T13:26:09.765527+0000","last_active":"2023-10-08T13:27:09.735990+0000","last_peered":"2023-10-08T13:27:09.735990+0000","last_clean":"2023-10-08T13:27:09.735990+0000","last_became_active":"2023-10-08T13:26:09.764823+0000","last_became_peered":"2023-10-08T13:26:09.764823+0000","last_unstale":"2023-10-08T13:27:09.735990+0000","last_undegraded":"2023-10-08T13:27:09.735990+0000","last_fullsized":"2023-10-08T13:27:09.735990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:28:41.632170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736470+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:27:09.736470+0000","last_peered":"2023-10-08T13:27:09.736470+0000","last_clean":"2023-10-08T13:27:09.736470+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:27:09.736470+0000","last_undegraded":"2023-10-08T13:27:09.736470+0000","last_fullsized":"2023-10-08T13:27:09.736470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741593+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:27:09.741593+0000","last_peered":"2023-10-08T13:27:09.741593+0000","last_clean":"2023-10-08T13:27:09.741593+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:27:09.741593+0000","last_undegraded":"2023-10-08T13:27:09.741593+0000","last_fullsized":"2023-10-08T13:27:09.741593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738840+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:27:09.738840+0000","last_peered":"2023-10-08T13:27:09.738840+0000","last_clean":"2023-10-08T13:27:09.738840+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:27:09.738840+0000","last_undegraded":"2023-10-08T13:27:09.738840+0000","last_fullsized":"2023-10-08T13:27:09.738840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'7","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:19.527956+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:27:19.527956+0000","last_peered":"2023-10-08T13:27:19.527956+0000","last_clean":"2023-10-08T13:27:19.527956+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:27:19.527956+0000","last_undegraded":"2023-10-08T13:27:19.527956+0000","last_fullsized":"2023-10-08T13:27:19.527956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736810+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:27:09.736810+0000","last_peered":"2023-10-08T13:27:09.736810+0000","last_clean":"2023-10-08T13:27:09.736810+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:27:09.736810+0000","last_undegraded":"2023-10-08T13:27:09.736810+0000","last_fullsized":"2023-10-08T13:27:09.736810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738971+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:27:09.738971+0000","last_peered":"2023-10-08T13:27:09.738971+0000","last_clean":"2023-10-08T13:27:09.738971+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:27:09.738971+0000","last_undegraded":"2023-10-08T13:27:09.738971+0000","last_fullsized":"2023-10-08T13:27:09.738971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781654+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:27:09.781654+0000","last_peered":"2023-10-08T13:27:09.781654+0000","last_clean":"2023-10-08T13:27:09.781654+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:27:09.781654+0000","last_undegraded":"2023-10-08T13:27:09.781654+0000","last_fullsized":"2023-10-08T13:27:09.781654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741675+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:27:09.741675+0000","last_peered":"2023-10-08T13:27:09.741675+0000","last_clean":"2023-10-08T13:27:09.741675+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:27:09.741675+0000","last_undegraded":"2023-10-08T13:27:09.741675+0000","last_fullsized":"2023-10-08T13:27:09.741675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739462+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:27:09.739462+0000","last_peered":"2023-10-08T13:27:09.739462+0000","last_clean":"2023-10-08T13:27:09.739462+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:27:09.739462+0000","last_undegraded":"2023-10-08T13:27:09.739462+0000","last_fullsized":"2023-10-08T13:27:09.739462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781165+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:27:09.781165+0000","last_peered":"2023-10-08T13:27:09.781165+0000","last_clean":"2023-10-08T13:27:09.781165+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:27:09.781165+0000","last_undegraded":"2023-10-08T13:27:09.781165+0000","last_fullsized":"2023-10-08T13:27:09.781165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780962+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:27:09.780962+0000","last_peered":"2023-10-08T13:27:09.780962+0000","last_clean":"2023-10-08T13:27:09.780962+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:27:09.780962+0000","last_undegraded":"2023-10-08T13:27:09.780962+0000","last_fullsized":"2023-10-08T13:27:09.780962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737865+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:27:09.737865+0000","last_peered":"2023-10-08T13:27:09.737865+0000","last_clean":"2023-10-08T13:27:09.737865+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:27:09.737865+0000","last_undegraded":"2023-10-08T13:27:09.737865+0000","last_fullsized":"2023-10-08T13:27:09.737865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741169+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:27:09.741169+0000","last_peered":"2023-10-08T13:27:09.741169+0000","last_clean":"2023-10-08T13:27:09.741169+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:27:09.741169+0000","last_undegraded":"2023-10-08T13:27:09.741169+0000","last_fullsized":"2023-10-08T13:27:09.741169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781742+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:27:09.781742+0000","last_peered":"2023-10-08T13:27:09.781742+0000","last_clean":"2023-10-08T13:27:09.781742+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:27:09.781742+0000","last_undegraded":"2023-10-08T13:27:09.781742+0000","last_fullsized":"2023-10-08T13:27:09.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781544+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:27:09.781544+0000","last_peered":"2023-10-08T13:27:09.781544+0000","last_clean":"2023-10-08T13:27:09.781544+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:27:09.781544+0000","last_undegraded":"2023-10-08T13:27:09.781544+0000","last_fullsized":"2023-10-08T13:27:09.781544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531560+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:27:22.531560+0000","last_peered":"2023-10-08T13:27:22.531560+0000","last_clean":"2023-10-08T13:27:22.531560+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:27:22.531560+0000","last_undegraded":"2023-10-08T13:27:22.531560+0000","last_fullsized":"2023-10-08T13:27:22.531560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737319+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:27:09.737319+0000","last_peered":"2023-10-08T13:27:09.737319+0000","last_clean":"2023-10-08T13:27:09.737319+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:27:09.737319+0000","last_undegraded":"2023-10-08T13:27:09.737319+0000","last_fullsized":"2023-10-08T13:27:09.737319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781429+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:27:09.781429+0000","last_peered":"2023-10-08T13:27:09.781429+0000","last_clean":"2023-10-08T13:27:09.781429+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:27:09.781429+0000","last_undegraded":"2023-10-08T13:27:09.781429+0000","last_fullsized":"2023-10-08T13:27:09.781429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.759323+0000","last_change":"2023-10-08T13:27:10.759323+0000","last_active":"2023-10-08T13:27:10.759323+0000","last_peered":"2023-10-08T13:27:10.759323+0000","last_clean":"2023-10-08T13:27:10.759323+0000","last_became_active":"2023-10-08T13:27:10.744684+0000","last_became_peered":"2023-10-08T13:27:10.744684+0000","last_unstale":"2023-10-08T13:27:10.759323+0000","last_undegraded":"2023-10-08T13:27:10.759323+0000","last_fullsized":"2023-10-08T13:27:10.759323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:26.169261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737905+0000","last_change":"2023-10-08T13:26:09.730654+0000","last_active":"2023-10-08T13:27:09.737905+0000","last_peered":"2023-10-08T13:27:09.737905+0000","last_clean":"2023-10-08T13:27:09.737905+0000","last_became_active":"2023-10-08T13:26:09.730372+0000","last_became_peered":"2023-10-08T13:26:09.730372+0000","last_unstale":"2023-10-08T13:27:09.737905+0000","last_undegraded":"2023-10-08T13:27:09.737905+0000","last_fullsized":"2023-10-08T13:27:09.737905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:10:09.821192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736469+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:27:09.736469+0000","last_peered":"2023-10-08T13:27:09.736469+0000","last_clean":"2023-10-08T13:27:09.736469+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:27:09.736469+0000","last_undegraded":"2023-10-08T13:27:09.736469+0000","last_fullsized":"2023-10-08T13:27:09.736469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741923+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:27:09.741923+0000","last_peered":"2023-10-08T13:27:09.741923+0000","last_clean":"2023-10-08T13:27:09.741923+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:27:09.741923+0000","last_undegraded":"2023-10-08T13:27:09.741923+0000","last_fullsized":"2023-10-08T13:27:09.741923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737113+0000","last_change":"2023-10-08T13:26:09.724775+0000","last_active":"2023-10-08T13:27:09.737113+0000","last_peered":"2023-10-08T13:27:09.737113+0000","last_clean":"2023-10-08T13:27:09.737113+0000","last_became_active":"2023-10-08T13:26:09.724388+0000","last_became_peered":"2023-10-08T13:26:09.724388+0000","last_unstale":"2023-10-08T13:27:09.737113+0000","last_undegraded":"2023-10-08T13:27:09.737113+0000","last_fullsized":"2023-10-08T13:27:09.737113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:17.186799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781804+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:27:09.781804+0000","last_peered":"2023-10-08T13:27:09.781804+0000","last_clean":"2023-10-08T13:27:09.781804+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:27:09.781804+0000","last_undegraded":"2023-10-08T13:27:09.781804+0000","last_fullsized":"2023-10-08T13:27:09.781804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'37","reported_seq":223,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531836+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:27:22.531836+0000","last_peered":"2023-10-08T13:27:22.531836+0000","last_clean":"2023-10-08T13:27:22.531836+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:27:22.531836+0000","last_undegraded":"2023-10-08T13:27:22.531836+0000","last_fullsized":"2023-10-08T13:27:22.531836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":140,"num_write":39,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736425+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:27:09.736425+0000","last_peered":"2023-10-08T13:27:09.736425+0000","last_clean":"2023-10-08T13:27:09.736425+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:27:09.736425+0000","last_undegraded":"2023-10-08T13:27:09.736425+0000","last_fullsized":"2023-10-08T13:27:09.736425+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741783+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:27:09.741783+0000","last_peered":"2023-10-08T13:27:09.741783+0000","last_clean":"2023-10-08T13:27:09.741783+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:27:09.741783+0000","last_undegraded":"2023-10-08T13:27:09.741783+0000","last_fullsized":"2023-10-08T13:27:09.741783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739315+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:27:09.739315+0000","last_peered":"2023-10-08T13:27:09.739315+0000","last_clean":"2023-10-08T13:27:09.739315+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:27:09.739315+0000","last_undegraded":"2023-10-08T13:27:09.739315+0000","last_fullsized":"2023-10-08T13:27:09.739315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781253+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:27:09.781253+0000","last_peered":"2023-10-08T13:27:09.781253+0000","last_clean":"2023-10-08T13:27:09.781253+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:27:09.781253+0000","last_undegraded":"2023-10-08T13:27:09.781253+0000","last_fullsized":"2023-10-08T13:27:09.781253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738562+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:27:09.738562+0000","last_peered":"2023-10-08T13:27:09.738562+0000","last_clean":"2023-10-08T13:27:09.738562+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:27:09.738562+0000","last_undegraded":"2023-10-08T13:27:09.738562+0000","last_fullsized":"2023-10-08T13:27:09.738562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741489+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:27:09.741489+0000","last_peered":"2023-10-08T13:27:09.741489+0000","last_clean":"2023-10-08T13:27:09.741489+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:27:09.741489+0000","last_undegraded":"2023-10-08T13:27:09.741489+0000","last_fullsized":"2023-10-08T13:27:09.741489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733295+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:27:09.733295+0000","last_peered":"2023-10-08T13:27:09.733295+0000","last_clean":"2023-10-08T13:27:09.733295+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:27:09.733295+0000","last_undegraded":"2023-10-08T13:27:09.733295+0000","last_fullsized":"2023-10-08T13:27:09.733295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782207+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:27:09.782207+0000","last_peered":"2023-10-08T13:27:09.782207+0000","last_clean":"2023-10-08T13:27:09.782207+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:27:09.782207+0000","last_undegraded":"2023-10-08T13:27:09.782207+0000","last_fullsized":"2023-10-08T13:27:09.782207+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:19.526960+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:27:19.526960+0000","last_peered":"2023-10-08T13:27:19.526960+0000","last_clean":"2023-10-08T13:27:19.526960+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:27:19.526960+0000","last_undegraded":"2023-10-08T13:27:19.526960+0000","last_fullsized":"2023-10-08T13:27:19.526960+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732939+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:27:09.732939+0000","last_peered":"2023-10-08T13:27:09.732939+0000","last_clean":"2023-10-08T13:27:09.732939+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:27:09.732939+0000","last_undegraded":"2023-10-08T13:27:09.732939+0000","last_fullsized":"2023-10-08T13:27:09.732939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781639+0000","last_change":"2023-10-08T13:26:09.765328+0000","last_active":"2023-10-08T13:27:09.781639+0000","last_peered":"2023-10-08T13:27:09.781639+0000","last_clean":"2023-10-08T13:27:09.781639+0000","last_became_active":"2023-10-08T13:26:09.764889+0000","last_became_peered":"2023-10-08T13:26:09.764889+0000","last_unstale":"2023-10-08T13:27:09.781639+0000","last_undegraded":"2023-10-08T13:27:09.781639+0000","last_fullsized":"2023-10-08T13:27:09.781639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:54.280258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.756068+0000","last_change":"2023-10-08T13:27:10.756068+0000","last_active":"2023-10-08T13:27:10.756068+0000","last_peered":"2023-10-08T13:27:10.756068+0000","last_clean":"2023-10-08T13:27:10.756068+0000","last_became_active":"2023-10-08T13:27:10.742701+0000","last_became_peered":"2023-10-08T13:27:10.742701+0000","last_unstale":"2023-10-08T13:27:10.756068+0000","last_undegraded":"2023-10-08T13:27:10.756068+0000","last_fullsized":"2023-10-08T13:27:10.756068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:44:20.540492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741532+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:27:09.741532+0000","last_peered":"2023-10-08T13:27:09.741532+0000","last_clean":"2023-10-08T13:27:09.741532+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:27:09.741532+0000","last_undegraded":"2023-10-08T13:27:09.741532+0000","last_fullsized":"2023-10-08T13:27:09.741532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741286+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:27:09.741286+0000","last_peered":"2023-10-08T13:27:09.741286+0000","last_clean":"2023-10-08T13:27:09.741286+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:27:09.741286+0000","last_undegraded":"2023-10-08T13:27:09.741286+0000","last_fullsized":"2023-10-08T13:27:09.741286+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.750176+0000","last_change":"2023-10-08T13:27:10.749693+0000","last_active":"2023-10-08T13:27:10.750176+0000","last_peered":"2023-10-08T13:27:10.750176+0000","last_clean":"2023-10-08T13:27:10.750176+0000","last_became_active":"2023-10-08T13:27:10.744809+0000","last_became_peered":"2023-10-08T13:27:10.744809+0000","last_unstale":"2023-10-08T13:27:10.750176+0000","last_undegraded":"2023-10-08T13:27:10.750176+0000","last_fullsized":"2023-10-08T13:27:10.750176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:13.914394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739047+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:27:09.739047+0000","last_peered":"2023-10-08T13:27:09.739047+0000","last_clean":"2023-10-08T13:27:09.739047+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:27:09.739047+0000","last_undegraded":"2023-10-08T13:27:09.739047+0000","last_fullsized":"2023-10-08T13:27:09.739047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736900+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:27:09.736900+0000","last_peered":"2023-10-08T13:27:09.736900+0000","last_clean":"2023-10-08T13:27:09.736900+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:27:09.736900+0000","last_undegraded":"2023-10-08T13:27:09.736900+0000","last_fullsized":"2023-10-08T13:27:09.736900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782110+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:27:09.782110+0000","last_peered":"2023-10-08T13:27:09.782110+0000","last_clean":"2023-10-08T13:27:09.782110+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:27:09.782110+0000","last_undegraded":"2023-10-08T13:27:09.782110+0000","last_fullsized":"2023-10-08T13:27:09.782110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781996+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:27:09.781996+0000","last_peered":"2023-10-08T13:27:09.781996+0000","last_clean":"2023-10-08T13:27:09.781996+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:27:09.781996+0000","last_undegraded":"2023-10-08T13:27:09.781996+0000","last_fullsized":"2023-10-08T13:27:09.781996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782909+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:27:09.782909+0000","last_peered":"2023-10-08T13:27:09.782909+0000","last_clean":"2023-10-08T13:27:09.782909+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:27:09.782909+0000","last_undegraded":"2023-10-08T13:27:09.782909+0000","last_fullsized":"2023-10-08T13:27:09.782909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:18.525468+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:27:18.525468+0000","last_peered":"2023-10-08T13:27:18.525468+0000","last_clean":"2023-10-08T13:27:18.525468+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:27:18.525468+0000","last_undegraded":"2023-10-08T13:27:18.525468+0000","last_fullsized":"2023-10-08T13:27:18.525468+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":77,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781800+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:27:09.781800+0000","last_peered":"2023-10-08T13:27:09.781800+0000","last_clean":"2023-10-08T13:27:09.781800+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:27:09.781800+0000","last_undegraded":"2023-10-08T13:27:09.781800+0000","last_fullsized":"2023-10-08T13:27:09.781800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781334+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:27:09.781334+0000","last_peered":"2023-10-08T13:27:09.781334+0000","last_clean":"2023-10-08T13:27:09.781334+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:27:09.781334+0000","last_undegraded":"2023-10-08T13:27:09.781334+0000","last_fullsized":"2023-10-08T13:27:09.781334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741292+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:27:09.741292+0000","last_peered":"2023-10-08T13:27:09.741292+0000","last_clean":"2023-10-08T13:27:09.741292+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:27:09.741292+0000","last_undegraded":"2023-10-08T13:27:09.741292+0000","last_fullsized":"2023-10-08T13:27:09.741292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.530346+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:27:22.530346+0000","last_peered":"2023-10-08T13:27:22.530346+0000","last_clean":"2023-10-08T13:27:22.530346+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:27:22.530346+0000","last_undegraded":"2023-10-08T13:27:22.530346+0000","last_fullsized":"2023-10-08T13:27:22.530346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733299+0000","last_change":"2023-10-08T13:26:09.734878+0000","last_active":"2023-10-08T13:27:09.733299+0000","last_peered":"2023-10-08T13:27:09.733299+0000","last_clean":"2023-10-08T13:27:09.733299+0000","last_became_active":"2023-10-08T13:26:09.730200+0000","last_became_peered":"2023-10-08T13:26:09.730200+0000","last_unstale":"2023-10-08T13:27:09.733299+0000","last_undegraded":"2023-10-08T13:27:09.733299+0000","last_fullsized":"2023-10-08T13:27:09.733299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:33.060346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781752+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:27:09.781752+0000","last_peered":"2023-10-08T13:27:09.781752+0000","last_clean":"2023-10-08T13:27:09.781752+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:27:09.781752+0000","last_undegraded":"2023-10-08T13:27:09.781752+0000","last_fullsized":"2023-10-08T13:27:09.781752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736317+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:27:09.736317+0000","last_peered":"2023-10-08T13:27:09.736317+0000","last_clean":"2023-10-08T13:27:09.736317+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:27:09.736317+0000","last_undegraded":"2023-10-08T13:27:09.736317+0000","last_fullsized":"2023-10-08T13:27:09.736317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":324,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732798+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:27:09.732798+0000","last_peered":"2023-10-08T13:27:09.732798+0000","last_clean":"2023-10-08T13:27:09.732798+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:27:09.732798+0000","last_undegraded":"2023-10-08T13:27:09.732798+0000","last_fullsized":"2023-10-08T13:27:09.732798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741629+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:27:09.741629+0000","last_peered":"2023-10-08T13:27:09.741629+0000","last_clean":"2023-10-08T13:27:09.741629+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:27:09.741629+0000","last_undegraded":"2023-10-08T13:27:09.741629+0000","last_fullsized":"2023-10-08T13:27:09.741629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780968+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:27:09.780968+0000","last_peered":"2023-10-08T13:27:09.780968+0000","last_clean":"2023-10-08T13:27:09.780968+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:27:09.780968+0000","last_undegraded":"2023-10-08T13:27:09.780968+0000","last_fullsized":"2023-10-08T13:27:09.780968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732943+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:27:09.732943+0000","last_peered":"2023-10-08T13:27:09.732943+0000","last_clean":"2023-10-08T13:27:09.732943+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:27:09.732943+0000","last_undegraded":"2023-10-08T13:27:09.732943+0000","last_fullsized":"2023-10-08T13:27:09.732943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738569+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:27:09.738569+0000","last_peered":"2023-10-08T13:27:09.738569+0000","last_clean":"2023-10-08T13:27:09.738569+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:27:09.738569+0000","last_undegraded":"2023-10-08T13:27:09.738569+0000","last_fullsized":"2023-10-08T13:27:09.738569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736536+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:27:09.736536+0000","last_peered":"2023-10-08T13:27:09.736536+0000","last_clean":"2023-10-08T13:27:09.736536+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:27:09.736536+0000","last_undegraded":"2023-10-08T13:27:09.736536+0000","last_fullsized":"2023-10-08T13:27:09.736536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782820+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:27:09.782820+0000","last_peered":"2023-10-08T13:27:09.782820+0000","last_clean":"2023-10-08T13:27:09.782820+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:27:09.782820+0000","last_undegraded":"2023-10-08T13:27:09.782820+0000","last_fullsized":"2023-10-08T13:27:09.782820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780955+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:27:09.780955+0000","last_peered":"2023-10-08T13:27:09.780955+0000","last_clean":"2023-10-08T13:27:09.780955+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:27:09.780955+0000","last_undegraded":"2023-10-08T13:27:09.780955+0000","last_fullsized":"2023-10-08T13:27:09.780955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:11.489730+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:27:11.489730+0000","last_peered":"2023-10-08T13:27:11.489730+0000","last_clean":"2023-10-08T13:27:11.489730+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:27:11.489730+0000","last_undegraded":"2023-10-08T13:27:11.489730+0000","last_fullsized":"2023-10-08T13:27:11.489730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782391+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:27:09.782391+0000","last_peered":"2023-10-08T13:27:09.782391+0000","last_clean":"2023-10-08T13:27:09.782391+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:27:09.782391+0000","last_undegraded":"2023-10-08T13:27:09.782391+0000","last_fullsized":"2023-10-08T13:27:09.782391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737106+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:27:09.737106+0000","last_peered":"2023-10-08T13:27:09.737106+0000","last_clean":"2023-10-08T13:27:09.737106+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:27:09.737106+0000","last_undegraded":"2023-10-08T13:27:09.737106+0000","last_fullsized":"2023-10-08T13:27:09.737106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736980+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:27:09.736980+0000","last_peered":"2023-10-08T13:27:09.736980+0000","last_clean":"2023-10-08T13:27:09.736980+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:27:09.736980+0000","last_undegraded":"2023-10-08T13:27:09.736980+0000","last_fullsized":"2023-10-08T13:27:09.736980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738015+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:27:09.738015+0000","last_peered":"2023-10-08T13:27:09.738015+0000","last_clean":"2023-10-08T13:27:09.738015+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:27:09.738015+0000","last_undegraded":"2023-10-08T13:27:09.738015+0000","last_fullsized":"2023-10-08T13:27:09.738015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736655+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:27:09.736655+0000","last_peered":"2023-10-08T13:27:09.736655+0000","last_clean":"2023-10-08T13:27:09.736655+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:27:09.736655+0000","last_undegraded":"2023-10-08T13:27:09.736655+0000","last_fullsized":"2023-10-08T13:27:09.736655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735735+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:27:09.735735+0000","last_peered":"2023-10-08T13:27:09.735735+0000","last_clean":"2023-10-08T13:27:09.735735+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:27:09.735735+0000","last_undegraded":"2023-10-08T13:27:09.735735+0000","last_fullsized":"2023-10-08T13:27:09.735735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735869+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:27:09.735869+0000","last_peered":"2023-10-08T13:27:09.735869+0000","last_clean":"2023-10-08T13:27:09.735869+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:27:09.735869+0000","last_undegraded":"2023-10-08T13:27:09.735869+0000","last_fullsized":"2023-10-08T13:27:09.735869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782360+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:27:09.782360+0000","last_peered":"2023-10-08T13:27:09.782360+0000","last_clean":"2023-10-08T13:27:09.782360+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:27:09.782360+0000","last_undegraded":"2023-10-08T13:27:09.782360+0000","last_fullsized":"2023-10-08T13:27:09.782360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781395+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:27:09.781395+0000","last_peered":"2023-10-08T13:27:09.781395+0000","last_clean":"2023-10-08T13:27:09.781395+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:27:09.781395+0000","last_undegraded":"2023-10-08T13:27:09.781395+0000","last_fullsized":"2023-10-08T13:27:09.781395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737259+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:27:09.737259+0000","last_peered":"2023-10-08T13:27:09.737259+0000","last_clean":"2023-10-08T13:27:09.737259+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:27:09.737259+0000","last_undegraded":"2023-10-08T13:27:09.737259+0000","last_fullsized":"2023-10-08T13:27:09.737259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735940+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:27:09.735940+0000","last_peered":"2023-10-08T13:27:09.735940+0000","last_clean":"2023-10-08T13:27:09.735940+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:27:09.735940+0000","last_undegraded":"2023-10-08T13:27:09.735940+0000","last_fullsized":"2023-10-08T13:27:09.735940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739206+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:27:09.739206+0000","last_peered":"2023-10-08T13:27:09.739206+0000","last_clean":"2023-10-08T13:27:09.739206+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:27:09.739206+0000","last_undegraded":"2023-10-08T13:27:09.739206+0000","last_fullsized":"2023-10-08T13:27:09.739206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781680+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:27:09.781680+0000","last_peered":"2023-10-08T13:27:09.781680+0000","last_clean":"2023-10-08T13:27:09.781680+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:27:09.781680+0000","last_undegraded":"2023-10-08T13:27:09.781680+0000","last_fullsized":"2023-10-08T13:27:09.781680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736305+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:27:09.736305+0000","last_peered":"2023-10-08T13:27:09.736305+0000","last_clean":"2023-10-08T13:27:09.736305+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:27:09.736305+0000","last_undegraded":"2023-10-08T13:27:09.736305+0000","last_fullsized":"2023-10-08T13:27:09.736305+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.753812+0000","last_change":"2023-10-08T13:27:10.753399+0000","last_active":"2023-10-08T13:27:10.753812+0000","last_peered":"2023-10-08T13:27:10.753812+0000","last_clean":"2023-10-08T13:27:10.753812+0000","last_became_active":"2023-10-08T13:27:10.745101+0000","last_became_peered":"2023-10-08T13:27:10.745101+0000","last_unstale":"2023-10-08T13:27:10.753812+0000","last_undegraded":"2023-10-08T13:27:10.753812+0000","last_fullsized":"2023-10-08T13:27:10.753812+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:43.743911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733014+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:27:09.733014+0000","last_peered":"2023-10-08T13:27:09.733014+0000","last_clean":"2023-10-08T13:27:09.733014+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:27:09.733014+0000","last_undegraded":"2023-10-08T13:27:09.733014+0000","last_fullsized":"2023-10-08T13:27:09.733014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735936+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:27:09.735936+0000","last_peered":"2023-10-08T13:27:09.735936+0000","last_clean":"2023-10-08T13:27:09.735936+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:27:09.735936+0000","last_undegraded":"2023-10-08T13:27:09.735936+0000","last_fullsized":"2023-10-08T13:27:09.735936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":103,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:18.526357+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:27:18.526357+0000","last_peered":"2023-10-08T13:27:18.526357+0000","last_clean":"2023-10-08T13:27:18.526357+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:27:18.526357+0000","last_undegraded":"2023-10-08T13:27:18.526357+0000","last_fullsized":"2023-10-08T13:27:18.526357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733459+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:27:09.733459+0000","last_peered":"2023-10-08T13:27:09.733459+0000","last_clean":"2023-10-08T13:27:09.733459+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:27:09.733459+0000","last_undegraded":"2023-10-08T13:27:09.733459+0000","last_fullsized":"2023-10-08T13:27:09.733459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741660+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:27:09.741660+0000","last_peered":"2023-10-08T13:27:09.741660+0000","last_clean":"2023-10-08T13:27:09.741660+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:27:09.741660+0000","last_undegraded":"2023-10-08T13:27:09.741660+0000","last_fullsized":"2023-10-08T13:27:09.741660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733214+0000","last_change":"2023-10-08T13:26:09.729493+0000","last_active":"2023-10-08T13:27:09.733214+0000","last_peered":"2023-10-08T13:27:09.733214+0000","last_clean":"2023-10-08T13:27:09.733214+0000","last_became_active":"2023-10-08T13:26:09.729238+0000","last_became_peered":"2023-10-08T13:26:09.729238+0000","last_unstale":"2023-10-08T13:27:09.733214+0000","last_undegraded":"2023-10-08T13:27:09.733214+0000","last_fullsized":"2023-10-08T13:27:09.733214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.262086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741059+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:27:09.741059+0000","last_peered":"2023-10-08T13:27:09.741059+0000","last_clean":"2023-10-08T13:27:09.741059+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:27:09.741059+0000","last_undegraded":"2023-10-08T13:27:09.741059+0000","last_fullsized":"2023-10-08T13:27:09.741059+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781723+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:27:09.781723+0000","last_peered":"2023-10-08T13:27:09.781723+0000","last_clean":"2023-10-08T13:27:09.781723+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:27:09.781723+0000","last_undegraded":"2023-10-08T13:27:09.781723+0000","last_fullsized":"2023-10-08T13:27:09.781723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733686+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:27:09.733686+0000","last_peered":"2023-10-08T13:27:09.733686+0000","last_clean":"2023-10-08T13:27:09.733686+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:27:09.733686+0000","last_undegraded":"2023-10-08T13:27:09.733686+0000","last_fullsized":"2023-10-08T13:27:09.733686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737343+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:27:09.737343+0000","last_peered":"2023-10-08T13:27:09.737343+0000","last_clean":"2023-10-08T13:27:09.737343+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:27:09.737343+0000","last_undegraded":"2023-10-08T13:27:09.737343+0000","last_fullsized":"2023-10-08T13:27:09.737343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738392+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:27:09.738392+0000","last_peered":"2023-10-08T13:27:09.738392+0000","last_clean":"2023-10-08T13:27:09.738392+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:27:09.738392+0000","last_undegraded":"2023-10-08T13:27:09.738392+0000","last_fullsized":"2023-10-08T13:27:09.738392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738345+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:27:09.738345+0000","last_peered":"2023-10-08T13:27:09.738345+0000","last_clean":"2023-10-08T13:27:09.738345+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:27:09.738345+0000","last_undegraded":"2023-10-08T13:27:09.738345+0000","last_fullsized":"2023-10-08T13:27:09.738345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737841+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:27:09.737841+0000","last_peered":"2023-10-08T13:27:09.737841+0000","last_clean":"2023-10-08T13:27:09.737841+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:27:09.737841+0000","last_undegraded":"2023-10-08T13:27:09.737841+0000","last_fullsized":"2023-10-08T13:27:09.737841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782767+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:27:09.782767+0000","last_peered":"2023-10-08T13:27:09.782767+0000","last_clean":"2023-10-08T13:27:09.782767+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:27:09.782767+0000","last_undegraded":"2023-10-08T13:27:09.782767+0000","last_fullsized":"2023-10-08T13:27:09.782767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739358+0000","last_change":"2023-10-08T13:26:09.729602+0000","last_active":"2023-10-08T13:27:09.739358+0000","last_peered":"2023-10-08T13:27:09.739358+0000","last_clean":"2023-10-08T13:27:09.739358+0000","last_became_active":"2023-10-08T13:26:09.729112+0000","last_became_peered":"2023-10-08T13:26:09.729112+0000","last_unstale":"2023-10-08T13:27:09.739358+0000","last_undegraded":"2023-10-08T13:27:09.739358+0000","last_fullsized":"2023-10-08T13:27:09.739358+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:29.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739001+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:27:09.739001+0000","last_peered":"2023-10-08T13:27:09.739001+0000","last_clean":"2023-10-08T13:27:09.739001+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:27:09.739001+0000","last_undegraded":"2023-10-08T13:27:09.739001+0000","last_fullsized":"2023-10-08T13:27:09.739001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782672+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:27:09.782672+0000","last_peered":"2023-10-08T13:27:09.782672+0000","last_clean":"2023-10-08T13:27:09.782672+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:27:09.782672+0000","last_undegraded":"2023-10-08T13:27:09.782672+0000","last_fullsized":"2023-10-08T13:27:09.782672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741194+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:27:09.741194+0000","last_peered":"2023-10-08T13:27:09.741194+0000","last_clean":"2023-10-08T13:27:09.741194+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:27:09.741194+0000","last_undegraded":"2023-10-08T13:27:09.741194+0000","last_fullsized":"2023-10-08T13:27:09.741194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781309+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:27:09.781309+0000","last_peered":"2023-10-08T13:27:09.781309+0000","last_clean":"2023-10-08T13:27:09.781309+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:27:09.781309+0000","last_undegraded":"2023-10-08T13:27:09.781309+0000","last_fullsized":"2023-10-08T13:27:09.781309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736159+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:27:09.736159+0000","last_peered":"2023-10-08T13:27:09.736159+0000","last_clean":"2023-10-08T13:27:09.736159+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:27:09.736159+0000","last_undegraded":"2023-10-08T13:27:09.736159+0000","last_fullsized":"2023-10-08T13:27:09.736159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781373+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:27:09.781373+0000","last_peered":"2023-10-08T13:27:09.781373+0000","last_clean":"2023-10-08T13:27:09.781373+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:27:09.781373+0000","last_undegraded":"2023-10-08T13:27:09.781373+0000","last_fullsized":"2023-10-08T13:27:09.781373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738775+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:27:09.738775+0000","last_peered":"2023-10-08T13:27:09.738775+0000","last_clean":"2023-10-08T13:27:09.738775+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:27:09.738775+0000","last_undegraded":"2023-10-08T13:27:09.738775+0000","last_fullsized":"2023-10-08T13:27:09.738775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66011,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":816,"num_read_kb":484,"num_write":243,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":524372,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.5},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89000000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.625},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90900000000000003,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.54900000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.753},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.65800000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93100000000000005,"5min":1.617,"15min":1.617},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.65400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.77700000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.68899999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0900000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.68899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.872}]}]},{"osd":10,"up_from":71,"seq":304942678054,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1159168,"data_stored":1173989,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":9.8559999999999999,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.8759999999999994,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.498}]},{"osd":3,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.32500000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.075,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.57499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.86199999999999999,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.7279999999999998,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2539999999999996,"5min":4.2539999999999996,"15min":4.2539999999999996},"last":0.68100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.628,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.70299999999999996}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":524280,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.53900000000000003,"15min":0.49199999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.315}]},{"osd":1,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":0.77600000000000002,"15min":0.70199999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.339,"5min":11.339,"15min":11.339},"last":0.48099999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.381,"5min":0.77300000000000002,"15min":0.68000000000000005},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":11.218999999999999,"5min":11.218999999999999,"15min":11.218999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.109,"5min":7.109,"15min":7.109},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":11.125,"5min":11.125,"15min":11.125},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":0.78200000000000003,"15min":0.70099999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.308,"5min":11.308,"15min":11.308},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.8799999999999999,"5min":6.8799999999999999,"15min":6.8799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":7.0519999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.81100000000000005,"15min":0.873},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2130000000000001,"5min":2.484,"15min":2.484},"last":0.65100000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":0.86899999999999999,"15min":0.79700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":11.249000000000001,"5min":11.249000000000001,"15min":11.249000000000001},"last":0.433},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.57199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.90600000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":11.278,"5min":11.278,"15min":11.278},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85799999999999998,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.68500000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.628}]}]},{"osd":8,"up_from":58,"seq":249108103214,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":520259,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.64100000000000001,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.438},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68400000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.58999999999999997},"min":{"1min":0.52200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76900000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.45500000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":1.073,"15min":1.073},"last":0.55700000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52500000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.52300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85399999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":1.175,"15min":1.175},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.879,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92500000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85699999999999998,"5min":4.319,"15min":4.319},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.73399999999999999,"15min":0.71299999999999997},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86899999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.59299999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.70899999999999996,"15min":0.67900000000000005},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80900000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.63,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.83399999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.85699999999999998}]}]},{"osd":7,"up_from":51,"seq":219043332146,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1117199,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.496},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88300000000000001,"5min":0.995,"15min":0.995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.749}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.72799999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.53800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.89600000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85999999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59699999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89000000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.872},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94799999999999995,"5min":1.05,"15min":1.05},"last":0.88500000000000001}]},{"osd":9,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.748,"15min":0.73199999999999998},"min":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.83599999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.036,"15min":1.036},"last":0.85399999999999998}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.91200000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":519784,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.45600000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.41499999999999998},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59699999999999998,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.33700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.499}]},{"osd":4,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.56699999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56699999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.79700000000000004,"15min":0.73699999999999999},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.44}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67800000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.622}]}]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":584080,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.70999999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85999999999999999,"5min":1.427,"15min":1.427},"last":0.82299999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.79300000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88200000000000001,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64000000000000001,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88300000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64000000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.66000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":1.238,"15min":1.238},"last":0.621}]},{"osd":9,"last update":"Sun Oct 8 13:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69499999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79600000000000004}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521240,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79300000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.40699999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.0029999999999999,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.73799999999999999,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.995,"15min":0.68700000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92900000000000005,"5min":45.244,"15min":45.244},"last":0.497}]},{"osd":6,"last update":"Sun Oct 8 13:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.48599999999999999},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.80200000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.35399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67300000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.85199999999999998},"min":{"1min":0.46800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90400000000000003,"5min":3.403,"15min":3.403},"last":0.54700000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66800000000000004,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":1.026,"15min":1.026},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66500000000000004,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97099999999999997,"5min":1.008,"15min":1.008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.57999999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.749}]}]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":584289,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":0.872,"15min":0.872},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81299999999999994,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57599999999999996,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58899999999999997,"15min":0.54700000000000004},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.504},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.499,"15min":0.441},"min":{"1min":0.435,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.62},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.48099999999999998},"min":{"1min":0.33100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.34499999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.438,"15min":0.438},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64400000000000002,"15min":0.63400000000000001},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86199999999999999,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67500000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58899999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:26:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.73199999999999998,"15min":0.71799999999999997},"min":{"1min":0.54000000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.008,"5min":1.026,"15min":1.026},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44900000000000001}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.58899999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.75700000000000001,"15min":0.73399999999999999},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.054,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.751}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80200000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":519211,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.52300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36399999999999999,"15min":0.32600000000000001},"min":{"1min":0.26500000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.54800000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.371}]},{"osd":1,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55300000000000005,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80200000000000005,"5min":1.806,"15min":1.806},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.502}]},{"osd":2,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60599999999999998,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.32800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68000000000000005,"5min":1.008,"15min":1.008},"last":0.45300000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.44},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66800000000000004,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.66100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.56100000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.88800000000000001,"5min":1.583,"15min":1.583},"last":0.66400000000000003}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.625}]}]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":523858,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.436,"15min":0.39400000000000002},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.55500000000000005},"min":{"1min":0.50900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.90800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.69499999999999995,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":1.004,"15min":1.004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97899999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99199999999999999,"5min":1.149,"15min":1.149},"last":0.74099999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.85699999999999998,"5min":1,"15min":1},"last":0.61699999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.131,"15min":1.131},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79400000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1116877,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.873,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.747,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.504,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61599999999999999,"15min":0.57699999999999996},"min":{"1min":0.58299999999999996,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79000000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55000000000000004}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.40999999999999998,"15min":0.38300000000000001},"min":{"1min":0.35499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.432,"15min":0.40200000000000002},"min":{"1min":0.34799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42499999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":1.571,"15min":1.571},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.63400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.499},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":1.032,"15min":1.032},"last":0.629}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.63600000000000001,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0209999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69099999999999995,"15min":0.66400000000000003},"min":{"1min":0.59499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.995,"5min":1.615,"15min":1.615},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.57099999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.57299999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":1.069,"15min":1.069},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71999999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.55000000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.006,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.73099999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.085,"5min":1.353,"15min":1.353},"last":0.78800000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.746},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.59899999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:27:26.434 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-08T13:27:26.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 -- 172.21.15.139:0/3409918853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64100640 msgr2=0x7fcd64100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 --2- 172.21.15.139:0/3409918853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64100640 0x7fcd64100ac0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009990 tx=0x7fcd58009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 -- 172.21.15.139:0/3409918853 shutdown_connections 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 --2- 172.21.15.139:0/3409918853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 0x7fcd6410d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 --2- 172.21.15.139:0/3409918853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64106650 0x7fcd64106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 --2- 172.21.15.139:0/3409918853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64100640 0x7fcd64100ac0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 -- 172.21.15.139:0/3409918853 >> 172.21.15.139:0/3409918853 conn(0x7fcd640fc1b0 msgr2=0x7fcd640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.590 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 -- 172.21.15.139:0/3409918853 shutdown_connections 2023-10-08T13:27:26.591 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.588+0000 7fcd69928700 1 -- 172.21.15.139:0/3409918853 wait complete. 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.589+0000 7fcd69928700 1 Processor -- start 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 -- start start 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64100640 0x7fcd64196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 0x7fcd64197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6419b950 con 0x7fcd64106650 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6419bac0 con 0x7fcd64100640 2023-10-08T13:27:26.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6419bc80 con 0x7fcd64101000 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40238/0 (socket says 172.21.15.139:40238) 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 -- 172.21.15.139:0/2723706346 learned_addr learned my addr 172.21.15.139:0/2723706346 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd627fc700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 0x7fcd64197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd62ffd700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64100640 0x7fcd64196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 -- 172.21.15.139:0/2723706346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 msgr2=0x7fcd64197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 0x7fcd64197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 -- 172.21.15.139:0/2723706346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64100640 msgr2=0x7fcd64196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64100640 0x7fcd64196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 -- 172.21.15.139:0/2723706346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580095f0 con 0x7fcd64106650 2023-10-08T13:27:26.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd637fe700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c007ee0 tx=0x7fcd5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c017070 con 0x7fcd64106650 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6419bf60 con 0x7fcd64106650 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd5c00f040 con 0x7fcd64106650 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.590+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c005740 con 0x7fcd64106650 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.591+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd641a3810 con 0x7fcd64106650 2023-10-08T13:27:26.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.591+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64108c60 con 0x7fcd64106650 2023-10-08T13:27:26.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.593+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fcd5c00dc60 con 0x7fcd64106650 2023-10-08T13:27:26.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.593+0000 7fcd68926700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.593+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcd5c0cd070 con 0x7fcd64106650 2023-10-08T13:27:26.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.593+0000 7fcd62ffd700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.594+0000 7fcd62ffd700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd54005fd0 tx=0x7fcd54005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.597+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd5c096270 con 0x7fcd64106650 2023-10-08T13:27:26.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.786+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd64197d70 con 0x7fcd4c0a14d0 2023-10-08T13:27:26.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.799+0000 7fcd68926700 1 -- 172.21.15.139:0/2723706346 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+427066 (secure 0 0 0) 0x7fcd64197d70 con 0x7fcd4c0a14d0 2023-10-08T13:27:26.804 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:26.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 msgr2=0x7fcd4c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd54005fd0 tx=0x7fcd54005ee0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 msgr2=0x7fcd6419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c007ee0 tx=0x7fcd5c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 shutdown_connections 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd4c0a14d0 0x7fcd4c0a3990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd64106650 0x7fcd6419b380 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd64100640 0x7fcd64196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 --2- 172.21.15.139:0/2723706346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd64101000 0x7fcd64197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 >> 172.21.15.139:0/2723706346 conn(0x7fcd640fc1b0 msgr2=0x7fcd640fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 shutdown_connections 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.803+0000 7fcd69928700 1 -- 172.21.15.139:0/2723706346 wait complete. 2023-10-08T13:27:26.809 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2023-10-08T13:27:26.817 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-10-08T13:27:26.622798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656943,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":973,"num_read_kb":604,"num_write":427,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":1180993,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336660,"kb_used_data":12380,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605164,"statfs":{"total":1151940427776,"available":1151595687936,"internally_reserved":0,"allocated":12677120,"data_stored":8230710,"data_compressed":424908,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":636,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":52,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003108"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739636+0000","last_change":"2023-10-08T13:25:34.446829+0000","last_active":"2023-10-08T13:27:09.739636+0000","last_peered":"2023-10-08T13:27:09.739636+0000","last_clean":"2023-10-08T13:27:09.739636+0000","last_became_active":"2023-10-08T13:25:34.446492+0000","last_became_peered":"2023-10-08T13:25:34.446492+0000","last_unstale":"2023-10-08T13:27:09.739636+0000","last_undegraded":"2023-10-08T13:27:09.739636+0000","last_fullsized":"2023-10-08T13:27:09.739636+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:13:50.935432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737982+0000","last_change":"2023-10-08T13:25:34.452009+0000","last_active":"2023-10-08T13:27:09.737982+0000","last_peered":"2023-10-08T13:27:09.737982+0000","last_clean":"2023-10-08T13:27:09.737982+0000","last_became_active":"2023-10-08T13:25:34.451756+0000","last_became_peered":"2023-10-08T13:25:34.451756+0000","last_unstale":"2023-10-08T13:27:09.737982+0000","last_undegraded":"2023-10-08T13:27:09.737982+0000","last_fullsized":"2023-10-08T13:27:09.737982+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:35.354054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737882+0000","last_change":"2023-10-08T13:25:34.449228+0000","last_active":"2023-10-08T13:27:09.737882+0000","last_peered":"2023-10-08T13:27:09.737882+0000","last_clean":"2023-10-08T13:27:09.737882+0000","last_became_active":"2023-10-08T13:25:34.448847+0000","last_became_peered":"2023-10-08T13:25:34.448847+0000","last_unstale":"2023-10-08T13:27:09.737882+0000","last_undegraded":"2023-10-08T13:27:09.737882+0000","last_fullsized":"2023-10-08T13:27:09.737882+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:44.969161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736599+0000","last_change":"2023-10-08T13:25:34.449002+0000","last_active":"2023-10-08T13:27:09.736599+0000","last_peered":"2023-10-08T13:27:09.736599+0000","last_clean":"2023-10-08T13:27:09.736599+0000","last_became_active":"2023-10-08T13:25:34.448699+0000","last_became_peered":"2023-10-08T13:25:34.448699+0000","last_unstale":"2023-10-08T13:27:09.736599+0000","last_undegraded":"2023-10-08T13:27:09.736599+0000","last_fullsized":"2023-10-08T13:27:09.736599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:53.924926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736798+0000","last_change":"2023-10-08T13:25:34.447681+0000","last_active":"2023-10-08T13:27:09.736798+0000","last_peered":"2023-10-08T13:27:09.736798+0000","last_clean":"2023-10-08T13:27:09.736798+0000","last_became_active":"2023-10-08T13:25:34.447383+0000","last_became_peered":"2023-10-08T13:25:34.447383+0000","last_unstale":"2023-10-08T13:27:09.736798+0000","last_undegraded":"2023-10-08T13:27:09.736798+0000","last_fullsized":"2023-10-08T13:27:09.736798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:00.905296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781660+0000","last_change":"2023-10-08T13:25:34.443125+0000","last_active":"2023-10-08T13:27:09.781660+0000","last_peered":"2023-10-08T13:27:09.781660+0000","last_clean":"2023-10-08T13:27:09.781660+0000","last_became_active":"2023-10-08T13:25:34.442219+0000","last_became_peered":"2023-10-08T13:25:34.442219+0000","last_unstale":"2023-10-08T13:27:09.781660+0000","last_undegraded":"2023-10-08T13:27:09.781660+0000","last_fullsized":"2023-10-08T13:27:09.781660+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:49:51.626310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732887+0000","last_change":"2023-10-08T13:25:34.445171+0000","last_active":"2023-10-08T13:27:09.732887+0000","last_peered":"2023-10-08T13:27:09.732887+0000","last_clean":"2023-10-08T13:27:09.732887+0000","last_became_active":"2023-10-08T13:25:34.442610+0000","last_became_peered":"2023-10-08T13:25:34.442610+0000","last_unstale":"2023-10-08T13:27:09.732887+0000","last_undegraded":"2023-10-08T13:27:09.732887+0000","last_fullsized":"2023-10-08T13:27:09.732887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:24.210563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781053+0000","last_change":"2023-10-08T13:25:34.446952+0000","last_active":"2023-10-08T13:27:09.781053+0000","last_peered":"2023-10-08T13:27:09.781053+0000","last_clean":"2023-10-08T13:27:09.781053+0000","last_became_active":"2023-10-08T13:25:34.446740+0000","last_became_peered":"2023-10-08T13:25:34.446740+0000","last_unstale":"2023-10-08T13:27:09.781053+0000","last_undegraded":"2023-10-08T13:27:09.781053+0000","last_fullsized":"2023-10-08T13:27:09.781053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:18.584519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737421+0000","last_change":"2023-10-08T13:26:09.727548+0000","last_active":"2023-10-08T13:27:09.737421+0000","last_peered":"2023-10-08T13:27:09.737421+0000","last_clean":"2023-10-08T13:27:09.737421+0000","last_became_active":"2023-10-08T13:26:09.727158+0000","last_became_peered":"2023-10-08T13:26:09.727158+0000","last_unstale":"2023-10-08T13:27:09.737421+0000","last_undegraded":"2023-10-08T13:27:09.737421+0000","last_fullsized":"2023-10-08T13:27:09.737421+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:37.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782064+0000","last_change":"2023-10-08T13:26:09.765316+0000","last_active":"2023-10-08T13:27:09.782064+0000","last_peered":"2023-10-08T13:27:09.782064+0000","last_clean":"2023-10-08T13:27:09.782064+0000","last_became_active":"2023-10-08T13:26:09.764968+0000","last_became_peered":"2023-10-08T13:26:09.764968+0000","last_unstale":"2023-10-08T13:27:09.782064+0000","last_undegraded":"2023-10-08T13:27:09.782064+0000","last_fullsized":"2023-10-08T13:27:09.782064+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:40.418426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733393+0000","last_change":"2023-10-08T13:25:34.455221+0000","last_active":"2023-10-08T13:27:09.733393+0000","last_peered":"2023-10-08T13:27:09.733393+0000","last_clean":"2023-10-08T13:27:09.733393+0000","last_became_active":"2023-10-08T13:25:34.454669+0000","last_became_peered":"2023-10-08T13:25:34.454669+0000","last_unstale":"2023-10-08T13:27:09.733393+0000","last_undegraded":"2023-10-08T13:27:09.733393+0000","last_fullsized":"2023-10-08T13:27:09.733393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:41:10.862480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736200+0000","last_change":"2023-10-08T13:25:34.452588+0000","last_active":"2023-10-08T13:27:09.736200+0000","last_peered":"2023-10-08T13:27:09.736200+0000","last_clean":"2023-10-08T13:27:09.736200+0000","last_became_active":"2023-10-08T13:25:34.452247+0000","last_became_peered":"2023-10-08T13:25:34.452247+0000","last_unstale":"2023-10-08T13:27:09.736200+0000","last_undegraded":"2023-10-08T13:27:09.736200+0000","last_fullsized":"2023-10-08T13:27:09.736200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:20.217760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781483+0000","last_change":"2023-10-08T13:25:34.450008+0000","last_active":"2023-10-08T13:27:09.781483+0000","last_peered":"2023-10-08T13:27:09.781483+0000","last_clean":"2023-10-08T13:27:09.781483+0000","last_became_active":"2023-10-08T13:25:34.449534+0000","last_became_peered":"2023-10-08T13:25:34.449534+0000","last_unstale":"2023-10-08T13:27:09.781483+0000","last_undegraded":"2023-10-08T13:27:09.781483+0000","last_fullsized":"2023-10-08T13:27:09.781483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:56:37.795500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.448535+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.448260+0000","last_became_peered":"2023-10-08T13:25:34.448260+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:58.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:34.454858+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:34.454564+0000","last_became_peered":"2023-10-08T13:25:34.454564+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:08:29.360304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735623+0000","last_change":"2023-10-08T13:25:34.453710+0000","last_active":"2023-10-08T13:27:09.735623+0000","last_peered":"2023-10-08T13:27:09.735623+0000","last_clean":"2023-10-08T13:27:09.735623+0000","last_became_active":"2023-10-08T13:25:34.453296+0000","last_became_peered":"2023-10-08T13:25:34.453296+0000","last_unstale":"2023-10-08T13:27:09.735623+0000","last_undegraded":"2023-10-08T13:27:09.735623+0000","last_fullsized":"2023-10-08T13:27:09.735623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:20.103498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739508+0000","last_change":"2023-10-08T13:25:34.444104+0000","last_active":"2023-10-08T13:27:09.739508+0000","last_peered":"2023-10-08T13:27:09.739508+0000","last_clean":"2023-10-08T13:27:09.739508+0000","last_became_active":"2023-10-08T13:25:34.443739+0000","last_became_peered":"2023-10-08T13:25:34.443739+0000","last_unstale":"2023-10-08T13:27:09.739508+0000","last_undegraded":"2023-10-08T13:27:09.739508+0000","last_fullsized":"2023-10-08T13:27:09.739508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:34.536747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782096+0000","last_change":"2023-10-08T13:25:34.447867+0000","last_active":"2023-10-08T13:27:09.782096+0000","last_peered":"2023-10-08T13:27:09.782096+0000","last_clean":"2023-10-08T13:27:09.782096+0000","last_became_active":"2023-10-08T13:25:34.447532+0000","last_became_peered":"2023-10-08T13:25:34.447532+0000","last_unstale":"2023-10-08T13:27:09.782096+0000","last_undegraded":"2023-10-08T13:27:09.782096+0000","last_fullsized":"2023-10-08T13:27:09.782096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:23.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739100+0000","last_change":"2023-10-08T13:25:34.443583+0000","last_active":"2023-10-08T13:27:09.739100+0000","last_peered":"2023-10-08T13:27:09.739100+0000","last_clean":"2023-10-08T13:27:09.739100+0000","last_became_active":"2023-10-08T13:25:34.443282+0000","last_became_peered":"2023-10-08T13:25:34.443282+0000","last_unstale":"2023-10-08T13:27:09.739100+0000","last_undegraded":"2023-10-08T13:27:09.739100+0000","last_fullsized":"2023-10-08T13:27:09.739100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:30.328517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737214+0000","last_change":"2023-10-08T13:25:38.494103+0000","last_active":"2023-10-08T13:27:09.737214+0000","last_peered":"2023-10-08T13:27:09.737214+0000","last_clean":"2023-10-08T13:27:09.737214+0000","last_became_active":"2023-10-08T13:25:38.493626+0000","last_became_peered":"2023-10-08T13:25:38.493626+0000","last_unstale":"2023-10-08T13:27:09.737214+0000","last_undegraded":"2023-10-08T13:27:09.737214+0000","last_fullsized":"2023-10-08T13:27:09.737214+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:25.180058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":113,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:20.527553+0000","last_change":"2023-10-08T13:25:33.440115+0000","last_active":"2023-10-08T13:27:20.527553+0000","last_peered":"2023-10-08T13:27:20.527553+0000","last_clean":"2023-10-08T13:27:20.527553+0000","last_became_active":"2023-10-08T13:25:33.439776+0000","last_became_peered":"2023-10-08T13:25:33.439776+0000","last_unstale":"2023-10-08T13:27:20.527553+0000","last_undegraded":"2023-10-08T13:27:20.527553+0000","last_fullsized":"2023-10-08T13:27:20.527553+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:26.159889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":79,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782523+0000","last_change":"2023-10-08T13:25:34.453238+0000","last_active":"2023-10-08T13:27:09.782523+0000","last_peered":"2023-10-08T13:27:09.782523+0000","last_clean":"2023-10-08T13:27:09.782523+0000","last_became_active":"2023-10-08T13:25:34.452937+0000","last_became_peered":"2023-10-08T13:25:34.452937+0000","last_unstale":"2023-10-08T13:27:09.782523+0000","last_undegraded":"2023-10-08T13:27:09.782523+0000","last_fullsized":"2023-10-08T13:27:09.782523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:08:16.565427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735909+0000","last_change":"2023-10-08T13:25:38.493227+0000","last_active":"2023-10-08T13:27:09.735909+0000","last_peered":"2023-10-08T13:27:09.735909+0000","last_clean":"2023-10-08T13:27:09.735909+0000","last_became_active":"2023-10-08T13:25:38.492770+0000","last_became_peered":"2023-10-08T13:25:38.492770+0000","last_unstale":"2023-10-08T13:27:09.735909+0000","last_undegraded":"2023-10-08T13:27:09.735909+0000","last_fullsized":"2023-10-08T13:27:09.735909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:52.404721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782569+0000","last_change":"2023-10-08T13:25:33.442883+0000","last_active":"2023-10-08T13:27:09.782569+0000","last_peered":"2023-10-08T13:27:09.782569+0000","last_clean":"2023-10-08T13:27:09.782569+0000","last_became_active":"2023-10-08T13:25:33.442587+0000","last_became_peered":"2023-10-08T13:25:33.442587+0000","last_unstale":"2023-10-08T13:27:09.782569+0000","last_undegraded":"2023-10-08T13:27:09.782569+0000","last_fullsized":"2023-10-08T13:27:09.782569+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:07.055721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737765+0000","last_change":"2023-10-08T13:25:34.448337+0000","last_active":"2023-10-08T13:27:09.737765+0000","last_peered":"2023-10-08T13:27:09.737765+0000","last_clean":"2023-10-08T13:27:09.737765+0000","last_became_active":"2023-10-08T13:25:34.448044+0000","last_became_peered":"2023-10-08T13:25:34.448044+0000","last_unstale":"2023-10-08T13:27:09.737765+0000","last_undegraded":"2023-10-08T13:27:09.737765+0000","last_fullsized":"2023-10-08T13:27:09.737765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:35.603115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736199+0000","last_change":"2023-10-08T13:26:09.765180+0000","last_active":"2023-10-08T13:27:09.736199+0000","last_peered":"2023-10-08T13:27:09.736199+0000","last_clean":"2023-10-08T13:27:09.736199+0000","last_became_active":"2023-10-08T13:26:09.764692+0000","last_became_peered":"2023-10-08T13:26:09.764692+0000","last_unstale":"2023-10-08T13:27:09.736199+0000","last_undegraded":"2023-10-08T13:27:09.736199+0000","last_fullsized":"2023-10-08T13:27:09.736199+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:15.983148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"88'12","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736865+0000","last_change":"2023-10-08T13:25:33.439379+0000","last_active":"2023-10-08T13:27:09.736865+0000","last_peered":"2023-10-08T13:27:09.736865+0000","last_clean":"2023-10-08T13:27:09.736865+0000","last_became_active":"2023-10-08T13:25:33.439098+0000","last_became_peered":"2023-10-08T13:25:33.439098+0000","last_unstale":"2023-10-08T13:27:09.736865+0000","last_undegraded":"2023-10-08T13:27:09.736865+0000","last_fullsized":"2023-10-08T13:27:09.736865+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:58.513164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736922+0000","last_change":"2023-10-08T13:25:34.444754+0000","last_active":"2023-10-08T13:27:09.736922+0000","last_peered":"2023-10-08T13:27:09.736922+0000","last_clean":"2023-10-08T13:27:09.736922+0000","last_became_active":"2023-10-08T13:25:34.444467+0000","last_became_peered":"2023-10-08T13:25:34.444467+0000","last_unstale":"2023-10-08T13:27:09.736922+0000","last_undegraded":"2023-10-08T13:27:09.736922+0000","last_fullsized":"2023-10-08T13:27:09.736922+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:23.001522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735990+0000","last_change":"2023-10-08T13:26:09.765527+0000","last_active":"2023-10-08T13:27:09.735990+0000","last_peered":"2023-10-08T13:27:09.735990+0000","last_clean":"2023-10-08T13:27:09.735990+0000","last_became_active":"2023-10-08T13:26:09.764823+0000","last_became_peered":"2023-10-08T13:26:09.764823+0000","last_unstale":"2023-10-08T13:27:09.735990+0000","last_undegraded":"2023-10-08T13:27:09.735990+0000","last_fullsized":"2023-10-08T13:27:09.735990+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:28:41.632170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736470+0000","last_change":"2023-10-08T13:25:33.436785+0000","last_active":"2023-10-08T13:27:09.736470+0000","last_peered":"2023-10-08T13:27:09.736470+0000","last_clean":"2023-10-08T13:27:09.736470+0000","last_became_active":"2023-10-08T13:25:33.436390+0000","last_became_peered":"2023-10-08T13:25:33.436390+0000","last_unstale":"2023-10-08T13:27:09.736470+0000","last_undegraded":"2023-10-08T13:27:09.736470+0000","last_fullsized":"2023-10-08T13:27:09.736470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:05.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741593+0000","last_change":"2023-10-08T13:25:34.449058+0000","last_active":"2023-10-08T13:27:09.741593+0000","last_peered":"2023-10-08T13:27:09.741593+0000","last_clean":"2023-10-08T13:27:09.741593+0000","last_became_active":"2023-10-08T13:25:34.448774+0000","last_became_peered":"2023-10-08T13:25:34.448774+0000","last_unstale":"2023-10-08T13:27:09.741593+0000","last_undegraded":"2023-10-08T13:27:09.741593+0000","last_fullsized":"2023-10-08T13:27:09.741593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:37:52.110173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738840+0000","last_change":"2023-10-08T13:25:38.486063+0000","last_active":"2023-10-08T13:27:09.738840+0000","last_peered":"2023-10-08T13:27:09.738840+0000","last_clean":"2023-10-08T13:27:09.738840+0000","last_became_active":"2023-10-08T13:25:38.485610+0000","last_became_peered":"2023-10-08T13:25:38.485610+0000","last_unstale":"2023-10-08T13:27:09.738840+0000","last_undegraded":"2023-10-08T13:27:09.738840+0000","last_fullsized":"2023-10-08T13:27:09.738840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:42:48.242964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'8","reported_seq":115,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:24.534892+0000","last_change":"2023-10-08T13:25:33.442562+0000","last_active":"2023-10-08T13:27:24.534892+0000","last_peered":"2023-10-08T13:27:24.534892+0000","last_clean":"2023-10-08T13:27:24.534892+0000","last_became_active":"2023-10-08T13:25:33.442238+0000","last_became_peered":"2023-10-08T13:25:33.442238+0000","last_unstale":"2023-10-08T13:27:24.534892+0000","last_undegraded":"2023-10-08T13:27:24.534892+0000","last_fullsized":"2023-10-08T13:27:24.534892+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:49:55.227792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736810+0000","last_change":"2023-10-08T13:25:34.449152+0000","last_active":"2023-10-08T13:27:09.736810+0000","last_peered":"2023-10-08T13:27:09.736810+0000","last_clean":"2023-10-08T13:27:09.736810+0000","last_became_active":"2023-10-08T13:25:34.448865+0000","last_became_peered":"2023-10-08T13:25:34.448865+0000","last_unstale":"2023-10-08T13:27:09.736810+0000","last_undegraded":"2023-10-08T13:27:09.736810+0000","last_fullsized":"2023-10-08T13:27:09.736810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:27.960184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738971+0000","last_change":"2023-10-08T13:25:38.494111+0000","last_active":"2023-10-08T13:27:09.738971+0000","last_peered":"2023-10-08T13:27:09.738971+0000","last_clean":"2023-10-08T13:27:09.738971+0000","last_became_active":"2023-10-08T13:25:38.493590+0000","last_became_peered":"2023-10-08T13:25:38.493590+0000","last_unstale":"2023-10-08T13:27:09.738971+0000","last_undegraded":"2023-10-08T13:27:09.738971+0000","last_fullsized":"2023-10-08T13:27:09.738971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:02:53.730882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781654+0000","last_change":"2023-10-08T13:25:33.434440+0000","last_active":"2023-10-08T13:27:09.781654+0000","last_peered":"2023-10-08T13:27:09.781654+0000","last_clean":"2023-10-08T13:27:09.781654+0000","last_became_active":"2023-10-08T13:25:33.434158+0000","last_became_peered":"2023-10-08T13:25:33.434158+0000","last_unstale":"2023-10-08T13:27:09.781654+0000","last_undegraded":"2023-10-08T13:27:09.781654+0000","last_fullsized":"2023-10-08T13:27:09.781654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:56.706274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741675+0000","last_change":"2023-10-08T13:25:34.453984+0000","last_active":"2023-10-08T13:27:09.741675+0000","last_peered":"2023-10-08T13:27:09.741675+0000","last_clean":"2023-10-08T13:27:09.741675+0000","last_became_active":"2023-10-08T13:25:34.453689+0000","last_became_peered":"2023-10-08T13:25:34.453689+0000","last_unstale":"2023-10-08T13:27:09.741675+0000","last_undegraded":"2023-10-08T13:27:09.741675+0000","last_fullsized":"2023-10-08T13:27:09.741675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:51.754304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739462+0000","last_change":"2023-10-08T13:25:38.488654+0000","last_active":"2023-10-08T13:27:09.739462+0000","last_peered":"2023-10-08T13:27:09.739462+0000","last_clean":"2023-10-08T13:27:09.739462+0000","last_became_active":"2023-10-08T13:25:38.488318+0000","last_became_peered":"2023-10-08T13:25:38.488318+0000","last_unstale":"2023-10-08T13:27:09.739462+0000","last_undegraded":"2023-10-08T13:27:09.739462+0000","last_fullsized":"2023-10-08T13:27:09.739462+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:56.895256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781165+0000","last_change":"2023-10-08T13:25:33.441144+0000","last_active":"2023-10-08T13:27:09.781165+0000","last_peered":"2023-10-08T13:27:09.781165+0000","last_clean":"2023-10-08T13:27:09.781165+0000","last_became_active":"2023-10-08T13:25:33.440636+0000","last_became_peered":"2023-10-08T13:25:33.440636+0000","last_unstale":"2023-10-08T13:27:09.781165+0000","last_undegraded":"2023-10-08T13:27:09.781165+0000","last_fullsized":"2023-10-08T13:27:09.781165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:43.454994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780962+0000","last_change":"2023-10-08T13:25:34.438578+0000","last_active":"2023-10-08T13:27:09.780962+0000","last_peered":"2023-10-08T13:27:09.780962+0000","last_clean":"2023-10-08T13:27:09.780962+0000","last_became_active":"2023-10-08T13:25:34.438233+0000","last_became_peered":"2023-10-08T13:25:34.438233+0000","last_unstale":"2023-10-08T13:27:09.780962+0000","last_undegraded":"2023-10-08T13:27:09.780962+0000","last_fullsized":"2023-10-08T13:27:09.780962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:54.257336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737865+0000","last_change":"2023-10-08T13:25:38.484833+0000","last_active":"2023-10-08T13:27:09.737865+0000","last_peered":"2023-10-08T13:27:09.737865+0000","last_clean":"2023-10-08T13:27:09.737865+0000","last_became_active":"2023-10-08T13:25:38.484477+0000","last_became_peered":"2023-10-08T13:25:38.484477+0000","last_unstale":"2023-10-08T13:27:09.737865+0000","last_undegraded":"2023-10-08T13:27:09.737865+0000","last_fullsized":"2023-10-08T13:27:09.737865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:28.597824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741169+0000","last_change":"2023-10-08T13:25:33.440079+0000","last_active":"2023-10-08T13:27:09.741169+0000","last_peered":"2023-10-08T13:27:09.741169+0000","last_clean":"2023-10-08T13:27:09.741169+0000","last_became_active":"2023-10-08T13:25:33.439777+0000","last_became_peered":"2023-10-08T13:25:33.439777+0000","last_unstale":"2023-10-08T13:27:09.741169+0000","last_undegraded":"2023-10-08T13:27:09.741169+0000","last_fullsized":"2023-10-08T13:27:09.741169+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:18:02.860371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781742+0000","last_change":"2023-10-08T13:25:34.447999+0000","last_active":"2023-10-08T13:27:09.781742+0000","last_peered":"2023-10-08T13:27:09.781742+0000","last_clean":"2023-10-08T13:27:09.781742+0000","last_became_active":"2023-10-08T13:25:34.447690+0000","last_became_peered":"2023-10-08T13:25:34.447690+0000","last_unstale":"2023-10-08T13:27:09.781742+0000","last_undegraded":"2023-10-08T13:27:09.781742+0000","last_fullsized":"2023-10-08T13:27:09.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:09:38.252301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781544+0000","last_change":"2023-10-08T13:25:38.490691+0000","last_active":"2023-10-08T13:27:09.781544+0000","last_peered":"2023-10-08T13:27:09.781544+0000","last_clean":"2023-10-08T13:27:09.781544+0000","last_became_active":"2023-10-08T13:25:38.490327+0000","last_became_peered":"2023-10-08T13:25:38.490327+0000","last_unstale":"2023-10-08T13:27:09.781544+0000","last_undegraded":"2023-10-08T13:27:09.781544+0000","last_fullsized":"2023-10-08T13:27:09.781544+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:34.415277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":183,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531560+0000","last_change":"2023-10-08T13:25:33.435345+0000","last_active":"2023-10-08T13:27:22.531560+0000","last_peered":"2023-10-08T13:27:22.531560+0000","last_clean":"2023-10-08T13:27:22.531560+0000","last_became_active":"2023-10-08T13:25:33.435016+0000","last_became_peered":"2023-10-08T13:25:33.435016+0000","last_unstale":"2023-10-08T13:27:22.531560+0000","last_undegraded":"2023-10-08T13:27:22.531560+0000","last_fullsized":"2023-10-08T13:27:22.531560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:19:47.084426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737319+0000","last_change":"2023-10-08T13:25:34.445575+0000","last_active":"2023-10-08T13:27:09.737319+0000","last_peered":"2023-10-08T13:27:09.737319+0000","last_clean":"2023-10-08T13:27:09.737319+0000","last_became_active":"2023-10-08T13:25:34.445354+0000","last_became_peered":"2023-10-08T13:25:34.445354+0000","last_unstale":"2023-10-08T13:27:09.737319+0000","last_undegraded":"2023-10-08T13:27:09.737319+0000","last_fullsized":"2023-10-08T13:27:09.737319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:09.624197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781429+0000","last_change":"2023-10-08T13:25:38.492823+0000","last_active":"2023-10-08T13:27:09.781429+0000","last_peered":"2023-10-08T13:27:09.781429+0000","last_clean":"2023-10-08T13:27:09.781429+0000","last_became_active":"2023-10-08T13:25:38.492431+0000","last_became_peered":"2023-10-08T13:25:38.492431+0000","last_unstale":"2023-10-08T13:27:09.781429+0000","last_undegraded":"2023-10-08T13:27:09.781429+0000","last_fullsized":"2023-10-08T13:27:09.781429+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:10.448034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.759323+0000","last_change":"2023-10-08T13:27:10.759323+0000","last_active":"2023-10-08T13:27:10.759323+0000","last_peered":"2023-10-08T13:27:10.759323+0000","last_clean":"2023-10-08T13:27:10.759323+0000","last_became_active":"2023-10-08T13:27:10.744684+0000","last_became_peered":"2023-10-08T13:27:10.744684+0000","last_unstale":"2023-10-08T13:27:10.759323+0000","last_undegraded":"2023-10-08T13:27:10.759323+0000","last_fullsized":"2023-10-08T13:27:10.759323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:26.169261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737905+0000","last_change":"2023-10-08T13:26:09.730654+0000","last_active":"2023-10-08T13:27:09.737905+0000","last_peered":"2023-10-08T13:27:09.737905+0000","last_clean":"2023-10-08T13:27:09.737905+0000","last_became_active":"2023-10-08T13:26:09.730372+0000","last_became_peered":"2023-10-08T13:26:09.730372+0000","last_unstale":"2023-10-08T13:27:09.737905+0000","last_undegraded":"2023-10-08T13:27:09.737905+0000","last_fullsized":"2023-10-08T13:27:09.737905+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:10:09.821192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736469+0000","last_change":"2023-10-08T13:25:38.493709+0000","last_active":"2023-10-08T13:27:09.736469+0000","last_peered":"2023-10-08T13:27:09.736469+0000","last_clean":"2023-10-08T13:27:09.736469+0000","last_became_active":"2023-10-08T13:25:38.492773+0000","last_became_peered":"2023-10-08T13:25:38.492773+0000","last_unstale":"2023-10-08T13:27:09.736469+0000","last_undegraded":"2023-10-08T13:27:09.736469+0000","last_fullsized":"2023-10-08T13:27:09.736469+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:10.571127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741923+0000","last_change":"2023-10-08T13:25:33.443136+0000","last_active":"2023-10-08T13:27:09.741923+0000","last_peered":"2023-10-08T13:27:09.741923+0000","last_clean":"2023-10-08T13:27:09.741923+0000","last_became_active":"2023-10-08T13:25:33.442812+0000","last_became_peered":"2023-10-08T13:25:33.442812+0000","last_unstale":"2023-10-08T13:27:09.741923+0000","last_undegraded":"2023-10-08T13:27:09.741923+0000","last_fullsized":"2023-10-08T13:27:09.741923+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:35.897676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737113+0000","last_change":"2023-10-08T13:26:09.724775+0000","last_active":"2023-10-08T13:27:09.737113+0000","last_peered":"2023-10-08T13:27:09.737113+0000","last_clean":"2023-10-08T13:27:09.737113+0000","last_became_active":"2023-10-08T13:26:09.724388+0000","last_became_peered":"2023-10-08T13:26:09.724388+0000","last_unstale":"2023-10-08T13:27:09.737113+0000","last_undegraded":"2023-10-08T13:27:09.737113+0000","last_fullsized":"2023-10-08T13:27:09.737113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:43:17.186799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781804+0000","last_change":"2023-10-08T13:25:38.488466+0000","last_active":"2023-10-08T13:27:09.781804+0000","last_peered":"2023-10-08T13:27:09.781804+0000","last_clean":"2023-10-08T13:27:09.781804+0000","last_became_active":"2023-10-08T13:25:38.488031+0000","last_became_peered":"2023-10-08T13:25:38.488031+0000","last_unstale":"2023-10-08T13:27:09.781804+0000","last_undegraded":"2023-10-08T13:27:09.781804+0000","last_fullsized":"2023-10-08T13:27:09.781804+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.481911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'37","reported_seq":223,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.531836+0000","last_change":"2023-10-08T13:25:33.437933+0000","last_active":"2023-10-08T13:27:22.531836+0000","last_peered":"2023-10-08T13:27:22.531836+0000","last_clean":"2023-10-08T13:27:22.531836+0000","last_became_active":"2023-10-08T13:25:33.437570+0000","last_became_peered":"2023-10-08T13:25:33.437570+0000","last_unstale":"2023-10-08T13:27:22.531836+0000","last_undegraded":"2023-10-08T13:27:22.531836+0000","last_fullsized":"2023-10-08T13:27:22.531836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:36:18.938171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59058,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":166,"num_read_kb":140,"num_write":39,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736425+0000","last_change":"2023-10-08T13:25:34.449187+0000","last_active":"2023-10-08T13:27:09.736425+0000","last_peered":"2023-10-08T13:27:09.736425+0000","last_clean":"2023-10-08T13:27:09.736425+0000","last_became_active":"2023-10-08T13:25:34.448897+0000","last_became_peered":"2023-10-08T13:25:34.448897+0000","last_unstale":"2023-10-08T13:27:09.736425+0000","last_undegraded":"2023-10-08T13:27:09.736425+0000","last_fullsized":"2023-10-08T13:27:09.736425+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:54.640558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741783+0000","last_change":"2023-10-08T13:25:38.484945+0000","last_active":"2023-10-08T13:27:09.741783+0000","last_peered":"2023-10-08T13:27:09.741783+0000","last_clean":"2023-10-08T13:27:09.741783+0000","last_became_active":"2023-10-08T13:25:38.484606+0000","last_became_peered":"2023-10-08T13:25:38.484606+0000","last_unstale":"2023-10-08T13:27:09.741783+0000","last_undegraded":"2023-10-08T13:27:09.741783+0000","last_fullsized":"2023-10-08T13:27:09.741783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:39.899915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739315+0000","last_change":"2023-10-08T13:25:33.441216+0000","last_active":"2023-10-08T13:27:09.739315+0000","last_peered":"2023-10-08T13:27:09.739315+0000","last_clean":"2023-10-08T13:27:09.739315+0000","last_became_active":"2023-10-08T13:25:33.440914+0000","last_became_peered":"2023-10-08T13:25:33.440914+0000","last_unstale":"2023-10-08T13:27:09.739315+0000","last_undegraded":"2023-10-08T13:27:09.739315+0000","last_fullsized":"2023-10-08T13:27:09.739315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:05.392218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781253+0000","last_change":"2023-10-08T13:25:34.445663+0000","last_active":"2023-10-08T13:27:09.781253+0000","last_peered":"2023-10-08T13:27:09.781253+0000","last_clean":"2023-10-08T13:27:09.781253+0000","last_became_active":"2023-10-08T13:25:34.445365+0000","last_became_peered":"2023-10-08T13:25:34.445365+0000","last_unstale":"2023-10-08T13:27:09.781253+0000","last_undegraded":"2023-10-08T13:27:09.781253+0000","last_fullsized":"2023-10-08T13:27:09.781253+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:11.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738562+0000","last_change":"2023-10-08T13:25:38.492982+0000","last_active":"2023-10-08T13:27:09.738562+0000","last_peered":"2023-10-08T13:27:09.738562+0000","last_clean":"2023-10-08T13:27:09.738562+0000","last_became_active":"2023-10-08T13:25:38.492620+0000","last_became_peered":"2023-10-08T13:25:38.492620+0000","last_unstale":"2023-10-08T13:27:09.738562+0000","last_undegraded":"2023-10-08T13:27:09.738562+0000","last_fullsized":"2023-10-08T13:27:09.738562+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:53:11.301584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741489+0000","last_change":"2023-10-08T13:25:33.442353+0000","last_active":"2023-10-08T13:27:09.741489+0000","last_peered":"2023-10-08T13:27:09.741489+0000","last_clean":"2023-10-08T13:27:09.741489+0000","last_became_active":"2023-10-08T13:25:33.441950+0000","last_became_peered":"2023-10-08T13:25:33.441950+0000","last_unstale":"2023-10-08T13:27:09.741489+0000","last_undegraded":"2023-10-08T13:27:09.741489+0000","last_fullsized":"2023-10-08T13:27:09.741489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:49.187597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733295+0000","last_change":"2023-10-08T13:25:34.445958+0000","last_active":"2023-10-08T13:27:09.733295+0000","last_peered":"2023-10-08T13:27:09.733295+0000","last_clean":"2023-10-08T13:27:09.733295+0000","last_became_active":"2023-10-08T13:25:34.445595+0000","last_became_peered":"2023-10-08T13:25:34.445595+0000","last_unstale":"2023-10-08T13:27:09.733295+0000","last_undegraded":"2023-10-08T13:27:09.733295+0000","last_fullsized":"2023-10-08T13:27:09.733295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:28.351906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782207+0000","last_change":"2023-10-08T13:25:38.494010+0000","last_active":"2023-10-08T13:27:09.782207+0000","last_peered":"2023-10-08T13:27:09.782207+0000","last_clean":"2023-10-08T13:27:09.782207+0000","last_became_active":"2023-10-08T13:25:38.493669+0000","last_became_peered":"2023-10-08T13:25:38.493669+0000","last_unstale":"2023-10-08T13:27:09.782207+0000","last_undegraded":"2023-10-08T13:27:09.782207+0000","last_fullsized":"2023-10-08T13:27:09.782207+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:31.756294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'5","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:24.533475+0000","last_change":"2023-10-08T13:25:33.441487+0000","last_active":"2023-10-08T13:27:24.533475+0000","last_peered":"2023-10-08T13:27:24.533475+0000","last_clean":"2023-10-08T13:27:24.533475+0000","last_became_active":"2023-10-08T13:25:33.441175+0000","last_became_peered":"2023-10-08T13:25:33.441175+0000","last_unstale":"2023-10-08T13:27:24.533475+0000","last_undegraded":"2023-10-08T13:27:24.533475+0000","last_fullsized":"2023-10-08T13:27:24.533475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:33.241725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732939+0000","last_change":"2023-10-08T13:25:34.454988+0000","last_active":"2023-10-08T13:27:09.732939+0000","last_peered":"2023-10-08T13:27:09.732939+0000","last_clean":"2023-10-08T13:27:09.732939+0000","last_became_active":"2023-10-08T13:25:34.454631+0000","last_became_peered":"2023-10-08T13:25:34.454631+0000","last_unstale":"2023-10-08T13:27:09.732939+0000","last_undegraded":"2023-10-08T13:27:09.732939+0000","last_fullsized":"2023-10-08T13:27:09.732939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:50.958416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781639+0000","last_change":"2023-10-08T13:26:09.765328+0000","last_active":"2023-10-08T13:27:09.781639+0000","last_peered":"2023-10-08T13:27:09.781639+0000","last_clean":"2023-10-08T13:27:09.781639+0000","last_became_active":"2023-10-08T13:26:09.764889+0000","last_became_peered":"2023-10-08T13:26:09.764889+0000","last_unstale":"2023-10-08T13:27:09.781639+0000","last_undegraded":"2023-10-08T13:27:09.781639+0000","last_fullsized":"2023-10-08T13:27:09.781639+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:54.280258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":65,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.756068+0000","last_change":"2023-10-08T13:27:10.756068+0000","last_active":"2023-10-08T13:27:10.756068+0000","last_peered":"2023-10-08T13:27:10.756068+0000","last_clean":"2023-10-08T13:27:10.756068+0000","last_became_active":"2023-10-08T13:27:10.742701+0000","last_became_peered":"2023-10-08T13:27:10.742701+0000","last_unstale":"2023-10-08T13:27:10.756068+0000","last_undegraded":"2023-10-08T13:27:10.756068+0000","last_fullsized":"2023-10-08T13:27:10.756068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:44:20.540492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,1],"acting":[8,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741532+0000","last_change":"2023-10-08T13:25:34.446887+0000","last_active":"2023-10-08T13:27:09.741532+0000","last_peered":"2023-10-08T13:27:09.741532+0000","last_clean":"2023-10-08T13:27:09.741532+0000","last_became_active":"2023-10-08T13:25:34.446527+0000","last_became_peered":"2023-10-08T13:25:34.446527+0000","last_unstale":"2023-10-08T13:27:09.741532+0000","last_undegraded":"2023-10-08T13:27:09.741532+0000","last_fullsized":"2023-10-08T13:27:09.741532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:29:45.845233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741286+0000","last_change":"2023-10-08T13:25:38.490917+0000","last_active":"2023-10-08T13:27:09.741286+0000","last_peered":"2023-10-08T13:27:09.741286+0000","last_clean":"2023-10-08T13:27:09.741286+0000","last_became_active":"2023-10-08T13:25:38.490504+0000","last_became_peered":"2023-10-08T13:25:38.490504+0000","last_unstale":"2023-10-08T13:27:09.741286+0000","last_undegraded":"2023-10-08T13:27:09.741286+0000","last_fullsized":"2023-10-08T13:27:09.741286+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:48.660274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.750176+0000","last_change":"2023-10-08T13:27:10.749693+0000","last_active":"2023-10-08T13:27:10.750176+0000","last_peered":"2023-10-08T13:27:10.750176+0000","last_clean":"2023-10-08T13:27:10.750176+0000","last_became_active":"2023-10-08T13:27:10.744809+0000","last_became_peered":"2023-10-08T13:27:10.744809+0000","last_unstale":"2023-10-08T13:27:10.750176+0000","last_undegraded":"2023-10-08T13:27:10.750176+0000","last_fullsized":"2023-10-08T13:27:10.750176+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:13:13.914394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739047+0000","last_change":"2023-10-08T13:25:34.448980+0000","last_active":"2023-10-08T13:27:09.739047+0000","last_peered":"2023-10-08T13:27:09.739047+0000","last_clean":"2023-10-08T13:27:09.739047+0000","last_became_active":"2023-10-08T13:25:34.448670+0000","last_became_peered":"2023-10-08T13:25:34.448670+0000","last_unstale":"2023-10-08T13:27:09.739047+0000","last_undegraded":"2023-10-08T13:27:09.739047+0000","last_fullsized":"2023-10-08T13:27:09.739047+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:08.128147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736900+0000","last_change":"2023-10-08T13:25:38.568176+0000","last_active":"2023-10-08T13:27:09.736900+0000","last_peered":"2023-10-08T13:27:09.736900+0000","last_clean":"2023-10-08T13:27:09.736900+0000","last_became_active":"2023-10-08T13:25:38.567725+0000","last_became_peered":"2023-10-08T13:25:38.567725+0000","last_unstale":"2023-10-08T13:27:09.736900+0000","last_undegraded":"2023-10-08T13:27:09.736900+0000","last_fullsized":"2023-10-08T13:27:09.736900+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:35.416709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782110+0000","last_change":"2023-10-08T13:25:33.442903+0000","last_active":"2023-10-08T13:27:09.782110+0000","last_peered":"2023-10-08T13:27:09.782110+0000","last_clean":"2023-10-08T13:27:09.782110+0000","last_became_active":"2023-10-08T13:25:33.442572+0000","last_became_peered":"2023-10-08T13:25:33.442572+0000","last_unstale":"2023-10-08T13:27:09.782110+0000","last_undegraded":"2023-10-08T13:27:09.782110+0000","last_fullsized":"2023-10-08T13:27:09.782110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:23.349309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781996+0000","last_change":"2023-10-08T13:25:34.445184+0000","last_active":"2023-10-08T13:27:09.781996+0000","last_peered":"2023-10-08T13:27:09.781996+0000","last_clean":"2023-10-08T13:27:09.781996+0000","last_became_active":"2023-10-08T13:25:34.444577+0000","last_became_peered":"2023-10-08T13:25:34.444577+0000","last_unstale":"2023-10-08T13:27:09.781996+0000","last_undegraded":"2023-10-08T13:27:09.781996+0000","last_fullsized":"2023-10-08T13:27:09.781996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:54:56.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782909+0000","last_change":"2023-10-08T13:25:38.482357+0000","last_active":"2023-10-08T13:27:09.782909+0000","last_peered":"2023-10-08T13:27:09.782909+0000","last_clean":"2023-10-08T13:27:09.782909+0000","last_became_active":"2023-10-08T13:25:38.482003+0000","last_became_peered":"2023-10-08T13:25:38.482003+0000","last_unstale":"2023-10-08T13:27:09.782909+0000","last_undegraded":"2023-10-08T13:27:09.782909+0000","last_fullsized":"2023-10-08T13:27:09.782909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:38:08.951228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:23.532167+0000","last_change":"2023-10-08T13:25:33.439966+0000","last_active":"2023-10-08T13:27:23.532167+0000","last_peered":"2023-10-08T13:27:23.532167+0000","last_clean":"2023-10-08T13:27:23.532167+0000","last_became_active":"2023-10-08T13:25:33.439649+0000","last_became_peered":"2023-10-08T13:25:33.439649+0000","last_unstale":"2023-10-08T13:27:23.532167+0000","last_undegraded":"2023-10-08T13:27:23.532167+0000","last_fullsized":"2023-10-08T13:27:23.532167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:13.903962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781800+0000","last_change":"2023-10-08T13:25:34.443083+0000","last_active":"2023-10-08T13:27:09.781800+0000","last_peered":"2023-10-08T13:27:09.781800+0000","last_clean":"2023-10-08T13:27:09.781800+0000","last_became_active":"2023-10-08T13:25:34.442769+0000","last_became_peered":"2023-10-08T13:25:34.442769+0000","last_unstale":"2023-10-08T13:27:09.781800+0000","last_undegraded":"2023-10-08T13:27:09.781800+0000","last_fullsized":"2023-10-08T13:27:09.781800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:21.441810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781334+0000","last_change":"2023-10-08T13:25:38.567954+0000","last_active":"2023-10-08T13:27:09.781334+0000","last_peered":"2023-10-08T13:27:09.781334+0000","last_clean":"2023-10-08T13:27:09.781334+0000","last_became_active":"2023-10-08T13:25:38.567456+0000","last_became_peered":"2023-10-08T13:25:38.567456+0000","last_unstale":"2023-10-08T13:27:09.781334+0000","last_undegraded":"2023-10-08T13:27:09.781334+0000","last_fullsized":"2023-10-08T13:27:09.781334+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:04.480928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741292+0000","last_change":"2023-10-08T13:25:34.450021+0000","last_active":"2023-10-08T13:27:09.741292+0000","last_peered":"2023-10-08T13:27:09.741292+0000","last_clean":"2023-10-08T13:27:09.741292+0000","last_became_active":"2023-10-08T13:25:34.449737+0000","last_became_peered":"2023-10-08T13:25:34.449737+0000","last_unstale":"2023-10-08T13:27:09.741292+0000","last_undegraded":"2023-10-08T13:27:09.741292+0000","last_fullsized":"2023-10-08T13:27:09.741292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:19:50.578301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:22.530346+0000","last_change":"2023-10-08T13:25:33.443538+0000","last_active":"2023-10-08T13:27:22.530346+0000","last_peered":"2023-10-08T13:27:22.530346+0000","last_clean":"2023-10-08T13:27:22.530346+0000","last_became_active":"2023-10-08T13:25:33.443251+0000","last_became_peered":"2023-10-08T13:25:33.443251+0000","last_unstale":"2023-10-08T13:27:22.530346+0000","last_undegraded":"2023-10-08T13:27:22.530346+0000","last_fullsized":"2023-10-08T13:27:22.530346+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:20:19.809857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733299+0000","last_change":"2023-10-08T13:26:09.734878+0000","last_active":"2023-10-08T13:27:09.733299+0000","last_peered":"2023-10-08T13:27:09.733299+0000","last_clean":"2023-10-08T13:27:09.733299+0000","last_became_active":"2023-10-08T13:26:09.730200+0000","last_became_peered":"2023-10-08T13:26:09.730200+0000","last_unstale":"2023-10-08T13:27:09.733299+0000","last_undegraded":"2023-10-08T13:27:09.733299+0000","last_fullsized":"2023-10-08T13:27:09.733299+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:33.060346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781752+0000","last_change":"2023-10-08T13:25:34.447190+0000","last_active":"2023-10-08T13:27:09.781752+0000","last_peered":"2023-10-08T13:27:09.781752+0000","last_clean":"2023-10-08T13:27:09.781752+0000","last_became_active":"2023-10-08T13:25:34.446805+0000","last_became_peered":"2023-10-08T13:25:34.446805+0000","last_unstale":"2023-10-08T13:27:09.781752+0000","last_undegraded":"2023-10-08T13:27:09.781752+0000","last_fullsized":"2023-10-08T13:27:09.781752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:54:36.523601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736317+0000","last_change":"2023-10-08T13:25:33.431242+0000","last_active":"2023-10-08T13:27:09.736317+0000","last_peered":"2023-10-08T13:27:09.736317+0000","last_clean":"2023-10-08T13:27:09.736317+0000","last_became_active":"2023-10-08T13:25:33.430915+0000","last_became_peered":"2023-10-08T13:25:33.430915+0000","last_unstale":"2023-10-08T13:27:09.736317+0000","last_undegraded":"2023-10-08T13:27:09.736317+0000","last_fullsized":"2023-10-08T13:27:09.736317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:04.530693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":324,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732798+0000","last_change":"2023-10-08T13:24:35.087384+0000","last_active":"2023-10-08T13:27:09.732798+0000","last_peered":"2023-10-08T13:27:09.732798+0000","last_clean":"2023-10-08T13:27:09.732798+0000","last_became_active":"2023-10-08T13:24:35.087046+0000","last_became_peered":"2023-10-08T13:24:35.087046+0000","last_unstale":"2023-10-08T13:27:09.732798+0000","last_undegraded":"2023-10-08T13:27:09.732798+0000","last_fullsized":"2023-10-08T13:27:09.732798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:21:44.905797+0000","last_clean_scrub_stamp":"2023-10-08T13:21:44.905797+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:09.553848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741629+0000","last_change":"2023-10-08T13:25:38.568273+0000","last_active":"2023-10-08T13:27:09.741629+0000","last_peered":"2023-10-08T13:27:09.741629+0000","last_clean":"2023-10-08T13:27:09.741629+0000","last_became_active":"2023-10-08T13:25:38.567829+0000","last_became_peered":"2023-10-08T13:25:38.567829+0000","last_unstale":"2023-10-08T13:27:09.741629+0000","last_undegraded":"2023-10-08T13:27:09.741629+0000","last_fullsized":"2023-10-08T13:27:09.741629+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:14:00.726866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780968+0000","last_change":"2023-10-08T13:25:34.437868+0000","last_active":"2023-10-08T13:27:09.780968+0000","last_peered":"2023-10-08T13:27:09.780968+0000","last_clean":"2023-10-08T13:27:09.780968+0000","last_became_active":"2023-10-08T13:25:34.437544+0000","last_became_peered":"2023-10-08T13:25:34.437544+0000","last_unstale":"2023-10-08T13:27:09.780968+0000","last_undegraded":"2023-10-08T13:27:09.780968+0000","last_fullsized":"2023-10-08T13:27:09.780968+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:35.139510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.732943+0000","last_change":"2023-10-08T13:25:33.439942+0000","last_active":"2023-10-08T13:27:09.732943+0000","last_peered":"2023-10-08T13:27:09.732943+0000","last_clean":"2023-10-08T13:27:09.732943+0000","last_became_active":"2023-10-08T13:25:33.439637+0000","last_became_peered":"2023-10-08T13:25:33.439637+0000","last_unstale":"2023-10-08T13:27:09.732943+0000","last_undegraded":"2023-10-08T13:27:09.732943+0000","last_fullsized":"2023-10-08T13:27:09.732943+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:08.756371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738569+0000","last_change":"2023-10-08T13:25:38.483477+0000","last_active":"2023-10-08T13:27:09.738569+0000","last_peered":"2023-10-08T13:27:09.738569+0000","last_clean":"2023-10-08T13:27:09.738569+0000","last_became_active":"2023-10-08T13:25:38.482875+0000","last_became_peered":"2023-10-08T13:25:38.482875+0000","last_unstale":"2023-10-08T13:27:09.738569+0000","last_undegraded":"2023-10-08T13:27:09.738569+0000","last_fullsized":"2023-10-08T13:27:09.738569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:41.974363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736536+0000","last_change":"2023-10-08T13:25:33.442376+0000","last_active":"2023-10-08T13:27:09.736536+0000","last_peered":"2023-10-08T13:27:09.736536+0000","last_clean":"2023-10-08T13:27:09.736536+0000","last_became_active":"2023-10-08T13:25:33.442071+0000","last_became_peered":"2023-10-08T13:25:33.442071+0000","last_unstale":"2023-10-08T13:27:09.736536+0000","last_undegraded":"2023-10-08T13:27:09.736536+0000","last_fullsized":"2023-10-08T13:27:09.736536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:36:36.146847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782820+0000","last_change":"2023-10-08T13:25:34.440406+0000","last_active":"2023-10-08T13:27:09.782820+0000","last_peered":"2023-10-08T13:27:09.782820+0000","last_clean":"2023-10-08T13:27:09.782820+0000","last_became_active":"2023-10-08T13:25:34.440105+0000","last_became_peered":"2023-10-08T13:25:34.440105+0000","last_unstale":"2023-10-08T13:27:09.782820+0000","last_undegraded":"2023-10-08T13:27:09.782820+0000","last_fullsized":"2023-10-08T13:27:09.782820+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:19.622906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.780955+0000","last_change":"2023-10-08T13:25:38.568503+0000","last_active":"2023-10-08T13:27:09.780955+0000","last_peered":"2023-10-08T13:27:09.780955+0000","last_clean":"2023-10-08T13:27:09.780955+0000","last_became_active":"2023-10-08T13:25:38.567455+0000","last_became_peered":"2023-10-08T13:25:38.567455+0000","last_unstale":"2023-10-08T13:27:09.780955+0000","last_undegraded":"2023-10-08T13:27:09.780955+0000","last_fullsized":"2023-10-08T13:27:09.780955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:12.655672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:11.489730+0000","last_change":"2023-10-08T13:25:33.442896+0000","last_active":"2023-10-08T13:27:11.489730+0000","last_peered":"2023-10-08T13:27:11.489730+0000","last_clean":"2023-10-08T13:27:11.489730+0000","last_became_active":"2023-10-08T13:25:33.442590+0000","last_became_peered":"2023-10-08T13:25:33.442590+0000","last_unstale":"2023-10-08T13:27:11.489730+0000","last_undegraded":"2023-10-08T13:27:11.489730+0000","last_fullsized":"2023-10-08T13:27:11.489730+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:00.020911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782391+0000","last_change":"2023-10-08T13:25:34.441512+0000","last_active":"2023-10-08T13:27:09.782391+0000","last_peered":"2023-10-08T13:27:09.782391+0000","last_clean":"2023-10-08T13:27:09.782391+0000","last_became_active":"2023-10-08T13:25:34.441144+0000","last_became_peered":"2023-10-08T13:25:34.441144+0000","last_unstale":"2023-10-08T13:27:09.782391+0000","last_undegraded":"2023-10-08T13:27:09.782391+0000","last_fullsized":"2023-10-08T13:27:09.782391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:36:27.194647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737106+0000","last_change":"2023-10-08T13:25:38.486456+0000","last_active":"2023-10-08T13:27:09.737106+0000","last_peered":"2023-10-08T13:27:09.737106+0000","last_clean":"2023-10-08T13:27:09.737106+0000","last_became_active":"2023-10-08T13:25:38.485849+0000","last_became_peered":"2023-10-08T13:25:38.485849+0000","last_unstale":"2023-10-08T13:27:09.737106+0000","last_undegraded":"2023-10-08T13:27:09.737106+0000","last_fullsized":"2023-10-08T13:27:09.737106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:14.443588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736980+0000","last_change":"2023-10-08T13:25:33.436736+0000","last_active":"2023-10-08T13:27:09.736980+0000","last_peered":"2023-10-08T13:27:09.736980+0000","last_clean":"2023-10-08T13:27:09.736980+0000","last_became_active":"2023-10-08T13:25:33.436417+0000","last_became_peered":"2023-10-08T13:25:33.436417+0000","last_unstale":"2023-10-08T13:27:09.736980+0000","last_undegraded":"2023-10-08T13:27:09.736980+0000","last_fullsized":"2023-10-08T13:27:09.736980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:04:05.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738015+0000","last_change":"2023-10-08T13:25:34.451571+0000","last_active":"2023-10-08T13:27:09.738015+0000","last_peered":"2023-10-08T13:27:09.738015+0000","last_clean":"2023-10-08T13:27:09.738015+0000","last_became_active":"2023-10-08T13:25:34.451248+0000","last_became_peered":"2023-10-08T13:25:34.451248+0000","last_unstale":"2023-10-08T13:27:09.738015+0000","last_undegraded":"2023-10-08T13:27:09.738015+0000","last_fullsized":"2023-10-08T13:27:09.738015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:17.780026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736655+0000","last_change":"2023-10-08T13:25:38.568547+0000","last_active":"2023-10-08T13:27:09.736655+0000","last_peered":"2023-10-08T13:27:09.736655+0000","last_clean":"2023-10-08T13:27:09.736655+0000","last_became_active":"2023-10-08T13:25:38.568051+0000","last_became_peered":"2023-10-08T13:25:38.568051+0000","last_unstale":"2023-10-08T13:27:09.736655+0000","last_undegraded":"2023-10-08T13:27:09.736655+0000","last_fullsized":"2023-10-08T13:27:09.736655+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:25.148277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735735+0000","last_change":"2023-10-08T13:25:33.443090+0000","last_active":"2023-10-08T13:27:09.735735+0000","last_peered":"2023-10-08T13:27:09.735735+0000","last_clean":"2023-10-08T13:27:09.735735+0000","last_became_active":"2023-10-08T13:25:33.442772+0000","last_became_peered":"2023-10-08T13:25:33.442772+0000","last_unstale":"2023-10-08T13:27:09.735735+0000","last_undegraded":"2023-10-08T13:27:09.735735+0000","last_fullsized":"2023-10-08T13:27:09.735735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:21:13.731545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735869+0000","last_change":"2023-10-08T13:25:34.448836+0000","last_active":"2023-10-08T13:27:09.735869+0000","last_peered":"2023-10-08T13:27:09.735869+0000","last_clean":"2023-10-08T13:27:09.735869+0000","last_became_active":"2023-10-08T13:25:34.448349+0000","last_became_peered":"2023-10-08T13:25:34.448349+0000","last_unstale":"2023-10-08T13:27:09.735869+0000","last_undegraded":"2023-10-08T13:27:09.735869+0000","last_fullsized":"2023-10-08T13:27:09.735869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:03:35.693758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782360+0000","last_change":"2023-10-08T13:25:38.494002+0000","last_active":"2023-10-08T13:27:09.782360+0000","last_peered":"2023-10-08T13:27:09.782360+0000","last_clean":"2023-10-08T13:27:09.782360+0000","last_became_active":"2023-10-08T13:25:38.493649+0000","last_became_peered":"2023-10-08T13:25:38.493649+0000","last_unstale":"2023-10-08T13:27:09.782360+0000","last_undegraded":"2023-10-08T13:27:09.782360+0000","last_fullsized":"2023-10-08T13:27:09.782360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:31.285996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781395+0000","last_change":"2023-10-08T13:25:33.441341+0000","last_active":"2023-10-08T13:27:09.781395+0000","last_peered":"2023-10-08T13:27:09.781395+0000","last_clean":"2023-10-08T13:27:09.781395+0000","last_became_active":"2023-10-08T13:25:33.441024+0000","last_became_peered":"2023-10-08T13:25:33.441024+0000","last_unstale":"2023-10-08T13:27:09.781395+0000","last_undegraded":"2023-10-08T13:27:09.781395+0000","last_fullsized":"2023-10-08T13:27:09.781395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:05.619662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737259+0000","last_change":"2023-10-08T13:25:34.442839+0000","last_active":"2023-10-08T13:27:09.737259+0000","last_peered":"2023-10-08T13:27:09.737259+0000","last_clean":"2023-10-08T13:27:09.737259+0000","last_became_active":"2023-10-08T13:25:34.442543+0000","last_became_peered":"2023-10-08T13:25:34.442543+0000","last_unstale":"2023-10-08T13:27:09.737259+0000","last_undegraded":"2023-10-08T13:27:09.737259+0000","last_fullsized":"2023-10-08T13:27:09.737259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:58.942450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735940+0000","last_change":"2023-10-08T13:25:38.493242+0000","last_active":"2023-10-08T13:27:09.735940+0000","last_peered":"2023-10-08T13:27:09.735940+0000","last_clean":"2023-10-08T13:27:09.735940+0000","last_became_active":"2023-10-08T13:25:38.492800+0000","last_became_peered":"2023-10-08T13:25:38.492800+0000","last_unstale":"2023-10-08T13:27:09.735940+0000","last_undegraded":"2023-10-08T13:27:09.735940+0000","last_fullsized":"2023-10-08T13:27:09.735940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:24.923035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739206+0000","last_change":"2023-10-08T13:25:33.431843+0000","last_active":"2023-10-08T13:27:09.739206+0000","last_peered":"2023-10-08T13:27:09.739206+0000","last_clean":"2023-10-08T13:27:09.739206+0000","last_became_active":"2023-10-08T13:25:33.431582+0000","last_became_peered":"2023-10-08T13:25:33.431582+0000","last_unstale":"2023-10-08T13:27:09.739206+0000","last_undegraded":"2023-10-08T13:27:09.739206+0000","last_fullsized":"2023-10-08T13:27:09.739206+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:36.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781680+0000","last_change":"2023-10-08T13:25:34.443141+0000","last_active":"2023-10-08T13:27:09.781680+0000","last_peered":"2023-10-08T13:27:09.781680+0000","last_clean":"2023-10-08T13:27:09.781680+0000","last_became_active":"2023-10-08T13:25:34.442839+0000","last_became_peered":"2023-10-08T13:25:34.442839+0000","last_unstale":"2023-10-08T13:27:09.781680+0000","last_undegraded":"2023-10-08T13:27:09.781680+0000","last_fullsized":"2023-10-08T13:27:09.781680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:05:16.022034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736305+0000","last_change":"2023-10-08T13:25:38.567899+0000","last_active":"2023-10-08T13:27:09.736305+0000","last_peered":"2023-10-08T13:27:09.736305+0000","last_clean":"2023-10-08T13:27:09.736305+0000","last_became_active":"2023-10-08T13:25:38.567391+0000","last_became_peered":"2023-10-08T13:25:38.567391+0000","last_unstale":"2023-10-08T13:27:09.736305+0000","last_undegraded":"2023-10-08T13:27:09.736305+0000","last_fullsized":"2023-10-08T13:27:09.736305+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:54:20.298022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:10.753812+0000","last_change":"2023-10-08T13:27:10.753399+0000","last_active":"2023-10-08T13:27:10.753812+0000","last_peered":"2023-10-08T13:27:10.753812+0000","last_clean":"2023-10-08T13:27:10.753812+0000","last_became_active":"2023-10-08T13:27:10.745101+0000","last_became_peered":"2023-10-08T13:27:10.745101+0000","last_unstale":"2023-10-08T13:27:10.753812+0000","last_undegraded":"2023-10-08T13:27:10.753812+0000","last_fullsized":"2023-10-08T13:27:10.753812+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:43.743911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733014+0000","last_change":"2023-10-08T13:25:34.449414+0000","last_active":"2023-10-08T13:27:09.733014+0000","last_peered":"2023-10-08T13:27:09.733014+0000","last_clean":"2023-10-08T13:27:09.733014+0000","last_became_active":"2023-10-08T13:25:34.449081+0000","last_became_peered":"2023-10-08T13:25:34.449081+0000","last_unstale":"2023-10-08T13:27:09.733014+0000","last_undegraded":"2023-10-08T13:27:09.733014+0000","last_fullsized":"2023-10-08T13:27:09.733014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.389658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.735936+0000","last_change":"2023-10-08T13:25:38.484043+0000","last_active":"2023-10-08T13:27:09.735936+0000","last_peered":"2023-10-08T13:27:09.735936+0000","last_clean":"2023-10-08T13:27:09.735936+0000","last_became_active":"2023-10-08T13:25:38.483416+0000","last_became_peered":"2023-10-08T13:25:38.483416+0000","last_unstale":"2023-10-08T13:27:09.735936+0000","last_undegraded":"2023-10-08T13:27:09.735936+0000","last_fullsized":"2023-10-08T13:27:09.735936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:24:30.385623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'5","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-10-08T13:27:23.533485+0000","last_change":"2023-10-08T13:25:33.442701+0000","last_active":"2023-10-08T13:27:23.533485+0000","last_peered":"2023-10-08T13:27:23.533485+0000","last_clean":"2023-10-08T13:27:23.533485+0000","last_became_active":"2023-10-08T13:25:33.441998+0000","last_became_peered":"2023-10-08T13:25:33.441998+0000","last_unstale":"2023-10-08T13:27:23.533485+0000","last_undegraded":"2023-10-08T13:27:23.533485+0000","last_fullsized":"2023-10-08T13:27:23.533485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:52:29.185929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733459+0000","last_change":"2023-10-08T13:25:34.448778+0000","last_active":"2023-10-08T13:27:09.733459+0000","last_peered":"2023-10-08T13:27:09.733459+0000","last_clean":"2023-10-08T13:27:09.733459+0000","last_became_active":"2023-10-08T13:25:34.448409+0000","last_became_peered":"2023-10-08T13:25:34.448409+0000","last_unstale":"2023-10-08T13:27:09.733459+0000","last_undegraded":"2023-10-08T13:27:09.733459+0000","last_fullsized":"2023-10-08T13:27:09.733459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:13.841063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737615+0000","last_change":"2023-10-08T13:25:38.491904+0000","last_active":"2023-10-08T13:27:09.737615+0000","last_peered":"2023-10-08T13:27:09.737615+0000","last_clean":"2023-10-08T13:27:09.737615+0000","last_became_active":"2023-10-08T13:25:38.491525+0000","last_became_peered":"2023-10-08T13:25:38.491525+0000","last_unstale":"2023-10-08T13:27:09.737615+0000","last_undegraded":"2023-10-08T13:27:09.737615+0000","last_fullsized":"2023-10-08T13:27:09.737615+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:25:20.579301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741660+0000","last_change":"2023-10-08T13:25:33.440386+0000","last_active":"2023-10-08T13:27:09.741660+0000","last_peered":"2023-10-08T13:27:09.741660+0000","last_clean":"2023-10-08T13:27:09.741660+0000","last_became_active":"2023-10-08T13:25:33.440101+0000","last_became_peered":"2023-10-08T13:25:33.440101+0000","last_unstale":"2023-10-08T13:27:09.741660+0000","last_undegraded":"2023-10-08T13:27:09.741660+0000","last_fullsized":"2023-10-08T13:27:09.741660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:12:27.039550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733214+0000","last_change":"2023-10-08T13:26:09.729493+0000","last_active":"2023-10-08T13:27:09.733214+0000","last_peered":"2023-10-08T13:27:09.733214+0000","last_clean":"2023-10-08T13:27:09.733214+0000","last_became_active":"2023-10-08T13:26:09.729238+0000","last_became_peered":"2023-10-08T13:26:09.729238+0000","last_unstale":"2023-10-08T13:27:09.733214+0000","last_undegraded":"2023-10-08T13:27:09.733214+0000","last_fullsized":"2023-10-08T13:27:09.733214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:33.262086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741059+0000","last_change":"2023-10-08T13:25:38.485197+0000","last_active":"2023-10-08T13:27:09.741059+0000","last_peered":"2023-10-08T13:27:09.741059+0000","last_clean":"2023-10-08T13:27:09.741059+0000","last_became_active":"2023-10-08T13:25:38.484802+0000","last_became_peered":"2023-10-08T13:25:38.484802+0000","last_unstale":"2023-10-08T13:27:09.741059+0000","last_undegraded":"2023-10-08T13:27:09.741059+0000","last_fullsized":"2023-10-08T13:27:09.741059+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:37.458898+0000","last_clean_scrub_stamp":"2023-10-08T13:25:37.458898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:25.401593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781723+0000","last_change":"2023-10-08T13:25:33.442893+0000","last_active":"2023-10-08T13:27:09.781723+0000","last_peered":"2023-10-08T13:27:09.781723+0000","last_clean":"2023-10-08T13:27:09.781723+0000","last_became_active":"2023-10-08T13:25:33.442593+0000","last_became_peered":"2023-10-08T13:25:33.442593+0000","last_unstale":"2023-10-08T13:27:09.781723+0000","last_undegraded":"2023-10-08T13:27:09.781723+0000","last_fullsized":"2023-10-08T13:27:09.781723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:32.408631+0000","last_clean_scrub_stamp":"2023-10-08T13:25:32.408631+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:18:56.277695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.733686+0000","last_change":"2023-10-08T13:25:34.454269+0000","last_active":"2023-10-08T13:27:09.733686+0000","last_peered":"2023-10-08T13:27:09.733686+0000","last_clean":"2023-10-08T13:27:09.733686+0000","last_became_active":"2023-10-08T13:25:34.453948+0000","last_became_peered":"2023-10-08T13:25:34.453948+0000","last_unstale":"2023-10-08T13:27:09.733686+0000","last_undegraded":"2023-10-08T13:27:09.733686+0000","last_fullsized":"2023-10-08T13:27:09.733686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:41:30.555243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737343+0000","last_change":"2023-10-08T13:25:34.454964+0000","last_active":"2023-10-08T13:27:09.737343+0000","last_peered":"2023-10-08T13:27:09.737343+0000","last_clean":"2023-10-08T13:27:09.737343+0000","last_became_active":"2023-10-08T13:25:34.454667+0000","last_became_peered":"2023-10-08T13:25:34.454667+0000","last_unstale":"2023-10-08T13:27:09.737343+0000","last_undegraded":"2023-10-08T13:27:09.737343+0000","last_fullsized":"2023-10-08T13:27:09.737343+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:36:47.925498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738392+0000","last_change":"2023-10-08T13:25:34.452284+0000","last_active":"2023-10-08T13:27:09.738392+0000","last_peered":"2023-10-08T13:27:09.738392+0000","last_clean":"2023-10-08T13:27:09.738392+0000","last_became_active":"2023-10-08T13:25:34.451975+0000","last_became_peered":"2023-10-08T13:25:34.451975+0000","last_unstale":"2023-10-08T13:27:09.738392+0000","last_undegraded":"2023-10-08T13:27:09.738392+0000","last_fullsized":"2023-10-08T13:27:09.738392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:01:20.208832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738345+0000","last_change":"2023-10-08T13:25:34.446482+0000","last_active":"2023-10-08T13:27:09.738345+0000","last_peered":"2023-10-08T13:27:09.738345+0000","last_clean":"2023-10-08T13:27:09.738345+0000","last_became_active":"2023-10-08T13:25:34.446208+0000","last_became_peered":"2023-10-08T13:25:34.446208+0000","last_unstale":"2023-10-08T13:27:09.738345+0000","last_undegraded":"2023-10-08T13:27:09.738345+0000","last_fullsized":"2023-10-08T13:27:09.738345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:40.913506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.737841+0000","last_change":"2023-10-08T13:25:34.450328+0000","last_active":"2023-10-08T13:27:09.737841+0000","last_peered":"2023-10-08T13:27:09.737841+0000","last_clean":"2023-10-08T13:27:09.737841+0000","last_became_active":"2023-10-08T13:25:34.449993+0000","last_became_peered":"2023-10-08T13:25:34.449993+0000","last_unstale":"2023-10-08T13:27:09.737841+0000","last_undegraded":"2023-10-08T13:27:09.737841+0000","last_fullsized":"2023-10-08T13:27:09.737841+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:41.905367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782767+0000","last_change":"2023-10-08T13:25:34.442764+0000","last_active":"2023-10-08T13:27:09.782767+0000","last_peered":"2023-10-08T13:27:09.782767+0000","last_clean":"2023-10-08T13:27:09.782767+0000","last_became_active":"2023-10-08T13:25:34.442464+0000","last_became_peered":"2023-10-08T13:25:34.442464+0000","last_unstale":"2023-10-08T13:27:09.782767+0000","last_undegraded":"2023-10-08T13:27:09.782767+0000","last_fullsized":"2023-10-08T13:27:09.782767+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:22.541663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739358+0000","last_change":"2023-10-08T13:26:09.729602+0000","last_active":"2023-10-08T13:27:09.739358+0000","last_peered":"2023-10-08T13:27:09.739358+0000","last_clean":"2023-10-08T13:27:09.739358+0000","last_became_active":"2023-10-08T13:26:09.729112+0000","last_became_peered":"2023-10-08T13:26:09.729112+0000","last_unstale":"2023-10-08T13:27:09.739358+0000","last_undegraded":"2023-10-08T13:27:09.739358+0000","last_fullsized":"2023-10-08T13:27:09.739358+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:29.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.739001+0000","last_change":"2023-10-08T13:25:34.441934+0000","last_active":"2023-10-08T13:27:09.739001+0000","last_peered":"2023-10-08T13:27:09.739001+0000","last_clean":"2023-10-08T13:27:09.739001+0000","last_became_active":"2023-10-08T13:25:34.441634+0000","last_became_peered":"2023-10-08T13:25:34.441634+0000","last_unstale":"2023-10-08T13:27:09.739001+0000","last_undegraded":"2023-10-08T13:27:09.739001+0000","last_fullsized":"2023-10-08T13:27:09.739001+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:28:33.342475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.782672+0000","last_change":"2023-10-08T13:25:34.444307+0000","last_active":"2023-10-08T13:27:09.782672+0000","last_peered":"2023-10-08T13:27:09.782672+0000","last_clean":"2023-10-08T13:27:09.782672+0000","last_became_active":"2023-10-08T13:25:34.443987+0000","last_became_peered":"2023-10-08T13:25:34.443987+0000","last_unstale":"2023-10-08T13:27:09.782672+0000","last_undegraded":"2023-10-08T13:27:09.782672+0000","last_fullsized":"2023-10-08T13:27:09.782672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:46.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.741194+0000","last_change":"2023-10-08T13:25:34.454640+0000","last_active":"2023-10-08T13:27:09.741194+0000","last_peered":"2023-10-08T13:27:09.741194+0000","last_clean":"2023-10-08T13:27:09.741194+0000","last_became_active":"2023-10-08T13:25:34.454349+0000","last_became_peered":"2023-10-08T13:25:34.454349+0000","last_unstale":"2023-10-08T13:27:09.741194+0000","last_undegraded":"2023-10-08T13:27:09.741194+0000","last_fullsized":"2023-10-08T13:27:09.741194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:51:48.071226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781309+0000","last_change":"2023-10-08T13:25:34.438742+0000","last_active":"2023-10-08T13:27:09.781309+0000","last_peered":"2023-10-08T13:27:09.781309+0000","last_clean":"2023-10-08T13:27:09.781309+0000","last_became_active":"2023-10-08T13:25:34.438431+0000","last_became_peered":"2023-10-08T13:25:34.438431+0000","last_unstale":"2023-10-08T13:27:09.781309+0000","last_undegraded":"2023-10-08T13:27:09.781309+0000","last_fullsized":"2023-10-08T13:27:09.781309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:51:25.611965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.736159+0000","last_change":"2023-10-08T13:25:34.442712+0000","last_active":"2023-10-08T13:27:09.736159+0000","last_peered":"2023-10-08T13:27:09.736159+0000","last_clean":"2023-10-08T13:27:09.736159+0000","last_became_active":"2023-10-08T13:25:34.442408+0000","last_became_peered":"2023-10-08T13:25:34.442408+0000","last_unstale":"2023-10-08T13:27:09.736159+0000","last_undegraded":"2023-10-08T13:27:09.736159+0000","last_fullsized":"2023-10-08T13:27:09.736159+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:10:28.428973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.781373+0000","last_change":"2023-10-08T13:25:34.442807+0000","last_active":"2023-10-08T13:27:09.781373+0000","last_peered":"2023-10-08T13:27:09.781373+0000","last_clean":"2023-10-08T13:27:09.781373+0000","last_became_active":"2023-10-08T13:25:34.442520+0000","last_became_peered":"2023-10-08T13:25:34.442520+0000","last_unstale":"2023-10-08T13:27:09.781373+0000","last_undegraded":"2023-10-08T13:27:09.781373+0000","last_fullsized":"2023-10-08T13:27:09.781373+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:49.276020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-10-08T13:27:09.738775+0000","last_change":"2023-10-08T13:25:34.439228+0000","last_active":"2023-10-08T13:27:09.738775+0000","last_peered":"2023-10-08T13:27:09.738775+0000","last_clean":"2023-10-08T13:27:09.738775+0000","last_became_active":"2023-10-08T13:25:34.438920+0000","last_became_peered":"2023-10-08T13:25:34.438920+0000","last_unstale":"2023-10-08T13:27:09.738775+0000","last_undegraded":"2023-10-08T13:27:09.738775+0000","last_fullsized":"2023-10-08T13:27:09.738775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T13:25:33.414085+0000","last_clean_scrub_stamp":"2023-10-08T13:25:33.414085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:26.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":3542208,"data_compressed":208782,"data_compressed_allocated":270336,"data_compressed_original":3489792,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66329,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":837,"num_read_kb":485,"num_write":244,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":134,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":198987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449121,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":524372,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36599999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64700000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.5},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80400000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.66200000000000003,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67300000000000004,"15min":0.66800000000000004},"min":{"1min":0.47799999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.89100000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70799999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.438},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.69499999999999995},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89000000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.505,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88200000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.64800000000000002},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.625},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56499999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.90900000000000003,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.54900000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1060000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.71099999999999997}]},{"osd":8,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.753},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.73899999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.65800000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93100000000000005,"5min":1.617,"15min":1.617},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.65400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98599999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.77700000000000002}]},{"osd":10,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.68899999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0900000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.68899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0169999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.872}]}]},{"osd":10,"up_from":71,"seq":304942678054,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1159168,"data_stored":1173989,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":9.8559999999999999,"5min":9.8559999999999999,"15min":9.8559999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.8759999999999994,"5min":9.8759999999999994,"15min":9.8759999999999994},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46300000000000002,"15min":0.46400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67700000000000005,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.498}]},{"osd":3,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.64200000000000002,"15min":0.65000000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.32500000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.751,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78600000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.443}]},{"osd":5,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83099999999999996,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.87,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.755,"15min":0.73599999999999999},"min":{"1min":0.51700000000000002,"5min":0.442,"15min":0.442},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":1.075,"5min":0.78200000000000003,"15min":0.73299999999999998},"min":{"1min":0.54000000000000004,"5min":0.5,"15min":0.5},"max":{"1min":7.9939999999999998,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":8,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.52500000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.997,"15min":0.997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.57499999999999996}]},{"osd":9,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":0.86199999999999999,"15min":0.81000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.7279999999999998,"5min":9.7279999999999998,"15min":9.7279999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.54400000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2539999999999996,"5min":4.2539999999999996,"15min":4.2539999999999996},"last":0.68100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.76900000000000002,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93799999999999994,"5min":1.002,"15min":1.002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.80800000000000005,"15min":0.79800000000000004},"min":{"1min":0.628,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.70299999999999996}]}]},{"osd":9,"up_from":66,"seq":283467841578,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":524280,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.53900000000000003,"15min":0.49199999999999999},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":11.170999999999999,"5min":11.170999999999999,"15min":11.170999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.52200000000000002,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":7.0830000000000002,"5min":7.0830000000000002,"15min":7.0830000000000002},"last":0.315}]},{"osd":1,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":0.77600000000000002,"15min":0.70199999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.339,"5min":11.339,"15min":11.339},"last":0.48099999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67200000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.1070000000000002,"5min":2.1070000000000002,"15min":2.1070000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":1.381,"5min":0.77300000000000002,"15min":0.68000000000000005},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":11.218999999999999,"5min":11.218999999999999,"15min":11.218999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.109,"5min":7.109,"15min":7.109},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.65600000000000003,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":11.125,"5min":11.125,"15min":11.125},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":0.78200000000000003,"15min":0.70099999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":11.308,"5min":11.308,"15min":11.308},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.82199999999999995,"15min":0.85799999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.8799999999999999,"5min":6.8799999999999999,"15min":6.8799999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Oct 8 13:25:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.496},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.39400000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":7.0519999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.81100000000000005,"15min":0.873},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":2.2130000000000001,"5min":2.484,"15min":2.484},"last":0.65100000000000002}]},{"osd":8,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":0.86899999999999999,"15min":0.79700000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":11.249000000000001,"5min":11.249000000000001,"15min":11.249000000000001},"last":0.433},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.59599999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":6.9299999999999997,"5min":6.9299999999999997,"15min":6.9299999999999997},"last":0.57199999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":0.90600000000000003,"15min":0.82599999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":11.278,"5min":11.278,"15min":11.278},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.85799999999999998,"15min":0.84199999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":7.0250000000000004,"5min":7.0250000000000004,"15min":7.0250000000000004},"last":0.68500000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":6.9619999999999997,"5min":6.9619999999999997,"15min":6.9619999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":0.628}]}]},{"osd":8,"up_from":58,"seq":249108103215,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":520259,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.41199999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.64100000000000001,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68400000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45000000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.63800000000000001,"15min":0.58999999999999997},"min":{"1min":0.52200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93899999999999995,"5min":4.2880000000000003,"15min":4.2880000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.45000000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78800000000000003,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.46800000000000003,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76900000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.317},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.45500000000000002},"min":{"1min":0.34200000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70899999999999996,"5min":1.073,"15min":1.073},"last":0.59099999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.435,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.624},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.42699999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65200000000000002,"15min":0.63800000000000001},"min":{"1min":0.52300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83799999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65300000000000002,"15min":0.63},"min":{"1min":0.53800000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85399999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76000000000000001,"5min":1.175,"15min":1.175},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59799999999999998,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.879,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92500000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.85699999999999998,"5min":4.319,"15min":4.319},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.55000000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.73399999999999999,"15min":0.71299999999999997},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.004,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65900000000000003}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.71699999999999997,"15min":0.69299999999999995},"min":{"1min":0.59299999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.70899999999999996,"15min":0.67900000000000005},"min":{"1min":0.61299999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93300000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71899999999999997}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0549999999999999,"5min":4.3049999999999997,"15min":4.3049999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.83499999999999996,"15min":0.82699999999999996},"min":{"1min":0.63,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":4.3339999999999996,"15min":4.3339999999999996},"last":0.745}]},{"osd":11,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.77500000000000002}]}]},{"osd":7,"up_from":51,"seq":219043332147,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1117517,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.38400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59999999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88300000000000001,"5min":0.995,"15min":0.995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.61399999999999999,"15min":0.60499999999999998},"min":{"1min":0.55900000000000005,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57399999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.62}]},{"osd":4,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73699999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.60799999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81200000000000006,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.53800000000000003,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85999999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.83299999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72199999999999998,"15min":0.71999999999999997},"min":{"1min":0.56399999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89000000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.94799999999999995,"5min":1.05,"15min":1.05},"last":0.87}]},{"osd":9,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.73499999999999999,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.748,"15min":0.73199999999999998},"min":{"1min":0.55400000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.80000000000000004}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68899999999999995,"15min":0.69399999999999995},"min":{"1min":0.436,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":1.036,"15min":1.036},"last":0.73499999999999999}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.92400000000000004}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":519784,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.45600000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.435,"15min":0.41499999999999998},"min":{"1min":0.31,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.40300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59699999999999998,"15min":0.57499999999999996},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.47299999999999998},"min":{"1min":0.33700000000000002,"5min":0.245,"15min":0.245},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.499}]},{"osd":4,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.626},"min":{"1min":0.46400000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54800000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.016,"5min":1.179,"15min":1.179},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.52700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.46200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:26:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0269999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.73199999999999998,"15min":0.75600000000000001},"min":{"1min":0.56699999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56699999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:27:16 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.79700000000000004,"15min":0.73699999999999999},"min":{"1min":0.44,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":12.978999999999999,"5min":12.978999999999999,"15min":12.978999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.874,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1820000000000004,"5min":5.1820000000000004,"15min":5.1820000000000004},"last":0.44}]},{"osd":10,"last update":"Sun Oct 8 13:26:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.752,"15min":0.74299999999999999},"min":{"1min":0.54100000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67800000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.622}]}]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":584080,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.314,"5min":0.307,"15min":0.307},"max":{"1min":0.70999999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52600000000000002,"15min":0.52000000000000002},"min":{"1min":0.33600000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.61599999999999999,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85999999999999999,"5min":1.427,"15min":1.427},"last":0.82299999999999995}]},{"osd":3,"last update":"Sun Oct 8 13:27:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68700000000000006,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79000000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:25:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.439},"min":{"1min":0.317,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66600000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.45000000000000001,"15min":0.432},"min":{"1min":0.33600000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.79300000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88200000000000001,"5min":5.9509999999999996,"15min":5.9509999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64000000000000001,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:27:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.83199999999999996,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61599999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88300000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64000000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.68100000000000005,"15min":0.66000000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0429999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.747},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":1.238,"15min":1.238},"last":0.621}]},{"osd":9,"last update":"Sun Oct 8 13:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.754},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.91300000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69499999999999995}]},{"osd":10,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69899999999999995,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.97299999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78200000000000003,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79600000000000004}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.85199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":521240,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52400000000000002,"15min":0.50600000000000001},"min":{"1min":0.35799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79300000000000004,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.40699999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.51600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82899999999999996,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.52800000000000002},"min":{"1min":0.42299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84199999999999997,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":1.0029999999999999,"15min":0.70199999999999996},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.73799999999999999,"5min":45.225000000000001,"15min":45.225000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.995,"15min":0.68700000000000006},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92900000000000005,"5min":45.244,"15min":45.244},"last":0.497}]},{"osd":6,"last update":"Sun Oct 8 13:27:13 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.502,"15min":0.48599999999999999},"min":{"1min":0.372,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.80200000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.623,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.35399999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67300000000000004}]},{"osd":8,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.79600000000000004,"15min":0.85199999999999998},"min":{"1min":0.46800000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90400000000000003,"5min":3.403,"15min":3.403},"last":0.54700000000000004}]},{"osd":9,"last update":"Sun Oct 8 13:27:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66800000000000004,"15min":0.70199999999999996},"min":{"1min":0.41099999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81499999999999995,"5min":1.026,"15min":1.026},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66500000000000004,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84799999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97099999999999997,"5min":1.008,"15min":1.008},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.57499999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90300000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.57999999999999996}]},{"osd":11,"last update":"Sun Oct 8 13:26:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.749}]}]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1093632,"data_stored":584925,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81200000000000006,"5min":0.872,"15min":0.872},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53000000000000003,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81299999999999994,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57599999999999996,"15min":0.53500000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83599999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58899999999999997,"15min":0.54700000000000004},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89900000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.60699999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:27:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.55800000000000005},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.499,"15min":0.441},"min":{"1min":0.435,"5min":0.311,"15min":0.311},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.48099999999999998},"min":{"1min":0.33100000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.89700000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88500000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.755}]},{"osd":7,"last update":"Sun Oct 8 13:26:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.88500000000000001}]},{"osd":8,"last update":"Sun Oct 8 13:26:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.81599999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.74199999999999999,"15min":0.72099999999999997},"min":{"1min":0.60199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96299999999999997,"5min":1.026,"15min":1.026},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74299999999999999,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.85199999999999998}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.58899999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.75700000000000001,"15min":0.73399999999999999},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.054,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83899999999999997}]},{"osd":11,"last update":"Sun Oct 8 13:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.86699999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":519211,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35999999999999999,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.52300000000000002,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36399999999999999,"15min":0.32600000000000001},"min":{"1min":0.26500000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.54800000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.251}]},{"osd":1,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55300000000000005,"15min":0.505},"min":{"1min":0.40000000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80200000000000005,"5min":1.806,"15min":1.806},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57199999999999995,"15min":0.52000000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79400000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.504},"min":{"1min":0.33500000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42699999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81399999999999995,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.54400000000000004},"min":{"1min":0.41799999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.60599999999999998,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.49299999999999999,"15min":0.48699999999999999},"min":{"1min":0.32800000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.64300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.307,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68000000000000005,"5min":1.008,"15min":1.008},"last":0.377}]},{"osd":7,"last update":"Sun Oct 8 13:26:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.62,"15min":0.60599999999999998},"min":{"1min":0.40799999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.68600000000000005,"15min":0.67700000000000005},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.60599999999999998}]},{"osd":8,"last update":"Sun Oct 8 13:24:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.59099999999999997}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.66800000000000004,"15min":0.70299999999999996},"min":{"1min":0.40000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.69999999999999996,"5min":1.05,"15min":1.05},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.628,"15min":0.66100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77800000000000002,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57699999999999996}]},{"osd":10,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.70299999999999996,"15min":0.71599999999999997},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.872,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.753,"15min":0.76100000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":0.88800000000000001,"5min":1.583,"15min":1.583},"last":0.63100000000000001}]},{"osd":11,"last update":"Sun Oct 8 13:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54100000000000004}]}]},{"osd":4,"up_from":33,"seq":141733920832,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":523858,"data_compressed":26505,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.41999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.42199999999999999,"15min":0.39800000000000002},"min":{"1min":0.307,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.436,"15min":0.39400000000000002},"min":{"1min":0.33400000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.59399999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59999999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.55500000000000005},"min":{"1min":0.50900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.90800000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.57999999999999996},"min":{"1min":0.48899999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.69499999999999995,"15min":0.64400000000000002},"min":{"1min":0.53500000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91300000000000003,"5min":1.004,"15min":1.004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.75800000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Oct 8 13:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.36499999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66500000000000004,"15min":0.65000000000000002},"min":{"1min":0.42599999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70899999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:26:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.69899999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97899999999999998,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81299999999999994,"15min":0.80700000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.99199999999999999,"5min":1.149,"15min":1.149},"last":0.74099999999999999}]},{"osd":9,"last update":"Sun Oct 8 13:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.51900000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96099999999999997,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.85699999999999998,"5min":1,"15min":1},"last":0.61699999999999999}]},{"osd":10,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.52000000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0629999999999999,"5min":1.131,"15min":1.131},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.71799999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96499999999999997,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56100000000000005}]},{"osd":11,"last update":"Sun Oct 8 13:26:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.79400000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":1117195,"data_compressed":62121,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54300000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.873,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.311,"15min":0.311},"max":{"1min":0.747,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.504,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.61599999999999999,"15min":0.57699999999999996},"min":{"1min":0.58299999999999996,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79000000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.84399999999999997}]},{"osd":2,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.40999999999999998,"15min":0.38300000000000001},"min":{"1min":0.35499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71699999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.432,"15min":0.40200000000000002},"min":{"1min":0.34799999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.69699999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51100000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41199999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":1.571,"15min":1.571},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.40799999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.63400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.755},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61099999999999999,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":1.032,"15min":1.032},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.63600000000000001,"15min":0.60399999999999998},"min":{"1min":0.504,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0209999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.69099999999999995,"15min":0.66400000000000003},"min":{"1min":0.59499999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.995,"5min":1.615,"15min":1.615},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.67600000000000005,"15min":0.65700000000000003},"min":{"1min":0.57099999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.63400000000000001,"15min":0.61699999999999999},"min":{"1min":0.57299999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.82499999999999996}]},{"osd":8,"last update":"Sun Oct 8 13:26:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.63800000000000001,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":1.069,"15min":1.069},"last":0.872},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.57199999999999995,"15min":0.54800000000000004},"min":{"1min":0.46899999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.69799999999999995}]},{"osd":9,"last update":"Sun Oct 8 13:27:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.69299999999999995,"15min":0.68200000000000005},"min":{"1min":0.55000000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.006,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.77200000000000002,"15min":0.74099999999999999},"min":{"1min":0.73099999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.085,"5min":1.353,"15min":1.353},"last":0.93600000000000005}]},{"osd":10,"last update":"Sun Oct 8 13:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.64000000000000001,"15min":0.61599999999999999},"min":{"1min":0.67600000000000005,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.66400000000000003,"15min":0.64300000000000002},"min":{"1min":0.59899999999999998,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33978,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35616,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:27:26.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:26.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.978+0000 7fc159938700 1 -- 172.21.15.139:0/3604505747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 msgr2=0x7fc15410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.978+0000 7fc159938700 1 --2- 172.21.15.139:0/3604505747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15410c470 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00b0a0 tx=0x7fc14c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 -- 172.21.15.139:0/3604505747 shutdown_connections 2023-10-08T13:27:26.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 --2- 172.21.15.139:0/3604505747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15410c470 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 --2- 172.21.15.139:0/3604505747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc154100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 --2- 172.21.15.139:0/3604505747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc154100c60 0x7fc154104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 -- 172.21.15.139:0/3604505747 >> 172.21.15.139:0/3604505747 conn(0x7fc154074820 msgr2=0x7fc154074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 -- 172.21.15.139:0/3604505747 shutdown_connections 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 -- 172.21.15.139:0/3604505747 wait complete. 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 Processor -- start 2023-10-08T13:27:26.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.979+0000 7fc159938700 1 -- start start 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc15419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 0x7fc154199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15419a2c0 con 0x7fc1541048e0 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15419a430 con 0x7fc1541997f0 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15419a5f0 con 0x7fc1541002b0 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40250/0 (socket says 172.21.15.139:40250) 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 -- 172.21.15.139:0/2156342831 learned_addr learned my addr 172.21.15.139:0/2156342831 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc152ffd700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc15419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1537fe700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 0x7fc154199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 -- 172.21.15.139:0/2156342831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 msgr2=0x7fc15419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc15419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 -- 172.21.15.139:0/2156342831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 msgr2=0x7fc154199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 0x7fc154199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 -- 172.21.15.139:0/2156342831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c009d00 con 0x7fc1541048e0 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc152ffd700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc15419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1537fe700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 0x7fc154199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc1527fc700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc14800d950 tx=0x7fc14800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc148009b40 con 0x7fc1541048e0 2023-10-08T13:27:26.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc14800de30 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1541a5a30 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14800f620 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.980+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1541a5f10 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.981+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc154104090 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.982+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc148010460 con 0x7fc1541048e0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.983+0000 7fc158936700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 0x7fc13c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.983+0000 7fc152ffd700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 0x7fc13c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:26.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.983+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc1480ccdc0 con 0x7fc1541048e0 2023-10-08T13:27:26.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.983+0000 7fc152ffd700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 0x7fc13c0a3990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc144009cb0 tx=0x7fc144009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:26.988 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:26.987+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc148095f60 con 0x7fc1541048e0 2023-10-08T13:27:27.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.179+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc154068880 con 0x7fc1541048e0 2023-10-08T13:27:27.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.180+0000 7fc158936700 1 -- 172.21.15.139:0/2156342831 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7fc148017090 con 0x7fc1541048e0 2023-10-08T13:27:27.181 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:27.182 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:27.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 msgr2=0x7fc13c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 0x7fc13c0a3990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc144009cb0 tx=0x7fc144009260 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 msgr2=0x7fc15419f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc14800d950 tx=0x7fc14800dd10 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 shutdown_connections 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc13c0a14d0 0x7fc13c0a3990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1541997f0 0x7fc154199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1541002b0 0x7fc15419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 --2- 172.21.15.139:0/2156342831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1541048e0 0x7fc15419f0c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 >> 172.21.15.139:0/2156342831 conn(0x7fc154074820 msgr2=0x7fc1541011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 shutdown_connections 2023-10-08T13:27:27.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.182+0000 7fc159938700 1 -- 172.21.15.139:0/2156342831 wait complete. 2023-10-08T13:27:27.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:27:27.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:27:27.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 -- 172.21.15.139:0/2384392480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 msgr2=0x7efbf010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 --2- 172.21.15.139:0/2384392480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf010c4e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efbe800b0a0 tx=0x7efbe800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 -- 172.21.15.139:0/2384392480 shutdown_connections 2023-10-08T13:27:27.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 --2- 172.21.15.139:0/2384392480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf010c4e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 --2- 172.21.15.139:0/2384392480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf01056b0 0x7efbf0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 --2- 172.21.15.139:0/2384392480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf00ff620 0x7efbf00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 -- 172.21.15.139:0/2384392480 >> 172.21.15.139:0/2384392480 conn(0x7efbf0076780 msgr2=0x7efbf0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 -- 172.21.15.139:0/2384392480 shutdown_connections 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.320+0000 7efbf6bed700 1 -- 172.21.15.139:0/2384392480 wait complete. 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 Processor -- start 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 -- start start 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00ff620 0x7efbf019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 0x7efbf0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01990b0 con 0x7efbf00fffe0 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf0199220 con 0x7efbf00ff620 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf6bed700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf01993e0 con 0x7efbf01056b0 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40264/0 (socket says 172.21.15.139:40264) 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 -- 172.21.15.139:0/3187815762 learned_addr learned my addr 172.21.15.139:0/3187815762 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf518a700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 0x7efbf0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf4989700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00ff620 0x7efbf019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 -- 172.21.15.139:0/3187815762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 msgr2=0x7efbf0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 0x7efbf0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 -- 172.21.15.139:0/3187815762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00ff620 msgr2=0x7efbf019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00ff620 0x7efbf019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 -- 172.21.15.139:0/3187815762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009d00 con 0x7efbf00fffe0 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbf518a700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 0x7efbf0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.321+0000 7efbeffff700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efbdc00c9b0 tx=0x7efbdc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.322+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc007b00 con 0x7efbf00fffe0 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.322+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbdc007c60 con 0x7efbf00fffe0 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.322+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf01996c0 con 0x7efbf00fffe0 2023-10-08T13:27:27.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.322+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbdc018660 con 0x7efbf00fffe0 2023-10-08T13:27:27.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.322+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf01a5910 con 0x7efbf00fffe0 2023-10-08T13:27:27.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.323+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf0100d50 con 0x7efbf00fffe0 2023-10-08T13:27:27.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.324+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7efbdc018880 con 0x7efbf00fffe0 2023-10-08T13:27:27.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.324+0000 7efbedffb700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 0x7efbe00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.325+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7efbdc0cd1b0 con 0x7efbf00fffe0 2023-10-08T13:27:27.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.325+0000 7efbf4989700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 0x7efbe00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.325+0000 7efbf4989700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 0x7efbe00a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005fd0 tx=0x7efbe4005dd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:27.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.329+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efbdc0963b0 con 0x7efbf00fffe0 2023-10-08T13:27:27.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.520+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efbf010f4f0 con 0x7efbf00fffe0 2023-10-08T13:27:27.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.520+0000 7efbedffb700 1 -- 172.21.15.139:0/3187815762 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7efbdc0999d0 con 0x7efbf00fffe0 2023-10-08T13:27:27.521 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:27:27.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 msgr2=0x7efbe00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 0x7efbe00a3a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efbe4005fd0 tx=0x7efbe4005dd0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 msgr2=0x7efbf019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efbdc00c9b0 tx=0x7efbdc00cd70 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 shutdown_connections 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbe00a1550 0x7efbe00a3a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efbf01056b0 0x7efbf0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efbf00ff620 0x7efbf019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 --2- 172.21.15.139:0/3187815762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efbf00fffe0 0x7efbf019ee60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.522+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 >> 172.21.15.139:0/3187815762 conn(0x7efbf0076780 msgr2=0x7efbf0067860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.523+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 shutdown_connections 2023-10-08T13:27:27.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.523+0000 7efbf6bed700 1 -- 172.21.15.139:0/3187815762 wait complete. 2023-10-08T13:27:27.536 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:27:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 -- 172.21.15.139:0/84270820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440ff620 msgr2=0x7fa3440ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 --2- 172.21.15.139:0/84270820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440ff620 0x7fa3440ffaa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa340009990 tx=0x7fa340009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 -- 172.21.15.139:0/84270820 shutdown_connections 2023-10-08T13:27:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 --2- 172.21.15.139:0/84270820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440fffe0 0x7fa34410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 --2- 172.21.15.139:0/84270820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 0x7fa344105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 --2- 172.21.15.139:0/84270820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440ff620 0x7fa3440ffaa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 -- 172.21.15.139:0/84270820 >> 172.21.15.139:0/84270820 conn(0x7fa344076780 msgr2=0x7fa344076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 -- 172.21.15.139:0/84270820 shutdown_connections 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.659+0000 7fa34c34b700 1 -- 172.21.15.139:0/84270820 wait complete. 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 Processor -- start 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 -- start start 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440ff620 0x7fa344198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 0x7fa34419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34419dca0 con 0x7fa3440fffe0 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34419de10 con 0x7fa3441056b0 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34c34b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34419dfd0 con 0x7fa3440ff620 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40278/0 (socket says 172.21.15.139:40278) 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 -- 172.21.15.139:0/2834062173 learned_addr learned my addr 172.21.15.139:0/2834062173 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34a8e8700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 0x7fa34419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa34a0e7700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440ff620 0x7fa344198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 -- 172.21.15.139:0/2834062173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440ff620 msgr2=0x7fa344198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440ff620 0x7fa344198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 -- 172.21.15.139:0/2834062173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 msgr2=0x7fa34419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 0x7fa34419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 -- 172.21.15.139:0/2834062173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400095f0 con 0x7fa3440fffe0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa3498e6700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa3400095c0 tx=0x7fa34000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34001d070 con 0x7fa3440fffe0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.660+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3400054f0 con 0x7fa3440fffe0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.661+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34419e250 con 0x7fa3440fffe0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.661+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340004bd0 con 0x7fa3440fffe0 2023-10-08T13:27:27.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.661+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3441a5af0 con 0x7fa3440fffe0 2023-10-08T13:27:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.661+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa344100d50 con 0x7fa3440fffe0 2023-10-08T13:27:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.662+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa34000fb80 con 0x7fa3440fffe0 2023-10-08T13:27:27.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.663+0000 7fa33b7fe700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 0x7fa3300a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.663+0000 7fa34a0e7700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 0x7fa3300a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.663+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa3400cdf30 con 0x7fa3440fffe0 2023-10-08T13:27:27.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.663+0000 7fa34a0e7700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 0x7fa3300a3990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa334005950 tx=0x7fa3340058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:27.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.667+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa3400971c0 con 0x7fa3440fffe0 2023-10-08T13:27:27.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.860+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa34410f540 con 0x7fa3440fffe0 2023-10-08T13:27:27.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.860+0000 7fa33b7fe700 1 -- 172.21.15.139:0/2834062173 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa34009a7e0 con 0x7fa3440fffe0 2023-10-08T13:27:27.862 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 msgr2=0x7fa3300a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 0x7fa3300a3990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa334005950 tx=0x7fa3340058e0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 msgr2=0x7fa3441992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa3400095c0 tx=0x7fa34000f690 comp rx=0 tx=0).stop 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 shutdown_connections 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa3300a14d0 0x7fa3300a3990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3441056b0 0x7fa34419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3440ff620 0x7fa344198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 --2- 172.21.15.139:0/2834062173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3440fffe0 0x7fa3441992c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:27.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 >> 172.21.15.139:0/2834062173 conn(0x7fa344076780 msgr2=0x7fa3440678f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:27.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 shutdown_connections 2023-10-08T13:27:27.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.863+0000 7fa34c34b700 1 -- 172.21.15.139:0/2834062173 wait complete. 2023-10-08T13:27:27.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:27:28.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 -- 172.21.15.139:0/3281145588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 msgr2=0x7f1d7c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 --2- 172.21.15.139:0/3281145588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c100bc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009990 tx=0x7f1d6c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 -- 172.21.15.139:0/3281145588 shutdown_connections 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 --2- 172.21.15.139:0/3281145588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c101100 0x7f1d7c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 --2- 172.21.15.139:0/3281145588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c106750 0x7f1d7c106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 --2- 172.21.15.139:0/3281145588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c100bc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 -- 172.21.15.139:0/3281145588 >> 172.21.15.139:0/3281145588 conn(0x7f1d7c0fc230 msgr2=0x7f1d7c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 -- 172.21.15.139:0/3281145588 shutdown_connections 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 -- 172.21.15.139:0/3281145588 wait complete. 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:27.999+0000 7f1d81312700 1 Processor -- start 2023-10-08T13:27:28.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 -- start start 2023-10-08T13:27:28.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101100 0x7f1d7c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 0x7f1d7c073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1a5020 con 0x7f1d7c100740 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1a5190 con 0x7f1d7c101100 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d81312700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1a5350 con 0x7f1d7c106750 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40290/0 (socket says 172.21.15.139:40290) 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 -- 172.21.15.139:0/2361945534 learned_addr learned my addr 172.21.15.139:0/2361945534 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7a7fc700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101100 0x7f1d7c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7b7fe700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 0x7f1d7c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 -- 172.21.15.139:0/2361945534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 msgr2=0x7f1d7c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 0x7f1d7c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 -- 172.21.15.139:0/2361945534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101100 msgr2=0x7f1d7c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101100 0x7f1d7c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 -- 172.21.15.139:0/2361945534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0095f0 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7b7fe700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 0x7f1d7c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.000+0000 7f1d7affd700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c920 tx=0x7f1d7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70007b00 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d7000ce70 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c1a5630 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d700054e0 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c1a5b10 con 0x7f1d7c100740 2023-10-08T13:27:28.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.001+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c108d60 con 0x7f1d7c100740 2023-10-08T13:27:28.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.003+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f1d70004750 con 0x7f1d7c100740 2023-10-08T13:27:28.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.004+0000 7f1d63fff700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 0x7f1d640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.004+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1d700cd1d0 con 0x7f1d7c100740 2023-10-08T13:27:28.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.004+0000 7f1d7a7fc700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 0x7f1d640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.004+0000 7f1d7a7fc700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 0x7f1d640a3990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00b5c0 tx=0x7f1d6c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.008 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.007+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1d70096370 con 0x7f1d7c100740 2023-10-08T13:27:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2156342831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:27 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3187815762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2156342831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:27 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3187815762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.199+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d7c073fd0 con 0x7f1d7c100740 2023-10-08T13:27:28.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.200+0000 7f1d63fff700 1 -- 172.21.15.139:0/2361945534 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d7001d020 con 0x7f1d7c100740 2023-10-08T13:27:28.201 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:27:28.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 msgr2=0x7f1d640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 0x7f1d640a3990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00b5c0 tx=0x7f1d6c005960 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 msgr2=0x7f1d7c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000c920 tx=0x7f1d7000cc30 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 shutdown_connections 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d640a14d0 0x7f1d640a3990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d7c106750 0x7f1d7c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d7c100740 0x7f1d7c072af0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 --2- 172.21.15.139:0/2361945534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101100 0x7f1d7c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 >> 172.21.15.139:0/2361945534 conn(0x7f1d7c0fc230 msgr2=0x7f1d7c0fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 shutdown_connections 2023-10-08T13:27:28.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.202+0000 7f1d81312700 1 -- 172.21.15.139:0/2361945534 wait complete. 2023-10-08T13:27:28.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:27:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s; 0 B/s, 0 objects/s recovering 2023-10-08T13:27:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T13:27:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2156342831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:27 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3187815762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 -- 172.21.15.139:0/1539995094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc100720 msgr2=0x7f46fc100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 --2- 172.21.15.139:0/1539995094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc100720 0x7f46fc100ba0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009990 tx=0x7f46f8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 -- 172.21.15.139:0/1539995094 shutdown_connections 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 --2- 172.21.15.139:0/1539995094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc1010e0 0x7f46fc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 --2- 172.21.15.139:0/1539995094 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc106730 0x7f46fc106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 --2- 172.21.15.139:0/1539995094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc100720 0x7f46fc100ba0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 -- 172.21.15.139:0/1539995094 >> 172.21.15.139:0/1539995094 conn(0x7f46fc0fc230 msgr2=0x7f46fc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 -- 172.21.15.139:0/1539995094 shutdown_connections 2023-10-08T13:27:28.343 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.339+0000 7f4703f27700 1 -- 172.21.15.139:0/1539995094 wait complete. 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 Processor -- start 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 -- start start 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc100720 0x7f46fc19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc1010e0 0x7f46fc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc196f30 con 0x7f46fc106730 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1970a0 con 0x7f46fc1010e0 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f4703f27700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc197260 con 0x7f46fc100720 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f47024c4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f47024c4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40308/0 (socket says 172.21.15.139:40308) 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f47024c4700 1 -- 172.21.15.139:0/3006332226 learned_addr learned my addr 172.21.15.139:0/3006332226 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:28.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.340+0000 7f47014c2700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc1010e0 0x7f46fc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f4701cc3700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc100720 0x7f46fc19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 -- 172.21.15.139:0/3006332226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc100720 msgr2=0x7f46fc19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc100720 0x7f46fc19c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 -- 172.21.15.139:0/3006332226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc1010e0 msgr2=0x7f46fc19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc1010e0 0x7f46fc19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 -- 172.21.15.139:0/3006332226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f80095f0 con 0x7f46fc106730 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f47024c4700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007ee0 tx=0x7f46f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4017070 con 0x7f46fc106730 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46f400f040 con 0x7f46fc106730 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc197540 con 0x7f46fc106730 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4005740 con 0x7f46fc106730 2023-10-08T13:27:28.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.341+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc1a3790 con 0x7f46fc106730 2023-10-08T13:27:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.342+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc108d40 con 0x7f46fc106730 2023-10-08T13:27:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.343+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f46f400dc60 con 0x7f46fc106730 2023-10-08T13:27:28.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.343+0000 7f46f2ffd700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 0x7f46e80a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.344+0000 7f4701cc3700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 0x7f46e80a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.344+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f46f40ccfb0 con 0x7f46fc106730 2023-10-08T13:27:28.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.344+0000 7f4701cc3700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 0x7f46e80a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f46ec005fd0 tx=0x7f46ec005ce0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.347 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.347+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f46f40961b0 con 0x7f46fc106730 2023-10-08T13:27:28.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.539+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46fc197d90 con 0x7f46fc106730 2023-10-08T13:27:28.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.540+0000 7f46f2ffd700 1 -- 172.21.15.139:0/3006332226 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46f40997d0 con 0x7f46fc106730 2023-10-08T13:27:28.541 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:27:28.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 msgr2=0x7f46e80a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 0x7f46e80a3a10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f46ec005fd0 tx=0x7f46ec005ce0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 msgr2=0x7f46fc1968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007ee0 tx=0x7f46f400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 shutdown_connections 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46e80a1550 0x7f46e80a3a10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f46fc106730 0x7f46fc1968d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46fc100720 0x7f46fc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 --2- 172.21.15.139:0/3006332226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46fc1010e0 0x7f46fc19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 >> 172.21.15.139:0/3006332226 conn(0x7f46fc0fc230 msgr2=0x7f46fc0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 shutdown_connections 2023-10-08T13:27:28.544 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.542+0000 7f4703f27700 1 -- 172.21.15.139:0/3006332226 wait complete. 2023-10-08T13:27:28.555 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 -- 172.21.15.139:0/1658370962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3114105600 msgr2=0x7f31141059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 --2- 172.21.15.139:0/1658370962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3114105600 0x7f31141059e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f31080099c0 tx=0x7f3108009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 -- 172.21.15.139:0/1658370962 shutdown_connections 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 --2- 172.21.15.139:0/1658370962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 0x7f311410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 --2- 172.21.15.139:0/1658370962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3114105600 0x7f31141059e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 --2- 172.21.15.139:0/1658370962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31140ff540 0x7f31140ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 -- 172.21.15.139:0/1658370962 >> 172.21.15.139:0/1658370962 conn(0x7f31140fb030 msgr2=0x7f31140fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 -- 172.21.15.139:0/1658370962 shutdown_connections 2023-10-08T13:27:28.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.676+0000 7f311b02a700 1 -- 172.21.15.139:0/1658370962 wait complete. 2023-10-08T13:27:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 Processor -- start 2023-10-08T13:27:28.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 -- start start 2023-10-08T13:27:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 0x7f3114195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3114105600 0x7f311419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419a910 con 0x7f31140ff540 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419aa80 con 0x7f3114105600 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f311b02a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419ac40 con 0x7f31140fff00 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f3118dc6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f3118dc6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40318/0 (socket says 172.21.15.139:40318) 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f3118dc6700 1 -- 172.21.15.139:0/1560828427 learned_addr learned my addr 172.21.15.139:0/1560828427 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.677+0000 7f3113fff700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 0x7f3114195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f31195c7700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3114105600 0x7f311419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 -- 172.21.15.139:0/1560828427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 msgr2=0x7f3114195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 0x7f3114195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 -- 172.21.15.139:0/1560828427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3114105600 msgr2=0x7f311419a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3114105600 0x7f311419a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 -- 172.21.15.139:0/1560828427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080095f0 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3118dc6700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f310800b580 tx=0x7f310800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310801c070 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f310800fdf0 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311419aec0 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108022c40 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.678+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311419b190 con 0x7f31140ff540 2023-10-08T13:27:28.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.679+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3114107a80 con 0x7f31140ff540 2023-10-08T13:27:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.680+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3108020070 con 0x7f31140ff540 2023-10-08T13:27:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.681+0000 7f3111ffb700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 0x7f31040a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.681+0000 7f3113fff700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 0x7f31040a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.681+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f31080ce470 con 0x7f31140ff540 2023-10-08T13:27:28.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.681+0000 7f3113fff700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 0x7f31040a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3114196f80 tx=0x7f3100009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:28.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.684+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3108097700 con 0x7f31140ff540 2023-10-08T13:27:28.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.922+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3114196d30 con 0x7f31140ff540 2023-10-08T13:27:28.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.923+0000 7f3111ffb700 1 -- 172.21.15.139:0/1560828427 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f310809ad20 con 0x7f31140ff540 2023-10-08T13:27:28.924 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:28.924 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:27:28.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 msgr2=0x7f31040a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 0x7f31040a3990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3114196f80 tx=0x7f3100009260 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 msgr2=0x7f3114195a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f310800b580 tx=0x7f310800bfd0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 shutdown_connections 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f31040a14d0 0x7f31040a3990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3114105600 0x7f311419a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31140ff540 0x7f3114195a30 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 --2- 172.21.15.139:0/1560828427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31140fff00 0x7f3114195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 >> 172.21.15.139:0/1560828427 conn(0x7f31140fb030 msgr2=0x7f31140fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 shutdown_connections 2023-10-08T13:27:28.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:28.925+0000 7f311b02a700 1 -- 172.21.15.139:0/1560828427 wait complete. 2023-10-08T13:27:28.928 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:27:28.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:28 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2834062173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:28 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2361945534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:28 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3006332226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:28.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 -- 172.21.15.139:0/835675884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780fff10 msgr2=0x7fc17810c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 --2- 172.21.15.139:0/835675884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780fff10 0x7fc17810c3d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc17000b0d0 tx=0x7fc17000b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 -- 172.21.15.139:0/835675884 shutdown_connections 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 --2- 172.21.15.139:0/835675884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780fff10 0x7fc17810c3d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 --2- 172.21.15.139:0/835675884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc178105610 0x7fc1781059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 --2- 172.21.15.139:0/835675884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1780ff550 0x7fc1780ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 -- 172.21.15.139:0/835675884 >> 172.21.15.139:0/835675884 conn(0x7fc1780fb060 msgr2=0x7fc1780fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 -- 172.21.15.139:0/835675884 shutdown_connections 2023-10-08T13:27:29.061 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.058+0000 7fc17d187700 1 -- 172.21.15.139:0/835675884 wait complete. 2023-10-08T13:27:29.061 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.059+0000 7fc17d187700 1 Processor -- start 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.059+0000 7fc17d187700 1 -- start start 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1780fff10 0x7fc17819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178105610 0x7fc178195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178195f60 con 0x7fc1780ff550 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1781960d0 con 0x7fc1780fff10 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc178196290 con 0x7fc178105610 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40332/0 (socket says 172.21.15.139:40332) 2023-10-08T13:27:29.063 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 -- 172.21.15.139:0/2820984454 learned_addr learned my addr 172.21.15.139:0/2820984454 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17759e700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178105610 0x7fc178195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17659c700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1780fff10 0x7fc17819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 -- 172.21.15.139:0/2820984454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178105610 msgr2=0x7fc178195900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178105610 0x7fc178195900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 -- 172.21.15.139:0/2820984454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1780fff10 msgr2=0x7fc17819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1780fff10 0x7fc17819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 -- 172.21.15.139:0/2820984454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170009d00 con 0x7fc1780ff550 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc176d9d700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d950 tx=0x7fc16800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168009940 con 0x7fc1780ff550 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc178196570 con 0x7fc1780ff550 2023-10-08T13:27:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc168010460 con 0x7fc1780ff550 2023-10-08T13:27:29.065 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16800f620 con 0x7fc1780ff550 2023-10-08T13:27:29.065 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.060+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1781a27c0 con 0x7fc1780ff550 2023-10-08T13:27:29.065 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.061+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1640052f0 con 0x7fc1780ff550 2023-10-08T13:27:29.065 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.062+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fc168009aa0 con 0x7fc1780ff550 2023-10-08T13:27:29.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.063+0000 7fc15ffff700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 0x7fc1600a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.063+0000 7fc17659c700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 0x7fc1600a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.063+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc1680ccf70 con 0x7fc1780ff550 2023-10-08T13:27:29.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.063+0000 7fc17659c700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 0x7fc1600a3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc178196ac0 tx=0x7fc16c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.068 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.066+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc168096170 con 0x7fc1780ff550 2023-10-08T13:27:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:28 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2834062173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:28 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2361945534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:28 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3006332226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:28 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2834062173' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:28 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2361945534' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:28 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3006332226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:27:29.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.261+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc164005870 con 0x7fc1780ff550 2023-10-08T13:27:29.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.262+0000 7fc15ffff700 1 -- 172.21.15.139:0/2820984454 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+25017 (secure 0 0 0) 0x7fc168016090 con 0x7fc1780ff550 2023-10-08T13:27:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:27:29.264 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":91,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:27:10.730150+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 msgr2=0x7fc1600a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 0x7fc1600a3990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc178196ac0 tx=0x7fc16c009260 comp rx=0 tx=0).stop 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 msgr2=0x7fc17819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d950 tx=0x7fc16800dc60 comp rx=0 tx=0).stop 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 shutdown_connections 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc1600a14d0 0x7fc1600a3990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178105610 0x7fc178195900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780ff550 0x7fc17819b7d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 --2- 172.21.15.139:0/2820984454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1780fff10 0x7fc17819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 >> 172.21.15.139:0/2820984454 conn(0x7fc1780fb060 msgr2=0x7fc1780fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 shutdown_connections 2023-10-08T13:27:29.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.265+0000 7fc17d187700 1 -- 172.21.15.139:0/2820984454 wait complete. 2023-10-08T13:27:29.279 DEBUG:tasks.fwd_scrub:Yielding 2023-10-08T13:27:29.279 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T13:27:29.290 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:27:29.290 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:27:29.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-08T13:27:29.290 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-08T13:27:29.290 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:27:29.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:27:29.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 -- 172.21.15.139:0/4160048496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ff630 msgr2=0x7f90400ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 --2- 172.21.15.139:0/4160048496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ff630 0x7f90400ffab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9034009990 tx=0x7f9034009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 -- 172.21.15.139:0/1360067736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c106780 msgr2=0x7f9e4c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 --2- 172.21.15.139:0/1360067736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c106780 0x7f9e4c106b60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009990 tx=0x7f9e48009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 -- 172.21.15.139:0/4160048496 shutdown_connections 2023-10-08T13:27:29.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 --2- 172.21.15.139:0/4160048496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ffff0 0x7f904010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 --2- 172.21.15.139:0/4160048496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 0x7f9040105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 --2- 172.21.15.139:0/4160048496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ff630 0x7f90400ffab0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 -- 172.21.15.139:0/4160048496 >> 172.21.15.139:0/4160048496 conn(0x7f90400767f0 msgr2=0x7f9040076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 -- 172.21.15.139:0/4160048496 shutdown_connections 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 -- 172.21.15.139:0/1360067736 shutdown_connections 2023-10-08T13:27:29.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 --2- 172.21.15.139:0/1360067736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 --2- 172.21.15.139:0/1360067736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c106780 0x7f9e4c106b60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 --2- 172.21.15.139:0/1360067736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 0x7f9e4c0ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 -- 172.21.15.139:0/1360067736 >> 172.21.15.139:0/1360067736 conn(0x7f9e4c075c40 msgr2=0x7f9e4c0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 -- 172.21.15.139:0/1360067736 shutdown_connections 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f9e543b1700 1 -- 172.21.15.139:0/1360067736 wait complete. 2023-10-08T13:27:29.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.417+0000 7f904561d700 1 -- 172.21.15.139:0/4160048496 wait complete. 2023-10-08T13:27:29.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 Processor -- start 2023-10-08T13:27:29.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 Processor -- start 2023-10-08T13:27:29.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 -- start start 2023-10-08T13:27:29.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 -- start start 2023-10-08T13:27:29.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 0x7f9e4c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.423 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 0x7f9e4c196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c197080 con 0x7f9e4c0ff640 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1971f0 con 0x7f9e4c0fec80 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e543b1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1973b0 con 0x7f9e4c106780 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e5194c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.424 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e5194c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40350/0 (socket says 172.21.15.139:40350) 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e5194c700 1 -- 172.21.15.139:0/2339302873 learned_addr learned my addr 172.21.15.139:0/2339302873 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 0x7f904019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 0x7f9040194850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040194eb0 con 0x7f90400ffff0 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040195020 con 0x7f9040105640 2023-10-08T13:27:29.425 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f904561d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90401951e0 con 0x7f90400ff630 2023-10-08T13:27:29.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.418+0000 7f9e5294e700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 0x7f9e4c196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5214d700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 0x7f9e4c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.426 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40070/0 (socket says 172.21.15.139:40070) 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903effd700 1 -- 172.21.15.139:0/1836924990 learned_addr learned my addr 172.21.15.139:0/1836924990 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 0x7f904019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903f7fe700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 0x7f9040194850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 -- 172.21.15.139:0/2339302873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 msgr2=0x7f9e4c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 0x7f9e4c19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 -- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 msgr2=0x7f9e4c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.427 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 -- 172.21.15.139:0/2339302873 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480095f0 con 0x7f9e4c106780 2023-10-08T13:27:29.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 -- 172.21.15.139:0/1836924990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 msgr2=0x7f904019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 -- 172.21.15.139:0/1836924990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 msgr2=0x7f9040194850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.428 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 0x7f9040194850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 -- 172.21.15.139:0/1836924990 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340095f0 con 0x7f90400ffff0 2023-10-08T13:27:29.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903effd700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:29.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e5294e700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 0x7f9e4c196a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400efc0 tx=0x7f9e4400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.429 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f903e7fc700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 0x7f904019ac00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9034000c00 tx=0x7f9034009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44018070 con 0x7f9e4c106780 2023-10-08T13:27:29.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c197630 con 0x7f9e4c106780 2023-10-08T13:27:29.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e4400f040 con 0x7f9e4c106780 2023-10-08T13:27:29.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9027fff700 1 -- 172.21.15.139:0/1836924990 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903401d070 con 0x7f90400ffff0 2023-10-08T13:27:29.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400cd40 con 0x7f9e4c106780 2023-10-08T13:27:29.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c1a38e0 con 0x7f9e4c106780 2023-10-08T13:27:29.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9040195460 con 0x7f90400ffff0 2023-10-08T13:27:29.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.419+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90401a1760 con 0x7f90400ffff0 2023-10-08T13:27:29.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.420+0000 7f9027fff700 1 -- 172.21.15.139:0/1836924990 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9034021410 con 0x7f90400ffff0 2023-10-08T13:27:29.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.420+0000 7f9027fff700 1 -- 172.21.15.139:0/1836924990 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034017650 con 0x7f90400ffff0 2023-10-08T13:27:29.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.420+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c108d30 con 0x7f9e4c106780 2023-10-08T13:27:29.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.422+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9e44003a00 con 0x7f9e4c106780 2023-10-08T13:27:29.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.422+0000 7f9027fff700 1 -- 172.21.15.139:0/1836924990 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f90340177b0 con 0x7f90400ffff0 2023-10-08T13:27:29.432 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9e437fe700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 0x7f9e380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 Processor -- start 2023-10-08T13:27:29.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 -- start start 2023-10-08T13:27:29.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9e440ccea0 con 0x7f9e4c106780 2023-10-08T13:27:29.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9e5214d700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 0x7f9e380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9027fff700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 0x7f90280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 0x5654856ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856f56d0 0x5654856f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654856534e0 con 0x5654856ea820 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x565485644ca0 con 0x5654856f56d0 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9051806b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654856425c0 con 0x5654856e9f00 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f903f7fe700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 0x7f90280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.423+0000 7f9027fff700 1 -- 172.21.15.139:0/1836924990 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f90340ce270 con 0x7f90400ffff0 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 0x5654856ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40364/0 (socket says 172.21.15.139:40364) 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 0x5654856ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40078/0 (socket says 172.21.15.139:40078) 2023-10-08T13:27:29.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 -- 172.21.15.139:0/67217334 learned_addr learned my addr 172.21.15.139:0/67217334 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f9e5214d700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 0x7f9e380a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800b2e0 tx=0x7f9e48005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903f7fe700 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856f56d0 0x5654856f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 -- 172.21.15.139:0/67217334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 msgr2=0x5654856ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 0x5654856ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 -- 172.21.15.139:0/67217334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856f56d0 msgr2=0x5654856f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856f56d0 0x5654856f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 -- 172.21.15.139:0/67217334 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565485468e60 con 0x5654856ea820 2023-10-08T13:27:29.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903f7fe700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 0x7f90280a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9038007750 tx=0x7f9038007b10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f903e7fc700 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f903400c010 tx=0x7f903402df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8befb21f1b71b50b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f90257fa700 1 -- 172.21.15.139:0/67217334 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903409f120 con 0x5654856ea820 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f90257fa700 1 -- 172.21.15.139:0/67217334 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f903409ad00 con 0x5654856ea820 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.424+0000 7f90257fa700 1 -- 172.21.15.139:0/67217334 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903409b1c0 con 0x5654856ea820 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- 172.21.15.139:0/67217334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 msgr2=0x5654856f5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f903400c010 tx=0x7f903402df10 comp rx=0 tx=0).stop 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- 172.21.15.139:0/67217334 shutdown_connections 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856f56d0 0x5654856f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856e9f00 0x5654856ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 --2- 172.21.15.139:0/67217334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856ea820 0x5654856f5190 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- 172.21.15.139:0/67217334 >> 172.21.15.139:0/67217334 conn(0x56548565f2e0 msgr2=0x5654856e6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.439 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- 172.21.15.139:0/67217334 shutdown_connections 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- 172.21.15.139:0/67217334 wait complete. 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 -- start start 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.425+0000 7f9051806b80 1 Processor -- start 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x565485700b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548563deb0 con 0x5654856e9f00 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654855da790 con 0x5654856ea820 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654855da430 con 0x5654856f56d0 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 10 client.0 _ll_register_callbacks cb 0x565485437880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40370/0 (socket says 172.21.15.139:40370) 2023-10-08T13:27:29.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 -- 172.21.15.139:0/3775508061 learned_addr learned my addr 172.21.15.139:0/3775508061 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903f7fe700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x565485700b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.441 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9e44096130 con 0x7f9e4c106780 2023-10-08T13:27:29.443 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 -- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 msgr2=0x565485700b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x565485700b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 -- 172.21.15.139:0/3775508061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 msgr2=0x5654856f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 -- 172.21.15.139:0/3775508061 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90401a1760 con 0x5654856e9f00 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f903effd700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9030015ed0 tx=0x7f9030015f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e2e71f47dc419b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9022ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030017a70 con 0x5654856e9f00 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9030017bd0 con 0x5654856e9f00 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.426+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565485605f30 con 0x5654856e9f00 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9030017dd0 con 0x5654856e9f00 2023-10-08T13:27:29.444 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 10 client.15861 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565485451ce0 con 0x5654856e9f00 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565485605f30 con 0x5654856e9f00 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9030003bb0 con 0x5654856e9f00 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 10 client.15861 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 20 client.15861 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x565485704f20 0x565485707340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 4 client.15861 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565485636e90 con 0x565485704f20 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.427+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x565485704f20 0x565485707340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.445 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x565485704f20 0x565485707340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f1e6298cb52133 server_cookie=1c1c5ca5239bd6d4 in_seq=0 out_seq=0 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9022ff5700 10 client.15861 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9022ff5700 1 -- 172.21.15.139:0/3775508061 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565485636e90 con 0x565485704f20 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9022ff5700 10 client.15861 handle_command_reply: tid=0 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9051806b80 1 client.15861 shutdown 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 msgr2=0x5654856f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.428+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9030015ed0 tx=0x7f9030015f00 comp rx=0 tx=0).stop 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 shutdown_connections 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x565485700b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856f5ab0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x565485704f20 0x565485707340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 --2- 172.21.15.139:0/3775508061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.446 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9022ff5700 0 client.15861 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 >> 172.21.15.139:0/3775508061 conn(0x56548565f2e0 msgr2=0x5654856e5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 shutdown_connections 2023-10-08T13:27:29.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 1 -- 172.21.15.139:0/3775508061 wait complete. 2023-10-08T13:27:29.447 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.429+0000 7f9051806b80 20 client.15861 trim_cache size 0 max 16384 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.445+0000 7f9051806b80 1 Processor -- start 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.445+0000 7f9051806b80 1 -- start start 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x5654856e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654854be9a0 con 0x5654856e9f00 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654856e2b60 con 0x5654856ea820 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f9051806b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654856eb150 con 0x5654856f56d0 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40378/0 (socket says 172.21.15.139:40378) 2023-10-08T13:27:29.452 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 -- 172.21.15.139:0/1224477180 learned_addr learned my addr 172.21.15.139:0/1224477180 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903f7fe700 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x5654856e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903e7fc700 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 -- 172.21.15.139:0/1224477180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 msgr2=0x5654856e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x5654856e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 -- 172.21.15.139:0/1224477180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 msgr2=0x5654856eede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856eede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 -- 172.21.15.139:0/1224477180 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56548570bf30 con 0x5654856e9f00 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.446+0000 7f903effd700 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9030005fe0 tx=0x7f9030005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e13e2d07ed0f455 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9025ffb700 1 -- 172.21.15.139:0/1224477180 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030017590 con 0x5654856e9f00 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9025ffb700 1 -- 172.21.15.139:0/1224477180 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9030013040 con 0x5654856e9f00 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9025ffb700 1 -- 172.21.15.139:0/1224477180 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030005350 con 0x5654856e9f00 2023-10-08T13:27:29.453 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 -- 172.21.15.139:0/1224477180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 msgr2=0x5654856fa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9030005fe0 tx=0x7f9030005db0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 -- 172.21.15.139:0/1224477180 shutdown_connections 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x5654856e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654856fa920 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 --2- 172.21.15.139:0/1224477180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654856eede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 -- 172.21.15.139:0/1224477180 >> 172.21.15.139:0/1224477180 conn(0x56548565f2e0 msgr2=0x5654856e5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 -- 172.21.15.139:0/1224477180 shutdown_connections 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.447+0000 7f9051806b80 1 -- 172.21.15.139:0/1224477180 wait complete. 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 -- start start 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 Processor -- start 2023-10-08T13:27:29.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654857536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x56548574d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548574dc40 con 0x5654856e9f00 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548574ddb0 con 0x5654856ea820 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56548574df70 con 0x5654856f56d0 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f9051806b80 10 client.0 _ll_register_callbacks cb 0x7f90300157c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40384/0 (socket says 172.21.15.139:40384) 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 -- 172.21.15.139:0/3442749263 learned_addr learned my addr 172.21.15.139:0/3442749263 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903f7fe700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x56548574d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654857536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 -- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 msgr2=0x56548574d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x56548574d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 -- 172.21.15.139:0/3442749263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 msgr2=0x5654857536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654857536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903effd700 1 -- 172.21.15.139:0/3442749263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565485451ce0 con 0x5654856e9f00 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.448+0000 7f903f7fe700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x56548574d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f903effd700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030017620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af6bf8b4f6594b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030017a70 con 0x5654856e9f00 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9030017bd0 con 0x5654856e9f00 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f903409ad00 con 0x5654856e9f00 2023-10-08T13:27:29.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9030017d90 con 0x5654856e9f00 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 10 client.15867 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56548548f2d0 con 0x5654856e9f00 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f903409ad00 con 0x5654856e9f00 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9030003aa0 con 0x5654856e9f00 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 10 client.15867 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 20 client.15867 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56548575ad50 0x56548575d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 4 client.15867 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.449+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x565485636bb0 con 0x56548575ad50 2023-10-08T13:27:29.457 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.450+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56548575ad50 0x56548575d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.450+0000 7f903e7fc700 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56548575ad50 0x56548575d140 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c634624e1988aa6 server_cookie=af61b2a7b0ac1c01 in_seq=0 out_seq=0 2023-10-08T13:27:29.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.450+0000 7f9022ff5700 10 client.15867 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.451+0000 7f9022ff5700 1 -- 172.21.15.139:0/3442749263 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x565485636bb0 con 0x56548575ad50 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.451+0000 7f9022ff5700 10 client.15867 handle_command_reply: tid=0 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.451+0000 7f9051806b80 1 client.15867 shutdown 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 msgr2=0x5654857531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9030000c00 tx=0x7f9030017620 comp rx=0 tx=0).stop 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 shutdown_connections 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654856f56d0 0x56548574d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5654856e9f00 0x5654857531b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56548575ad50 0x56548575d140 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 --2- 172.21.15.139:0/3442749263 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5654856ea820 0x5654857536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 >> 172.21.15.139:0/3442749263 conn(0x56548565f2e0 msgr2=0x5654856e5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9022ff5700 0 client.15867 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 shutdown_connections 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 1 -- 172.21.15.139:0/3442749263 wait complete. 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f9051806b80 20 client.15867 trim_cache size 0 max 16384 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:29.460 INFO:teuthology.orchestra.run.smithi139.stdout: "return_code": 0, 2023-10-08T13:27:29.461 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_tag": "e4794b9a-3510-4724-9451-1adeeb090b45", 2023-10-08T13:27:29.461 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": "asynchronous" 2023-10-08T13:27:29.461 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:29.461 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 msgr2=0x7f90280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 0x7f90280a3990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9038007750 tx=0x7f9038007b10 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 msgr2=0x7f904019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 0x7f904019ac00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9034000c00 tx=0x7f9034009580 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 shutdown_connections 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f90280a14d0 0x7f90280a3990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9040105640 0x7f9040194850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90400ff630 0x7f904019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 --2- 172.21.15.139:0/1836924990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90400ffff0 0x7f904019ac00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.452+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 >> 172.21.15.139:0/1836924990 conn(0x7f90400767f0 msgr2=0x7f9040102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.453+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 shutdown_connections 2023-10-08T13:27:29.462 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.453+0000 7f904561d700 1 -- 172.21.15.139:0/1836924990 wait complete. 2023-10-08T13:27:29.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 -- 172.21.15.139:0/3261740906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 msgr2=0x7fa150105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 --2- 172.21.15.139:0/3261740906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150105a90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009990 tx=0x7fa14c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 -- 172.21.15.139:0/3261740906 shutdown_connections 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 --2- 172.21.15.139:0/3261740906 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 0x7fa15010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 --2- 172.21.15.139:0/3261740906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150105a90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 --2- 172.21.15.139:0/3261740906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 0x7fa1500ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 -- 172.21.15.139:0/3261740906 >> 172.21.15.139:0/3261740906 conn(0x7fa150076780 msgr2=0x7fa150076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 -- 172.21.15.139:0/3261740906 shutdown_connections 2023-10-08T13:27:29.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.598+0000 7fa158451700 1 -- 172.21.15.139:0/3261740906 wait complete. 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 Processor -- start 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 -- start start 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 0x7fa15019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 0x7fa15019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150195e70 con 0x7fa1501056b0 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150195fe0 con 0x7fa1500ff620 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa158451700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501961a0 con 0x7fa1500fffe0 2023-10-08T13:27:29.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40402/0 (socket says 172.21.15.139:40402) 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 -- 172.21.15.139:0/3548453391 learned_addr learned my addr 172.21.15.139:0/3548453391 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1559ec700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 0x7fa15019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1561ed700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 0x7fa15019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 -- 172.21.15.139:0/3548453391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 msgr2=0x7fa15019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 0x7fa15019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 -- 172.21.15.139:0/3548453391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 msgr2=0x7fa15019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 0x7fa15019b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.599+0000 7fa1569ee700 1 -- 172.21.15.139:0/3548453391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0095f0 con 0x7fa1501056b0 2023-10-08T13:27:29.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa148007ee0 tx=0x7fa14800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa1477fe700 1 -- 172.21.15.139:0/3548453391 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148017070 con 0x7fa1501056b0 2023-10-08T13:27:29.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150196480 con 0x7fa1501056b0 2023-10-08T13:27:29.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa1477fe700 1 -- 172.21.15.139:0/3548453391 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14800f040 con 0x7fa1501056b0 2023-10-08T13:27:29.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa1477fe700 1 -- 172.21.15.139:0/3548453391 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148005580 con 0x7fa1501056b0 2023-10-08T13:27:29.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.600+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501a2670 con 0x7fa1501056b0 2023-10-08T13:27:29.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.603+0000 7fa1477fe700 1 -- 172.21.15.139:0/3548453391 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7fa14800db20 con 0x7fa1501056b0 2023-10-08T13:27:29.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.603+0000 7fa16463ab80 1 Processor -- start 2023-10-08T13:27:29.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 -- start start 2023-10-08T13:27:29.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1477fe700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 0x7fa13c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 0x5621428ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56214280a460 con 0x5621428a17a0 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621427fbc20 con 0x5621428ac650 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa16463ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621427f9540 con 0x5621428a0e80 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1477fe700 1 -- 172.21.15.139:0/3548453391 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa1480cc920 con 0x7fa1501056b0 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1559ec700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 0x7fa13c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1559ec700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 0x5621428ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40122/0 (socket says 172.21.15.139:40122) 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1561ed700 1 -- 172.21.15.139:0/1970008478 learned_addr learned my addr 172.21.15.139:0/1970008478 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.604+0000 7fa1569ee700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 -- 172.21.15.139:0/1970008478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 msgr2=0x5621428aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 -- 172.21.15.139:0/1970008478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 msgr2=0x5621428ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 0x5621428ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 -- 172.21.15.139:0/1970008478 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56214261fde0 con 0x5621428a0e80 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1559ec700 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 0x5621428ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1559ec700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 0x7fa13c0a3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa140005ea0 tx=0x7fa14000ab80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa1561ed700 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa150077ab0 tx=0x7fa14c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766d9bb3d25ddfc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa144d82700 1 -- 172.21.15.139:0/1970008478 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00b9d0 con 0x5621428a0e80 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa144d82700 1 -- 172.21.15.139:0/1970008478 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14c00be80 con 0x5621428a0e80 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.605+0000 7fa144d82700 1 -- 172.21.15.139:0/1970008478 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c003df0 con 0x5621428a0e80 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- 172.21.15.139:0/1970008478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 msgr2=0x5621428a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa150077ab0 tx=0x7fa14c009f90 comp rx=0 tx=0).stop 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- 172.21.15.139:0/1970008478 shutdown_connections 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428a1260 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 --2- 172.21.15.139:0/1970008478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a17a0 0x5621428ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- 172.21.15.139:0/1970008478 >> 172.21.15.139:0/1970008478 conn(0x562142816260 msgr2=0x56214289d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- 172.21.15.139:0/1970008478 shutdown_connections 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- 172.21.15.139:0/1970008478 wait complete. 2023-10-08T13:27:29.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 -- start start 2023-10-08T13:27:29.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.606+0000 7fa16463ab80 1 Processor -- start 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428ac650 0x5621428a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621427f4e30 con 0x5621428a0e80 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562142791710 con 0x5621428a17a0 2023-10-08T13:27:29.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621427913b0 con 0x5621428ac650 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa16463ab80 10 client.0 _ll_register_callbacks cb 0x5621425ee800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40412/0 (socket says 172.21.15.139:40412) 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 -- 172.21.15.139:0/2603834872 learned_addr learned my addr 172.21.15.139:0/2603834872 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1569ee700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428ac650 0x5621428a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1559ec700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 -- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428ac650 msgr2=0x5621428a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428ac650 0x5621428a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 -- 172.21.15.139:0/2603834872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 msgr2=0x5621428a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 -- 172.21.15.139:0/2603834872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa140019040 con 0x5621428a0e80 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa14c006010 tx=0x7fa14c00ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8257125c3bffb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.607+0000 7fa139ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c003790 con 0x5621428a0e80 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa14c005110 con 0x5621428a0e80 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621427bceb0 con 0x5621428a0e80 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14c003e80 con 0x5621428a0e80 2023-10-08T13:27:29.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 10 client.15879 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa15010cde0 con 0x5621428a0e80 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5621427bceb0 con 0x5621428a0e80 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa14c021b90 con 0x5621428a0e80 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 20 client.15879 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621428c0070 0x5621428c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 4 client.15879 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621427ede10 con 0x5621428c0070 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.608+0000 7fa1559ec700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621428c0070 0x5621428c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.609+0000 7fa139ffb700 10 client.15879 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.609+0000 7fa1559ec700 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621428c0070 0x5621428c2460 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1086ad7bb2682d server_cookie=ea0fc7c23bcbc64d in_seq=0 out_seq=0 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.609+0000 7fa139ffb700 1 -- 172.21.15.139:0/2603834872 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621427ede10 con 0x5621428c0070 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.609+0000 7fa139ffb700 10 client.15879 handle_command_reply: tid=0 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.609+0000 7fa16463ab80 1 client.15879 shutdown 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 msgr2=0x5621428ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa14c006010 tx=0x7fa14c00ba80 comp rx=0 tx=0).stop 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 shutdown_connections 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428ac650 0x5621428a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428ac010 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621428c0070 0x5621428c2460 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2603834872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa139ffb700 0 client.15879 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 >> 172.21.15.139:0/2603834872 conn(0x562142816260 msgr2=0x56214289cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 shutdown_connections 2023-10-08T13:27:29.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 1 -- 172.21.15.139:0/2603834872 wait complete. 2023-10-08T13:27:29.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.610+0000 7fa16463ab80 20 client.15879 trim_cache size 0 max 16384 2023-10-08T13:27:29.632 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 Processor -- start 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 -- start start 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 0x5621428b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562142675920 con 0x5621428a0e80 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621428a2970 con 0x5621428ac650 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.626+0000 7fa16463ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621428b7b50 con 0x5621428a17a0 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40420/0 (socket says 172.21.15.139:40420) 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 -- 172.21.15.139:0/2337674597 learned_addr learned my addr 172.21.15.139:0/2337674597 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.633 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1559ec700 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 0x5621428b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 -- 172.21.15.139:0/2337674597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 msgr2=0x5621428b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 0x5621428b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 -- 172.21.15.139:0/2337674597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 msgr2=0x5621428abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 -- 172.21.15.139:0/2337674597 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562142608c60 con 0x5621428a0e80 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1559ec700 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 0x5621428b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa1561ed700 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa14c021ef0 tx=0x7fa14c00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a60119908c826ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa145583700 1 -- 172.21.15.139:0/2337674597 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c00baf0 con 0x5621428a0e80 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa145583700 1 -- 172.21.15.139:0/2337674597 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14c00fe20 con 0x5621428a0e80 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.627+0000 7fa145583700 1 -- 172.21.15.139:0/2337674597 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c021460 con 0x5621428a0e80 2023-10-08T13:27:29.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- 172.21.15.139:0/2337674597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 msgr2=0x5621428a9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa14c021ef0 tx=0x7fa14c00b540 comp rx=0 tx=0).stop 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- 172.21.15.139:0/2337674597 shutdown_connections 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428ac650 0x5621428abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428a0e80 0x5621428a9360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- 172.21.15.139:0/2337674597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a17a0 0x5621428b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- 172.21.15.139:0/2337674597 >> 172.21.15.139:0/2337674597 conn(0x562142816260 msgr2=0x5621428a8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- 172.21.15.139:0/2337674597 shutdown_connections 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- 172.21.15.139:0/2337674597 wait complete. 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- start start 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 Processor -- start 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.635 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621428b5ee0 con 0x5621428ac650 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621428b6050 con 0x5621428a17a0 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621428b6210 con 0x5621428a0e80 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.628+0000 7fa16463ab80 10 client.0 _ll_register_callbacks cb 0x7fa140011520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40430/0 (socket says 172.21.15.139:40430) 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 -- 172.21.15.139:0/3215376241 learned_addr learned my addr 172.21.15.139:0/3215376241 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1559ec700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1561ed700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.636 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 -- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 msgr2=0x5621428b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 -- 172.21.15.139:0/3215376241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 msgr2=0x5621428b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 -- 172.21.15.139:0/3215376241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15010cde0 con 0x5621428ac650 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa1569ee700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa148095ce0 tx=0x7fa148005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c37e70de3821bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa139ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480a1b70 con 0x5621428ac650 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa148004c40 con 0x5621428ac650 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa14c00be80 con 0x5621428ac650 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1480840b0 con 0x5621428ac650 2023-10-08T13:27:29.637 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa16463ab80 10 client.15885 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.629+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562142646250 con 0x5621428ac650 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa14c00be80 con 0x5621428ac650 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa148099a40 con 0x5621428ac650 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 10 client.15885 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 20 client.15885 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562142915250 0x562142917670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 4 client.15885 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5621427edb30 con 0x562142915250 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.630+0000 7fa1561ed700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562142915250 0x562142917670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa139ffb700 10 client.15885 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.638 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa1561ed700 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562142915250 0x562142917670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd9e6d5281c034c0 server_cookie=121296933c6d5554 in_seq=0 out_seq=0 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa139ffb700 1 -- 172.21.15.139:0/3215376241 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5621427edb30 con 0x562142915250 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa139ffb700 10 client.15885 handle_command_reply: tid=0 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 client.15885 shutdown 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 msgr2=0x5621428b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa148095ce0 tx=0x7fa148005020 comp rx=0 tx=0).stop 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 shutdown_connections 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621428ac650 0x5621428b57d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621428a0e80 0x5621428b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562142915250 0x562142917670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 --2- 172.21.15.139:0/3215376241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621428a17a0 0x5621428b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.639 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 >> 172.21.15.139:0/3215376241 conn(0x562142816260 msgr2=0x5621428bbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa139ffb700 0 client.15885 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 shutdown_connections 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 1 -- 172.21.15.139:0/3215376241 wait complete. 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa16463ab80 20 client.15885 trim_cache size 0 max 16384 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:27:29.640 INFO:teuthology.orchestra.run.smithi139.stdout: "e4794b9a-3510-4724-9451-1adeeb090b45": { 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "e4794b9a-3510-4724-9451-1adeeb090b45", 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:27:29.641 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 msgr2=0x7fa13c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 0x7fa13c0a3990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa140005ea0 tx=0x7fa14000ab80 comp rx=0 tx=0).stop 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 msgr2=0x7fa150195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.631+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa148007ee0 tx=0x7fa14800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 shutdown_connections 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa13c0a14d0 0x7fa13c0a3990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1501056b0 0x7fa150195800 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.642 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1500ff620 0x7fa15019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 --2- 172.21.15.139:0/3548453391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1500fffe0 0x7fa15019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 >> 172.21.15.139:0/3548453391 conn(0x7fa150076780 msgr2=0x7fa1500fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 shutdown_connections 2023-10-08T13:27:29.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.632+0000 7fa158451700 1 -- 172.21.15.139:0/3548453391 wait complete. 2023-10-08T13:27:29.645 INFO:tasks.cephfs.filesystem:scrub status for tag:e4794b9a-3510-4724-9451-1adeeb090b45 - {'path': '/', 'tag': 'e4794b9a-3510-4724-9451-1adeeb090b45', 'options': 'recursive,force'} 2023-10-08T13:27:29.673 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.672+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e4c067b60 con 0x7f9e380a14d0 2023-10-08T13:27:29.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.777+0000 7f9e437fe700 1 -- 172.21.15.139:0/2339302873 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9e4c067b60 con 0x7f9e380a14d0 2023-10-08T13:27:29.778 INFO:teuthology.orchestra.run.smithi139.stdout:Schedule set for path / 2023-10-08T13:27:29.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 msgr2=0x7f9e380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 0x7f9e380a3990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800b2e0 tx=0x7f9e48005960 comp rx=0 tx=0).stop 2023-10-08T13:27:29.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 msgr2=0x7f9e4c196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 0x7f9e4c196a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400efc0 tx=0x7f9e4400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 shutdown_connections 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9e380a14d0 0x7f9e380a3990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e4c106780 0x7f9e4c196a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e4c0fec80 0x7f9e4c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 --2- 172.21.15.139:0/2339302873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e4c0ff640 0x7f9e4c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 >> 172.21.15.139:0/2339302873 conn(0x7f9e4c075c40 msgr2=0x7f9e4c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 shutdown_connections 2023-10-08T13:27:29.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.779+0000 7f9e543b1700 1 -- 172.21.15.139:0/2339302873 wait complete. 2023-10-08T13:27:29.792 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: pgmap v299: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1560828427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2820984454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: scrub queued for path: / 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:29.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:27:29.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:29 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:29.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 -- 172.21.15.139:0/856337111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c067fd0 msgr2=0x7f420c0683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 --2- 172.21.15.139:0/856337111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c067fd0 0x7f420c0683b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f42080099c0 tx=0x7f4208009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 -- 172.21.15.139:0/856337111 shutdown_connections 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 --2- 172.21.15.139:0/856337111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105ae0 0x7f420c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 --2- 172.21.15.139:0/856337111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c067fd0 0x7f420c0683b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 --2- 172.21.15.139:0/856337111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c105120 0x7f420c1055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 -- 172.21.15.139:0/856337111 >> 172.21.15.139:0/856337111 conn(0x7f420c076790 msgr2=0x7f420c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 -- 172.21.15.139:0/856337111 shutdown_connections 2023-10-08T13:27:29.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.955+0000 7f42140dc700 1 -- 172.21.15.139:0/856337111 wait complete. 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 Processor -- start 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 -- start start 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c067fd0 0x7f420c19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 0x7f420c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c197000 con 0x7f420c105ae0 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c197170 con 0x7f420c105120 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f42140dc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c197330 con 0x7f420c067fd0 2023-10-08T13:27:29.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f4212679700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f4211e78700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c067fd0 0x7f420c19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f4212679700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40464/0 (socket says 172.21.15.139:40464) 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f4212679700 1 -- 172.21.15.139:0/758191419 learned_addr learned my addr 172.21.15.139:0/758191419 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.956+0000 7f4211677700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 0x7f420c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 -- 172.21.15.139:0/758191419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c067fd0 msgr2=0x7f420c19c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c067fd0 0x7f420c19c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 -- 172.21.15.139:0/758191419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 msgr2=0x7f420c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 0x7f420c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 -- 172.21.15.139:0/758191419 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080095f0 con 0x7f420c105ae0 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4211677700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 0x7f420c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4212679700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4204007ee0 tx=0x7f420400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204017070 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f420400f040 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c197610 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4204005740 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.957+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c1a3860 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.958+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c108bb0 con 0x7f420c105ae0 2023-10-08T13:27:29.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.959+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f420400dc60 con 0x7f420c105ae0 2023-10-08T13:27:29.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.959+0000 7f4202ffd700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 0x7f41f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:29.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.960+0000 7f4211e78700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 0x7f41f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:29.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.960+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f42040cc9a0 con 0x7f420c105ae0 2023-10-08T13:27:29.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.960+0000 7f4211e78700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 0x7f41f80a3990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4208009990 tx=0x7f4208003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:29.965 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:29.964+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4204095ba0 con 0x7f420c105ae0 2023-10-08T13:27:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: pgmap v299: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1560828427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2820984454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: scrub queued for path: / 2023-10-08T13:27:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:27:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:29 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:30.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.180+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f420c197e60 con 0x7f41f80a14d0 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: pgmap v299: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1560828427' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2820984454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: scrub queued for path: / 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:27:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:29 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:27:30.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.235+0000 7f4202ffd700 1 -- 172.21.15.139:0/758191419 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f420c197e60 con 0x7f41f80a14d0 2023-10-08T13:27:30.237 INFO:teuthology.orchestra.run.smithi139.stdout:Retention added to path / 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 msgr2=0x7f41f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 0x7f41f80a3990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4208009990 tx=0x7f4208003680 comp rx=0 tx=0).stop 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 msgr2=0x7f420c1969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4204007ee0 tx=0x7f420400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 shutdown_connections 2023-10-08T13:27:30.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f41f80a14d0 0x7f41f80a3990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f420c105ae0 0x7f420c1969a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f420c067fd0 0x7f420c19c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 --2- 172.21.15.139:0/758191419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f420c105120 0x7f420c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 >> 172.21.15.139:0/758191419 conn(0x7f420c076790 msgr2=0x7f420c0fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 shutdown_connections 2023-10-08T13:27:30.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.237+0000 7f42140dc700 1 -- 172.21.15.139:0/758191419 wait complete. 2023-10-08T13:27:30.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 -- 172.21.15.139:0/4292527945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b50105670 msgr2=0x7f3b50105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4292527945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b50105670 0x7f3b50105a50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009990 tx=0x7f3b40009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 -- 172.21.15.139:0/4292527945 shutdown_connections 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4292527945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b500fff90 0x7f3b5010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4292527945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b50105670 0x7f3b50105a50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4292527945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b500ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 -- 172.21.15.139:0/4292527945 >> 172.21.15.139:0/4292527945 conn(0x7f3b500fb0c0 msgr2=0x7f3b500fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 -- 172.21.15.139:0/4292527945 shutdown_connections 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.370+0000 7f3b566d6700 1 -- 172.21.15.139:0/4292527945 wait complete. 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 Processor -- start 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 -- start start 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b5019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 0x7f3b501957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50195e40 con 0x7f3b500fff90 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50195fb0 con 0x7f3b500ff5d0 2023-10-08T13:27:30.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b566d6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50196170 con 0x7f3b50105670 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b4f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b4f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40478/0 (socket says 172.21.15.139:40478) 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b4f7fe700 1 -- 172.21.15.139:0/4011641813 learned_addr learned my addr 172.21.15.139:0/4011641813 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.371+0000 7f3b4ffff700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b5019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b54c73700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 0x7f3b501957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 -- 172.21.15.139:0/4011641813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 msgr2=0x7f3b501957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 0x7f3b501957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 -- 172.21.15.139:0/4011641813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 msgr2=0x7f3b5019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b5019b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 -- 172.21.15.139:0/4011641813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400095f0 con 0x7f3b500fff90 2023-10-08T13:27:30.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4ffff700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b5019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b54c73700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 0x7f3b501957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4f7fe700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d980 tx=0x7f3b4400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400bb60 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b44007640 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50196450 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44004e90 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.372+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501a2690 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.373+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50107bd0 con 0x7f3b500fff90 2023-10-08T13:27:30.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.374+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f3b4400bcc0 con 0x7f3b500fff90 2023-10-08T13:27:30.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.375+0000 7f3b4d7fa700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 0x7f3b380a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.375+0000 7f3b4ffff700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 0x7f3b380a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.375+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3b440cd120 con 0x7f3b500fff90 2023-10-08T13:27:30.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.375+0000 7f3b4ffff700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 0x7f3b380a3990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006010 tx=0x7f3b4001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:30.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.379+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b44096320 con 0x7f3b500fff90 2023-10-08T13:27:30.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.602+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b50196c90 con 0x7f3b380a14d0 2023-10-08T13:27:30.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.610+0000 7f3b4d7fa700 1 -- 172.21.15.139:0/4011641813 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f3b50196c90 con 0x7f3b380a14d0 2023-10-08T13:27:30.611 INFO:teuthology.orchestra.run.smithi139.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T13:27:29", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-08T13:27:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 msgr2=0x7f3b380a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.613 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 0x7f3b380a3990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006010 tx=0x7f3b4001a040 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 msgr2=0x7f3b5019bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400d980 tx=0x7f3b4400dd40 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 shutdown_connections 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3b380a14d0 0x7f3b380a3990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b50105670 0x7f3b501957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b500ff5d0 0x7f3b5019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 --2- 172.21.15.139:0/4011641813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b500fff90 0x7f3b5019bbe0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 >> 172.21.15.139:0/4011641813 conn(0x7f3b500fb0c0 msgr2=0x7f3b500fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 shutdown_connections 2023-10-08T13:27:30.614 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.612+0000 7f3b566d6700 1 -- 172.21.15.139:0/4011641813 wait complete. 2023-10-08T13:27:30.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T13:27:30.751 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 -- 172.21.15.139:0/1687942107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c100730 msgr2=0x7f963c10c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 --2- 172.21.15.139:0/1687942107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c100730 0x7f963c10c440 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f963400b0a0 tx=0x7f963400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 -- 172.21.15.139:0/1687942107 shutdown_connections 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 --2- 172.21.15.139:0/1687942107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c100730 0x7f963c10c440 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 --2- 172.21.15.139:0/1687942107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c1045b0 0x7f963c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 --2- 172.21.15.139:0/1687942107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f963c0ffd70 0x7f963c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 -- 172.21.15.139:0/1687942107 >> 172.21.15.139:0/1687942107 conn(0x7f963c075bf0 msgr2=0x7f963c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 -- 172.21.15.139:0/1687942107 shutdown_connections 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.750+0000 7f96424a8700 1 -- 172.21.15.139:0/1687942107 wait complete. 2023-10-08T13:27:30.752 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 Processor -- start 2023-10-08T13:27:30.753 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 -- start start 2023-10-08T13:27:30.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 0x7f963c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f963c1045b0 0x7f963c1a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1987e0 con 0x7f963c0ffd70 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1a3030 con 0x7f963c100730 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f96424a8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1a3170 con 0x7f963c1045b0 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40490/0 (socket says 172.21.15.139:40490) 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963bfff700 1 -- 172.21.15.139:0/632733964 learned_addr learned my addr 172.21.15.139:0/632733964 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963b7fe700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 0x7f963c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963bfff700 1 -- 172.21.15.139:0/632733964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f963c1045b0 msgr2=0x7f963c1a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.751+0000 7f963bfff700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f963c1045b0 0x7f963c1a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f963bfff700 1 -- 172.21.15.139:0/632733964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 msgr2=0x7f963c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f963bfff700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 0x7f963c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f963bfff700 1 -- 172.21.15.139:0/632733964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009d00 con 0x7f963c0ffd70 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f963b7fe700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 0x7f963c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f963bfff700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f963000d950 tx=0x7f963000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630009b40 con 0x7f963c0ffd70 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9630009ca0 con 0x7f963c0ffd70 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c1a33d0 con 0x7f963c0ffd70 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963000f620 con 0x7f963c0ffd70 2023-10-08T13:27:30.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.752+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c1a38b0 con 0x7f963c0ffd70 2023-10-08T13:27:30.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.753+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c107b90 con 0x7f963c0ffd70 2023-10-08T13:27:30.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.754+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 22) v1 ==== 136021+0+0 (secure 0 0 0) 0x7f9630010460 con 0x7f963c0ffd70 2023-10-08T13:27:30.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.754+0000 7f96397fa700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 0x7f96240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:30.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.755+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f96300cd5b0 con 0x7f963c0ffd70 2023-10-08T13:27:30.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.755+0000 7f963b7fe700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 0x7f96240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:30.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.755+0000 7f963b7fe700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 0x7f96240a3990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ff420 tx=0x7f962c00b2c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:30.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.758+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96300967b0 con 0x7f963c0ffd70 2023-10-08T13:27:30.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:30 smithi139 ceph-mon[99506]: from='client.25390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:30.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.980+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f963c0ff240 con 0x7f96240a14d0 2023-10-08T13:27:30.988 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.987+0000 7f96397fa700 1 -- 172.21.15.139:0/632733964 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f963c0ff240 con 0x7f96240a14d0 2023-10-08T13:27:30.988 INFO:teuthology.orchestra.run.smithi139.stdout:/ 1m 6m3h 2023-10-08T13:27:30.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 msgr2=0x7f96240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 0x7f96240a3990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ff420 tx=0x7f962c00b2c0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 msgr2=0x7f963c197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f963000d950 tx=0x7f963000dd10 comp rx=0 tx=0).stop 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 shutdown_connections 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96240a14d0 0x7f96240a3990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f963c1045b0 0x7f963c1a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f963c0ffd70 0x7f963c197a70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 --2- 172.21.15.139:0/632733964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f963c100730 0x7f963c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:30.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.989+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 >> 172.21.15.139:0/632733964 conn(0x7f963c075bf0 msgr2=0x7f963c102220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:30.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.990+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 shutdown_connections 2023-10-08T13:27:30.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:30.990+0000 7f96424a8700 1 -- 172.21.15.139:0/632733964 wait complete. 2023-10-08T13:27:31.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-08T13:27:31.030 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-08T13:27:31.041 INFO:teuthology.run_tasks:Running task background_exec... 2023-10-08T13:27:31.053 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:27:31.054 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-10-08T13:27:31.073 INFO:teuthology.run_tasks:Running task workunit... 2023-10-08T13:27:31.085 INFO:tasks.workunit:Pulling workunits from ref 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:27:31.086 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-08T13:27:31.086 INFO:tasks.workunit:timeout=3h 2023-10-08T13:27:31.086 INFO:tasks.workunit:cleanup=True 2023-10-08T13:27:31.086 DEBUG:teuthology.orchestra.run.smithi139:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:31.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:30 smithi155 ceph-mon[103467]: from='client.25390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:31.103 INFO:teuthology.orchestra.run.smithi139.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:31.103 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-08T13:27:31.103 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 7ch/124d Inode: 1099511627783 Links: 2 2023-10-08T13:27:31.103 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T13:27:31.104 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-08T13:27:31.104 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2023-10-08 13:26:03.589358970 +0000 2023-10-08T13:27:31.104 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2023-10-08 13:26:03.589358970 +0000 2023-10-08T13:27:31.104 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2023-10-08 13:27:21.493613261 +0000 2023-10-08T13:27:31.104 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2023-10-08 13:26:03.589358970 +0000 2023-10-08T13:27:31.104 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-08T13:27:31.105 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-08T13:27:31.225 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T13:27:31.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:30 smithi187 ceph-mon[104336]: from='client.25390 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:31.243 INFO:tasks.workunit.client.0.smithi139.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-08T13:27:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:31 smithi155 ceph-mon[103467]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:31 smithi155 ceph-mon[103467]: from='client.15903 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:31 smithi155 ceph-mon[103467]: pgmap v300: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-08T13:27:32.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:31 smithi139 ceph-mon[99506]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:31 smithi139 ceph-mon[99506]: from='client.15903 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:31 smithi139 ceph-mon[99506]: pgmap v300: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-08T13:27:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:31 smithi187 ceph-mon[104336]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:31 smithi187 ceph-mon[104336]: from='client.15903 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:32.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:31 smithi187 ceph-mon[104336]: pgmap v300: 129 pgs: 129 active+clean; 647 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-10-08T13:27:33.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:32 smithi155 ceph-mon[103467]: from='client.15909 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:33.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:32 smithi155 ceph-mon[103467]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:27:33.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:32 smithi139 ceph-mon[99506]: from='client.15909 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:33.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:32 smithi139 ceph-mon[99506]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:27:33.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:32 smithi187 ceph-mon[104336]: from='client.15909 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:27:33.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:32 smithi187 ceph-mon[104336]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T13:27:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:33 smithi155 ceph-mon[103467]: pgmap v301: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:33 smithi139 ceph-mon[99506]: pgmap v301: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:33 smithi187 ceph-mon[104336]: pgmap v301: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:35 smithi155 ceph-mon[103467]: pgmap v302: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-08T13:27:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:35 smithi139 ceph-mon[99506]: pgmap v302: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-08T13:27:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:35 smithi187 ceph-mon[104336]: pgmap v302: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 115 KiB/s wr, 45 op/s 2023-10-08T13:27:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:37 smithi155 ceph-mon[103467]: pgmap v303: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:37 smithi139 ceph-mon[99506]: pgmap v303: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:37 smithi187 ceph-mon[104336]: pgmap v303: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:39 smithi155 ceph-mon[103467]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:39 smithi139 ceph-mon[99506]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:39 smithi187 ceph-mon[104336]: pgmap v304: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 116 KiB/s wr, 45 op/s 2023-10-08T13:27:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:41 smithi139 ceph-mon[99506]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:41 smithi187 ceph-mon[104336]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:41 smithi155 ceph-mon[103467]: pgmap v305: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:42.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:42 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:27:42.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:42 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:27:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:42 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:27:43.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:43 smithi139 ceph-mon[99506]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:43.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:43 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:27:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:43 smithi187 ceph-mon[104336]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:43 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:27:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:43 smithi155 ceph-mon[103467]: pgmap v306: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 115 KiB/s wr, 44 op/s 2023-10-08T13:27:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:43 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:27:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.231+0000 7fa06550f700 1 -- 172.21.15.139:0/3614391665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0601045e0 msgr2=0x7fa0601049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.231+0000 7fa06550f700 1 --2- 172.21.15.139:0/3614391665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0601045e0 0x7fa0601049c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa050009990 tx=0x7fa050009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 -- 172.21.15.139:0/3614391665 shutdown_connections 2023-10-08T13:27:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 --2- 172.21.15.139:0/3614391665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600fff90 0x7fa06010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 --2- 172.21.15.139:0/3614391665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0601045e0 0x7fa0601049c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 --2- 172.21.15.139:0/3614391665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0600ff5d0 0x7fa0600ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 -- 172.21.15.139:0/3614391665 >> 172.21.15.139:0/3614391665 conn(0x7fa060076790 msgr2=0x7fa060076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 -- 172.21.15.139:0/3614391665 shutdown_connections 2023-10-08T13:27:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 -- 172.21.15.139:0/3614391665 wait complete. 2023-10-08T13:27:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.232+0000 7fa06550f700 1 Processor -- start 2023-10-08T13:27:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 -- start start 2023-10-08T13:27:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600ff5d0 0x7fa060195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0601045e0 0x7fa06019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06019a910 con 0x7fa0600fff90 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06019aa80 con 0x7fa0601045e0 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa06550f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06019ac40 con 0x7fa0600ff5d0 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40510/0 (socket says 172.21.15.139:40510) 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 -- 172.21.15.139:0/32887379 learned_addr learned my addr 172.21.15.139:0/32887379 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05effd700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600ff5d0 0x7fa060195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05f7fe700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0601045e0 0x7fa06019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 -- 172.21.15.139:0/32887379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600ff5d0 msgr2=0x7fa060195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600ff5d0 0x7fa060195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 -- 172.21.15.139:0/32887379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0601045e0 msgr2=0x7fa06019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0601045e0 0x7fa06019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.233+0000 7fa05e7fc700 1 -- 172.21.15.139:0/32887379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500095f0 con 0x7fa0600fff90 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d950 tx=0x7fa05400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa047fff700 1 -- 172.21.15.139:0/32887379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400f890 con 0x7fa0600fff90 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06019af20 con 0x7fa0600fff90 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa047fff700 1 -- 172.21.15.139:0/32887379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa054010460 con 0x7fa0600fff90 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa047fff700 1 -- 172.21.15.139:0/32887379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400e610 con 0x7fa0600fff90 2023-10-08T13:27:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.234+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0601a27d0 con 0x7fa0600fff90 2023-10-08T13:27:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.236+0000 7fa047fff700 1 -- 172.21.15.139:0/32887379 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7fa0540108d0 con 0x7fa0600fff90 2023-10-08T13:27:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.236+0000 7fa047fff700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 0x7fa0480a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.236+0000 7fa05effd700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 0x7fa0480a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.236+0000 7fa047fff700 1 -- 172.21.15.139:0/32887379 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa0540cd0e0 con 0x7fa0600fff90 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa05effd700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 0x7fa0480a3a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa050006010 tx=0x7fa050005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 Processor -- start 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 -- start start 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 0x563205af9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205afa0b0 0x563205afa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205a62400 con 0x563205aff880 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205a53bc0 con 0x563205b001a0 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.237+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205a514e0 con 0x563205afa0b0 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40516/0 (socket says 172.21.15.139:40516) 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 -- 172.21.15.139:0/3924239131 learned_addr learned my addr 172.21.15.139:0/3924239131 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05f7fe700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205afa0b0 0x563205afa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 0x563205af9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 -- 172.21.15.139:0/3924239131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205afa0b0 msgr2=0x563205afa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205afa0b0 0x563205afa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 -- 172.21.15.139:0/3924239131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 msgr2=0x563205af9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 0x563205af9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 -- 172.21.15.139:0/3924239131 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563205877d80 con 0x563205aff880 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 0x563205af9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa05effd700 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b5c0 tx=0x7fa05001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692728a8ef21eff5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa0457fa700 1 -- 172.21.15.139:0/3924239131 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050029070 con 0x563205aff880 2023-10-08T13:27:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa0457fa700 1 -- 172.21.15.139:0/3924239131 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa05001e040 con 0x563205aff880 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.238+0000 7fa0457fa700 1 -- 172.21.15.139:0/3924239131 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000f750 con 0x563205aff880 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- 172.21.15.139:0/3924239131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 msgr2=0x563205affc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b5c0 tx=0x7fa05001f000 comp rx=0 tx=0).stop 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- 172.21.15.139:0/3924239131 shutdown_connections 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205afa0b0 0x563205afa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205affc60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/3924239131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205b001a0 0x563205af9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- 172.21.15.139:0/3924239131 >> 172.21.15.139:0/3924239131 conn(0x563205a6e200 msgr2=0x563205af4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- 172.21.15.139:0/3924239131 shutdown_connections 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- 172.21.15.139:0/3924239131 wait complete. 2023-10-08T13:27:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 -- start start 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 Processor -- start 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205b034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.239+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205a4cdd0 con 0x563205aff880 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632059e96b0 con 0x563205afa0b0 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632059e9350 con 0x563205b001a0 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 10 client.0 _ll_register_callbacks cb 0x5632058467a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40524/0 (socket says 172.21.15.139:40524) 2023-10-08T13:27:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 -- 172.21.15.139:0/1991127330 learned_addr learned my addr 172.21.15.139:0/1991127330 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05f7fe700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05effd700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205b034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 -- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 msgr2=0x563205b03f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 -- 172.21.15.139:0/1991127330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 msgr2=0x563205b034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205b034b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 -- 172.21.15.139:0/1991127330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06010cd90 con 0x563205aff880 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa054010fd0 tx=0x7fa054099ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b61b3d7a94644a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa042ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05409a2a0 con 0x563205aff880 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563205a14e50 con 0x563205aff880 2023-10-08T13:27:44.248 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa0540a21d0 con 0x563205aff880 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa054099330 con 0x563205aff880 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 10 client.15921 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563205860c00 con 0x563205aff880 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.240+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0540b8030 con 0x563205aff880 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa05405fbc0 con 0x563205aff880 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 10 client.15921 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 20 client.15921 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b13ad0 0x563205b15ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 4 client.15921 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563205a45db0 con 0x563205b13ad0 2023-10-08T13:27:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa05effd700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b13ad0 0x563205b15ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa042ff5700 10 client.15921 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.241+0000 7fa05effd700 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b13ad0 0x563205b15ef0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc45036bdcb6a33d server_cookie=8060f359b88f7399 in_seq=0 out_seq=0 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa042ff5700 1 -- 172.21.15.139:0/1991127330 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563205a45db0 con 0x563205b13ad0 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa042ff5700 10 client.15921 handle_command_reply: tid=0 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 client.15921 shutdown 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 msgr2=0x563205b039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa054010fd0 tx=0x7fa054099ec0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 shutdown_connections 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b13ad0 0x563205b15ef0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205b034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa042ff5700 0 client.15921 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1991127330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205b039f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 >> 172.21.15.139:0/1991127330 conn(0x563205a6e200 msgr2=0x563205af4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 shutdown_connections 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1991127330 wait complete. 2023-10-08T13:27:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.242+0000 7fa0716f8b80 20 client.15921 trim_cache size 0 max 16384 2023-10-08T13:27:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 Processor -- start 2023-10-08T13:27:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 -- start start 2023-10-08T13:27:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205af9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.261 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632058cd8c0 con 0x563205aff880 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205af1830 con 0x563205afa0b0 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205b04ad0 con 0x563205b001a0 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40532/0 (socket says 172.21.15.139:40532) 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 -- 172.21.15.139:0/439752267 learned_addr learned my addr 172.21.15.139:0/439752267 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05effd700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205af9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05f7fe700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 -- 172.21.15.139:0/439752267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 msgr2=0x563205b03d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 -- 172.21.15.139:0/439752267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 msgr2=0x563205af9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205af9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05e7fc700 1 -- 172.21.15.139:0/439752267 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56320589e1f0 con 0x563205aff880 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.257+0000 7fa05effd700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205af9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa0540968b0 tx=0x7fa054010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aff88c5910dbd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa045ffb700 1 -- 172.21.15.139:0/439752267 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054096180 con 0x563205aff880 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa045ffb700 1 -- 172.21.15.139:0/439752267 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa0540b8040 con 0x563205aff880 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa045ffb700 1 -- 172.21.15.139:0/439752267 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054099330 con 0x563205aff880 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 -- 172.21.15.139:0/439752267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 msgr2=0x563205afec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa0540968b0 tx=0x7fa054010cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 -- 172.21.15.139:0/439752267 shutdown_connections 2023-10-08T13:27:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b03d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205afa0b0 0x563205af9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/439752267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205aff880 0x563205afec60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 -- 172.21.15.139:0/439752267 >> 172.21.15.139:0/439752267 conn(0x563205a6e200 msgr2=0x563205afe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 -- 172.21.15.139:0/439752267 shutdown_connections 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.258+0000 7fa0716f8b80 1 -- 172.21.15.139:0/439752267 wait complete. 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 -- start start 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 Processor -- start 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 0x563205b09050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205b66ad0 con 0x563205afa0b0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205b66c40 con 0x563205aff880 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563205b66e00 con 0x563205b001a0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa0716f8b80 10 client.0 _ll_register_callbacks cb 0x7fa054099830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40536/0 (socket says 172.21.15.139:40536) 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 -- 172.21.15.139:0/1319638732 learned_addr learned my addr 172.21.15.139:0/1319638732 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 0x563205b09050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05f7fe700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 -- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 msgr2=0x563205b095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 -- 172.21.15.139:0/1319638732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 msgr2=0x563205b09050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 0x563205b09050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 -- 172.21.15.139:0/1319638732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563205877d80 con 0x563205afa0b0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 0x563205b09050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa05effd700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa05002f040 tx=0x7fa050005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feda783b76d15b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.259+0000 7fa042ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050029040 con 0x563205afa0b0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa050027040 con 0x563205afa0b0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa05001e040 con 0x563205afa0b0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa050036920 con 0x563205afa0b0 2023-10-08T13:27:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 10 client.15927 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563205860c00 con 0x563205afa0b0 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa05001e040 con 0x563205afa0b0 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa050035070 con 0x563205afa0b0 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 20 client.15927 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b68150 0x563205b6a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 4 client.15927 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563205a45ad0 con 0x563205b68150 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.260+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b68150 0x563205b6a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.261+0000 7fa042ff5700 10 client.15927 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:44.267 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.261+0000 7fa05e7fc700 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b68150 0x563205b6a540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f5d86e7cd2cb3f server_cookie=ae2cb44e3932c865 in_seq=0 out_seq=0 2023-10-08T13:27:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa042ff5700 1 -- 172.21.15.139:0/1319638732 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563205a45ad0 con 0x563205b68150 2023-10-08T13:27:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa042ff5700 10 client.15927 handle_command_reply: tid=0 2023-10-08T13:27:44.274 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 client.15927 shutdown 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 msgr2=0x563205b08b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa05002f040 tx=0x7fa050005500 comp rx=0 tx=0).stop 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 shutdown_connections 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563205b001a0 0x563205b095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.273+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563205afa0b0 0x563205b08b10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563205b68150 0x563205b6a540 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 1 --2- 172.21.15.139:0/1319638732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563205aff880 0x563205b09050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa042ff5700 0 client.15927 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 >> 172.21.15.139:0/1319638732 conn(0x563205a6e200 msgr2=0x563205b00580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 shutdown_connections 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 1 -- 172.21.15.139:0/1319638732 wait complete. 2023-10-08T13:27:44.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa0716f8b80 20 client.15927 trim_cache size 0 max 16384 2023-10-08T13:27:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:27:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:27:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:27:44.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 msgr2=0x7fa0480a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 0x7fa0480a3a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa050006010 tx=0x7fa050005960 comp rx=0 tx=0).stop 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 msgr2=0x7fa060195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa05400d950 tx=0x7fa05400dc60 comp rx=0 tx=0).stop 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 shutdown_connections 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa0480a1560 0x7fa0480a3a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0601045e0 0x7fa06019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0600ff5d0 0x7fa060195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 --2- 172.21.15.139:0/32887379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0600fff90 0x7fa060195f70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 >> 172.21.15.139:0/32887379 conn(0x7fa060076790 msgr2=0x7fa0600fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.274+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 shutdown_connections 2023-10-08T13:27:44.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:44.275+0000 7fa06550f700 1 -- 172.21.15.139:0/32887379 wait complete. 2023-10-08T13:27:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:45 smithi139 ceph-mon[99506]: pgmap v307: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:45.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:45 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:45 smithi187 ceph-mon[104336]: pgmap v307: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:45 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:45 smithi155 ceph-mon[103467]: pgmap v307: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 11 op/s 2023-10-08T13:27:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:45 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:27:47.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:27:47.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:27:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:27:47.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:27:47.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:27:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:47 smithi155 ceph-mon[103467]: pgmap v308: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-08T13:27:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:47 smithi139 ceph-mon[99506]: pgmap v308: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-08T13:27:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:47 smithi187 ceph-mon[104336]: pgmap v308: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2023-10-08T13:27:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:49 smithi155 ceph-mon[103467]: pgmap v309: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:49 smithi139 ceph-mon[99506]: pgmap v309: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:49 smithi187 ceph-mon[104336]: pgmap v309: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:51 smithi139 ceph-mon[99506]: pgmap v310: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:51 smithi187 ceph-mon[104336]: pgmap v310: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:51 smithi155 ceph-mon[103467]: pgmap v310: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:53.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:53 smithi139 ceph-mon[99506]: pgmap v311: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:53 smithi187 ceph-mon[104336]: pgmap v311: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:53 smithi155 ceph-mon[103467]: pgmap v311: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:55 smithi187 ceph-mon[104336]: pgmap v312: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:55 smithi155 ceph-mon[103467]: pgmap v312: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:55 smithi139 ceph-mon[99506]: pgmap v312: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2023-10-08T13:27:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 -- 172.21.15.139:0/3958194180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100105ae0 msgr2=0x7f410010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 --2- 172.21.15.139:0/3958194180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100105ae0 0x7f410010d4f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f40f800b0d0 tx=0x7f40f800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 -- 172.21.15.139:0/3958194180 shutdown_connections 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 --2- 172.21.15.139:0/3958194180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100105ae0 0x7f410010d4f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 --2- 172.21.15.139:0/3958194180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100067fd0 0x7f41000683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 --2- 172.21.15.139:0/3958194180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 0x7f41001055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 -- 172.21.15.139:0/3958194180 >> 172.21.15.139:0/3958194180 conn(0x7f4100076790 msgr2=0x7f4100076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 -- 172.21.15.139:0/3958194180 shutdown_connections 2023-10-08T13:27:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.383+0000 7f4106897700 1 -- 172.21.15.139:0/3958194180 wait complete. 2023-10-08T13:27:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 Processor -- start 2023-10-08T13:27:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 -- start start 2023-10-08T13:27:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 0x7f4100199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100105ae0 0x7f410019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019dd60 con 0x7f4100067fd0 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019ded0 con 0x7f4100105120 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f4106897700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410019e090 con 0x7f4100105ae0 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40550/0 (socket says 172.21.15.139:40550) 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f40fffff700 1 -- 172.21.15.139:0/3531671653 learned_addr learned my addr 172.21.15.139:0/3531671653 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.384+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 0x7f4100199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f4104e34700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100105ae0 0x7f410019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 -- 172.21.15.139:0/3531671653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100105ae0 msgr2=0x7f410019d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100105ae0 0x7f410019d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 -- 172.21.15.139:0/3531671653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 msgr2=0x7f4100199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 0x7f4100199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 -- 172.21.15.139:0/3531671653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009d00 con 0x7f4100067fd0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fffff700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c920 tx=0x7f40f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fd7fa700 1 -- 172.21.15.139:0/3531671653 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0007b00 con 0x7f4100067fd0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410019e370 con 0x7f4100067fd0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fd7fa700 1 -- 172.21.15.139:0/3531671653 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f000ce70 con 0x7f4100067fd0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f40fd7fa700 1 -- 172.21.15.139:0/3531671653 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0005460 con 0x7f4100067fd0 2023-10-08T13:27:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.385+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41001a5bb0 con 0x7f4100067fd0 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.387+0000 7f40fd7fa700 1 -- 172.21.15.139:0/3531671653 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f40f0004750 con 0x7f4100067fd0 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.388+0000 7f40fd7fa700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 0x7f40e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.388+0000 7f40fd7fa700 1 -- 172.21.15.139:0/3531671653 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f40f00ccf90 con 0x7f4100067fd0 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.388+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 0x7f40e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.388+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 0x7f40e80a3a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f410019a390 tx=0x7f40f400b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 Processor -- start 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 -- start start 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x56248043dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480438510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624803a0400 con 0x56248043e1a0 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562480391bc0 con 0x56248043d880 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f4112a80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248038f4e0 con 0x5624804380b0 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40560/0 (socket says 172.21.15.139:40560) 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 -- 172.21.15.139:0/3373451782 learned_addr learned my addr 172.21.15.139:0/3373451782 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40fffff700 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x56248043dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 -- 172.21.15.139:0/3373451782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 msgr2=0x562480438510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480438510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 -- 172.21.15.139:0/3373451782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 msgr2=0x56248043dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x56248043dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.389+0000 7f40ff7fe700 1 -- 172.21.15.139:0/3373451782 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624801b5d80 con 0x56248043e1a0 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.390+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f40f4010e30 tx=0x7f40f4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50d28eb71c213a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.390+0000 7f40e67fc700 1 -- 172.21.15.139:0/3373451782 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4011db0 con 0x56248043e1a0 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.390+0000 7f40e67fc700 1 -- 172.21.15.139:0/3373451782 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f4015070 con 0x56248043e1a0 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.390+0000 7f40e67fc700 1 -- 172.21.15.139:0/3373451782 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f401c610 con 0x56248043e1a0 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- 172.21.15.139:0/3373451782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 msgr2=0x562480437b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f40f4010e30 tx=0x7f40f4013000 comp rx=0 tx=0).stop 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- 172.21.15.139:0/3373451782 shutdown_connections 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480438510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x56248043dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- 172.21.15.139:0/3373451782 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043e1a0 0x562480437b70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- 172.21.15.139:0/3373451782 >> 172.21.15.139:0/3373451782 conn(0x5624803ac200 msgr2=0x562480432b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- 172.21.15.139:0/3373451782 shutdown_connections 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- 172.21.15.139:0/3373451782 wait complete. 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- start start 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 Processor -- start 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043d880 0x5624804414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x562480441c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248038add0 con 0x5624804380b0 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.391+0000 7f4112a80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624803276b0 con 0x56248043e1a0 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f4112a80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562480327350 con 0x56248043d880 2023-10-08T13:27:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f4112a80b80 10 client.0 _ll_register_callbacks cb 0x5624801847a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40564/0 (socket says 172.21.15.139:40564) 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 -- 172.21.15.139:0/769404173 learned_addr learned my addr 172.21.15.139:0/769404173 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f4104e34700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x562480441c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043d880 0x5624804414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 -- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043d880 msgr2=0x5624804414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043d880 0x5624804414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 -- 172.21.15.139:0/769404173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 msgr2=0x562480441c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x562480441c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 -- 172.21.15.139:0/769404173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f4010ae0 con 0x5624804380b0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40fffff700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f40f00999f0 tx=0x7f40f009a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57457415c4a32b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00b1070 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f40f00a2080 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562480352e50 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.392+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40f0099f50 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 10 client.15939 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56248019ec00 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f0063080 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f40f00a1bf0 con 0x5624804380b0 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 10 client.15939 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 20 client.15939 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562480451b90 0x562480453f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 4 client.15939 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562480383db0 con 0x562480451b90 2023-10-08T13:27:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.393+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562480451b90 0x562480453f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f40df7fe700 10 client.15939 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562480451b90 0x562480453f80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11032d1d0b01347c server_cookie=174567dcbe367668 in_seq=0 out_seq=0 2023-10-08T13:27:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f40df7fe700 1 -- 172.21.15.139:0/769404173 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562480383db0 con 0x562480451b90 2023-10-08T13:27:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f40df7fe700 10 client.15939 handle_command_reply: tid=0 2023-10-08T13:27:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f4112a80b80 1 client.15939 shutdown 2023-10-08T13:27:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 msgr2=0x562480444200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.394+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f40f00999f0 tx=0x7f40f009a4a0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 shutdown_connections 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562480451b90 0x562480453f80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x562480441c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480444200 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 --2- 172.21.15.139:0/769404173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043d880 0x5624804414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 >> 172.21.15.139:0/769404173 conn(0x5624803ac200 msgr2=0x562480432010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f40df7fe700 0 client.15939 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 shutdown_connections 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 1 -- 172.21.15.139:0/769404173 wait complete. 2023-10-08T13:27:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.395+0000 7f4112a80b80 20 client.15939 trim_cache size 0 max 16384 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 Processor -- start 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 -- start start 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x562480448c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043e1a0 0x562480432790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248020b8c0 con 0x5624804380b0 2023-10-08T13:27:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248043fa40 con 0x56248043d880 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f4112a80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562480442420 con 0x56248043e1a0 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f40fffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40572/0 (socket says 172.21.15.139:40572) 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f40fffff700 1 -- 172.21.15.139:0/2371472651 learned_addr learned my addr 172.21.15.139:0/2371472651 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.409+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x562480448c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f4104e34700 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043e1a0 0x562480432790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 -- 172.21.15.139:0/2371472651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043e1a0 msgr2=0x562480432790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043e1a0 0x562480432790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 -- 172.21.15.139:0/2371472651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 msgr2=0x562480448c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x562480448c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 -- 172.21.15.139:0/2371472651 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624801dc1f0 con 0x5624804380b0 2023-10-08T13:27:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40fffff700 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40f00a1b50 tx=0x7f40f009dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab357f7dddb7113b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40e6ffd700 1 -- 172.21.15.139:0/2371472651 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0099d70 con 0x5624804380b0 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40e6ffd700 1 -- 172.21.15.139:0/2371472651 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562480352e50 con 0x5624804380b0 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.410+0000 7f40e6ffd700 1 -- 172.21.15.139:0/2371472651 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00a1d70 con 0x5624804380b0 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- 172.21.15.139:0/2371472651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 msgr2=0x562480438490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40f00a1b50 tx=0x7f40f009dfc0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- 172.21.15.139:0/2371472651 shutdown_connections 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248043e1a0 0x562480432790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624804380b0 0x562480438490 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2371472651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043d880 0x562480448c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- 172.21.15.139:0/2371472651 >> 172.21.15.139:0/2371472651 conn(0x5624803ac200 msgr2=0x562480443e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- 172.21.15.139:0/2371472651 shutdown_connections 2023-10-08T13:27:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- 172.21.15.139:0/2371472651 wait complete. 2023-10-08T13:27:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 -- start start 2023-10-08T13:27:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 Processor -- start 2023-10-08T13:27:57.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480446c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.411+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x5624804476b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624804a4920 con 0x56248043d880 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624804a4a60 con 0x56248043e1a0 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624804a4c20 con 0x5624804380b0 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 10 client.0 _ll_register_callbacks cb 0x5624801847a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40580/0 (socket says 172.21.15.139:40580) 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 -- 172.21.15.139:0/2199783345 learned_addr learned my addr 172.21.15.139:0/2199783345 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:57.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40fffff700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480446c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4104e34700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x5624804476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 -- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 msgr2=0x562480446c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480446c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 -- 172.21.15.139:0/2199783345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 msgr2=0x5624804476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x5624804476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 -- 172.21.15.139:0/2199783345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56248019ec00 con 0x56248043d880 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40fffff700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480446c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40ff7fe700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x56248043e600 tx=0x7f40f4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ac2dd56d3ad990 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f4034e00 con 0x56248043d880 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x56248043d880 2023-10-08T13:27:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40f4015070 con 0x56248043d880 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40f4011e00 con 0x56248043d880 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.412+0000 7f4112a80b80 10 client.15945 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5624801b4250 con 0x56248043d880 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40f4015070 con 0x56248043d880 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f40f4011440 con 0x56248043d880 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 10 client.15945 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 20 client.15945 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624804a6430 0x5624804a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 4 client.15945 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562480383ad0 con 0x5624804a6430 2023-10-08T13:27:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f40fffff700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624804a6430 0x5624804a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.413+0000 7f40df7fe700 10 client.15945 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.414+0000 7f40fffff700 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624804a6430 0x5624804a8850 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79503a7f1f21ec0a server_cookie=7c89cf4b84eb5650 in_seq=0 out_seq=0 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.420+0000 7f40df7fe700 1 -- 172.21.15.139:0/2199783345 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562480383ad0 con 0x5624804a6430 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f40df7fe700 10 client.15945 handle_command_reply: tid=0 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 client.15945 shutdown 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 msgr2=0x562480447170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x56248043e600 tx=0x7f40f4011b60 comp rx=0 tx=0).stop 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 shutdown_connections 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624804a6430 0x5624804a8850 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56248043e1a0 0x5624804476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624804380b0 0x562480446c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 --2- 172.21.15.139:0/2199783345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56248043d880 0x562480447170 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f40df7fe700 0 client.15945 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 >> 172.21.15.139:0/2199783345 conn(0x5624803ac200 msgr2=0x56248043fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 shutdown_connections 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 1 -- 172.21.15.139:0/2199783345 wait complete. 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.421+0000 7f4112a80b80 20 client.15945 trim_cache size 0 max 16384 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:27:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:27:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:27:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:27:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 msgr2=0x7f40e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 0x7f40e80a3a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f410019a390 tx=0x7f40f400b410 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 msgr2=0x7f4100198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c920 tx=0x7f40f000cc30 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 shutdown_connections 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40e80a1560 0x7f40e80a3a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4100105ae0 0x7f410019d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4100067fd0 0x7f4100198e40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 --2- 172.21.15.139:0/3531671653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100105120 0x7f4100199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 >> 172.21.15.139:0/3531671653 conn(0x7f4100076790 msgr2=0x7f41000fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 shutdown_connections 2023-10-08T13:27:57.425 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:27:57.422+0000 7f4106897700 1 -- 172.21.15.139:0/3531671653 wait complete. 2023-10-08T13:27:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:57 smithi187 ceph-mon[104336]: pgmap v313: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:57 smithi155 ceph-mon[103467]: pgmap v313: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:57 smithi139 ceph-mon[99506]: pgmap v313: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2023-10-08T13:27:59.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:27:59.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- 172.21.15.139:0/994059731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c067ce0 msgr2=0x7fe76c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 --2- 172.21.15.139:0/994059731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c067ce0 0x7fe76c0680c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe7680099c0 tx=0x7fe768009cd0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- 172.21.15.139:0/994059731 shutdown_connections 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 --2- 172.21.15.139:0/994059731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c105b80 0x7fe76c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 --2- 172.21.15.139:0/994059731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c067ce0 0x7fe76c0680c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 --2- 172.21.15.139:0/994059731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c1051c0 0x7fe76c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- 172.21.15.139:0/994059731 >> 172.21.15.139:0/994059731 conn(0x7fe76c076780 msgr2=0x7fe76c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- 172.21.15.139:0/994059731 shutdown_connections 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- 172.21.15.139:0/994059731 wait complete. 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 Processor -- start 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.799+0000 7fe774384700 1 -- start start 2023-10-08T13:27:59.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c067ce0 0x7fe76c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c105b80 0x7fe76c196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c197060 con 0x7fe76c1051c0 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c1971d0 con 0x7fe76c105b80 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c197390 con 0x7fe76c067ce0 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40594/0 (socket says 172.21.15.139:40594) 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 -- 172.21.15.139:0/3843418333 learned_addr learned my addr 172.21.15.139:0/3843418333 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe772921700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c105b80 0x7fe76c196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe772120700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c067ce0 0x7fe76c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 -- 172.21.15.139:0/3843418333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c067ce0 msgr2=0x7fe76c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c067ce0 0x7fe76c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 -- 172.21.15.139:0/3843418333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c105b80 msgr2=0x7fe76c196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c105b80 0x7fe76c196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 -- 172.21.15.139:0/3843418333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680095f0 con 0x7fe76c1051c0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe77191f700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00d980 tx=0x7fe75c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe7637fe700 1 -- 172.21.15.139:0/3843418333 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c004220 con 0x7fe76c1051c0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe7637fe700 1 -- 172.21.15.139:0/3843418333 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe75c007640 con 0x7fe76c1051c0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c197670 con 0x7fe76c1051c0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe7637fe700 1 -- 172.21.15.139:0/3843418333 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c005690 con 0x7fe76c1051c0 2023-10-08T13:27:59.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.800+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c0ff5e0 con 0x7fe76c1051c0 2023-10-08T13:27:59.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.802+0000 7fe7637fe700 1 -- 172.21.15.139:0/3843418333 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7fe75c004750 con 0x7fe76c1051c0 2023-10-08T13:27:59.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.803+0000 7fe7637fe700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 0x7fe7580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.803+0000 7fe772120700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 0x7fe7580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.803+0000 7fe7637fe700 1 -- 172.21.15.139:0/3843418333 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe75c0cced0 con 0x7fe76c1051c0 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.804+0000 7fe772120700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 0x7fe7580a3a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe768009990 tx=0x7fe768003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.804+0000 7fe78056db80 1 Processor -- start 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.804+0000 7fe78056db80 1 -- start start 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c98260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572c01460 con 0x55c572ca3650 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572bf2c20 con 0x55c572c97e80 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe78056db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572bf0540 con 0x55c572c987a0 2023-10-08T13:27:59.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772120700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c98260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40604/0 (socket says 172.21.15.139:40604) 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 -- 172.21.15.139:0/3204025387 learned_addr learned my addr 172.21.15.139:0/3204025387 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe77191f700 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 -- 172.21.15.139:0/3204025387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 msgr2=0x55c572ca3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 -- 172.21.15.139:0/3204025387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 msgr2=0x55c572c98260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c98260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 -- 172.21.15.139:0/3204025387 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c572a16de0 con 0x55c572ca3650 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772120700 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c98260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe772921700 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe76400a730 tx=0x7fe7640078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7d748abae8e922 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe760d82700 1 -- 172.21.15.139:0/3204025387 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764018070 con 0x55c572ca3650 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe760d82700 1 -- 172.21.15.139:0/3204025387 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe764010040 con 0x55c572ca3650 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.805+0000 7fe760d82700 1 -- 172.21.15.139:0/3204025387 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400f050 con 0x55c572ca3650 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 -- 172.21.15.139:0/3204025387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 msgr2=0x55c572ca5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe76400a730 tx=0x7fe7640078d0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 -- 172.21.15.139:0/3204025387 shutdown_connections 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca5a40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c98260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 --2- 172.21.15.139:0/3204025387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 -- 172.21.15.139:0/3204025387 >> 172.21.15.139:0/3204025387 conn(0x55c572c0d260 msgr2=0x55c572c942d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 -- 172.21.15.139:0/3204025387 shutdown_connections 2023-10-08T13:27:59.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.806+0000 7fe78056db80 1 -- 172.21.15.139:0/3204025387 wait complete. 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 -- start start 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 Processor -- start 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572ca3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572bebe30 con 0x55c572ca3650 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572b88710 con 0x55c572c97e80 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572b883b0 con 0x55c572c987a0 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe78056db80 10 client.0 _ll_register_callbacks cb 0x55c5729e5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40610/0 (socket says 172.21.15.139:40610) 2023-10-08T13:27:59.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe772921700 1 -- 172.21.15.139:0/3938147739 learned_addr learned my addr 172.21.15.139:0/3938147739 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe77191f700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.807+0000 7fe772120700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572ca3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 -- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 msgr2=0x55c572ca0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 -- 172.21.15.139:0/3938147739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 msgr2=0x55c572ca3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572ca3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 -- 172.21.15.139:0/3938147739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c10dec0 con 0x55c572ca3650 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe772921700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe764003cb0 tx=0x7fe764003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ead7037feaa560 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764018070 con 0x55c572ca3650 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe764003ff0 con 0x55c572ca3650 2023-10-08T13:27:59.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c572bb3eb0 con 0x55c572ca3650 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe764004210 con 0x55c572ca3650 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 10 client.15957 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fe76400a410 con 0x55c572ca3650 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c572bb3eb0 con 0x55c572ca3650 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe76401ecd0 con 0x55c572ca3650 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 10 client.15957 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 20 client.15957 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.808+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572cb2ff0 0x55c572cb5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.809+0000 7fe78056db80 4 client.15957 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:27:59.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.809+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c572be4e10 con 0x55c572cb2ff0 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.809+0000 7fe772120700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572cb2ff0 0x55c572cb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.809+0000 7fe755ffb700 10 client.15957 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.809+0000 7fe772120700 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572cb2ff0 0x55c572cb5410 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3481c6fc16573200 server_cookie=f6f531c45b5bbfc1 in_seq=0 out_seq=0 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe755ffb700 1 -- 172.21.15.139:0/3938147739 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c572be4e10 con 0x55c572cb2ff0 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe755ffb700 10 client.15957 handle_command_reply: tid=0 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 client.15957 shutdown 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 msgr2=0x55c572ca0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe764003cb0 tx=0x7fe764003ce0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 shutdown_connections 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572ca0980 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572cb2ff0 0x55c572cb5410 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572ca3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 --2- 172.21.15.139:0/3938147739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c987a0 0x55c572ca0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe755ffb700 0 client.15957 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 >> 172.21.15.139:0/3938147739 conn(0x55c572c0d260 msgr2=0x55c572c93ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 shutdown_connections 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 1 -- 172.21.15.139:0/3938147739 wait complete. 2023-10-08T13:27:59.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.810+0000 7fe78056db80 20 client.15957 trim_cache size 0 max 16384 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 Processor -- start 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 -- start start 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c9ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572ca3650 0x55c572caefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572a6c920 con 0x55c572c987a0 2023-10-08T13:27:59.833 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572cb0830 con 0x55c572c97e80 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe78056db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572cb2e60 con 0x55c572ca3650 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40616/0 (socket says 172.21.15.139:40616) 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 -- 172.21.15.139:0/239385926 learned_addr learned my addr 172.21.15.139:0/239385926 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe772120700 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c9ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe772921700 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572ca3650 0x55c572caefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 -- 172.21.15.139:0/239385926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572ca3650 msgr2=0x55c572caefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572ca3650 0x55c572caefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 -- 172.21.15.139:0/239385926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 msgr2=0x55c572c9ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c9ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.827+0000 7fe77191f700 1 -- 172.21.15.139:0/239385926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5729ffc60 con 0x55c572c987a0 2023-10-08T13:27:59.834 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe77191f700 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0058f0 tx=0x7fe75c0960a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dc2c08b22daca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe761583700 1 -- 172.21.15.139:0/239385926 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0b9040 con 0x55c572c987a0 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe761583700 1 -- 172.21.15.139:0/239385926 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe75c09dd80 con 0x55c572c987a0 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe761583700 1 -- 172.21.15.139:0/239385926 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c09a0d0 con 0x55c572c987a0 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 -- 172.21.15.139:0/239385926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 msgr2=0x55c572caa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0058f0 tx=0x7fe75c0960a0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 -- 172.21.15.139:0/239385926 shutdown_connections 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572ca3650 0x55c572caefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c97e80 0x55c572c9ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 --2- 172.21.15.139:0/239385926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572c987a0 0x55c572caa140 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 -- 172.21.15.139:0/239385926 >> 172.21.15.139:0/239385926 conn(0x55c572c0d260 msgr2=0x55c572cae890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.828+0000 7fe78056db80 1 -- 172.21.15.139:0/239385926 shutdown_connections 2023-10-08T13:27:59.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 -- 172.21.15.139:0/239385926 wait complete. 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 -- start start 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 Processor -- start 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c97e80 0x55c572cfafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c987a0 0x55c572cfb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572cff5c0 con 0x55c572ca3650 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572cff730 con 0x55c572c987a0 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c572cff8f0 con 0x55c572c97e80 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe78056db80 10 client.0 _ll_register_callbacks cb 0x7fe768005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe772921700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40624/0 (socket says 172.21.15.139:40624) 2023-10-08T13:27:59.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe772921700 1 -- 172.21.15.139:0/4174146620 learned_addr learned my addr 172.21.15.139:0/4174146620 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe772120700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c97e80 0x55c572cfafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.829+0000 7fe77191f700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c987a0 0x55c572cfb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 -- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c97e80 msgr2=0x55c572cfafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c97e80 0x55c572cfafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 -- 172.21.15.139:0/4174146620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c987a0 msgr2=0x55c572cfb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c987a0 0x55c572cfb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 -- 172.21.15.139:0/4174146620 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c0ff5e0 con 0x55c572ca3650 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe772921700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe764014480 tx=0x7fe764014c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb01609dc304a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400f070 con 0x55c572ca3650 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe764014e40 con 0x55c572ca3650 2023-10-08T13:27:59.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe764010040 con 0x55c572ca3650 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe764018040 con 0x55c572ca3650 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 10 client.15963 fetch_fsmap learned FSMap version 26 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c572a3d250 con 0x55c572ca3650 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe764010040 con 0x55c572ca3650 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe76400aa40 con 0x55c572ca3650 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 10 client.15963 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.830+0000 7fe78056db80 20 client.15963 populate_metadata read hostname 'smithi139' 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572d080f0 0x55c572d0a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 4 client.15963 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:27:59.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c572be4b30 con 0x55c572d080f0 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe772120700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572d080f0 0x55c572d0a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe755ffb700 10 client.15963 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe772120700 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572d080f0 0x55c572d0a510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15517aab5b538f98 server_cookie=e54b3195421f5167 in_seq=0 out_seq=0 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe755ffb700 1 -- 172.21.15.139:0/4174146620 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c572be4b30 con 0x55c572d080f0 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe755ffb700 10 client.15963 handle_command_reply: tid=0 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 client.15963 shutdown 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 msgr2=0x55c572cff040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe764014480 tx=0x7fe764014c50 comp rx=0 tx=0).stop 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 shutdown_connections 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c572ca3650 0x55c572cff040 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c572c97e80 0x55c572cfafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.831+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55c572d080f0 0x55c572d0a510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe78056db80 1 --2- 172.21.15.139:0/4174146620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c572c987a0 0x55c572cfb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 >> 172.21.15.139:0/4174146620 conn(0x55c572c0d260 msgr2=0x55c572caf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe755ffb700 0 client.15963 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 shutdown_connections 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe78056db80 1 -- 172.21.15.139:0/4174146620 wait complete. 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe78056db80 20 client.15963 trim_cache size 0 max 16384 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:27:59.840 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "no active scrubs running", 2023-10-08T13:27:59.841 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": {} 2023-10-08T13:27:59.841 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:27:59.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 msgr2=0x7fe7580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 0x7fe7580a3a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe768009990 tx=0x7fe768003680 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 msgr2=0x7fe76c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00d980 tx=0x7fe75c00dc90 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 shutdown_connections 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe7580a1560 0x7fe7580a3a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe76c105b80 0x7fe76c196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe76c067ce0 0x7fe76c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 --2- 172.21.15.139:0/3843418333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe76c1051c0 0x7fe76c19ce10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 >> 172.21.15.139:0/3843418333 conn(0x7fe76c076780 msgr2=0x7fe76c0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 shutdown_connections 2023-10-08T13:27:59.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.832+0000 7fe774384700 1 -- 172.21.15.139:0/3843418333 wait complete. 2023-10-08T13:27:59.845 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:27:59.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:27:59.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 -- 172.21.15.139:0/1716826537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714102170 msgr2=0x7f471410a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 --2- 172.21.15.139:0/1716826537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714102170 0x7f471410a650 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4708009990 tx=0x7f4708009ca0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 -- 172.21.15.139:0/1716826537 shutdown_connections 2023-10-08T13:27:59.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 --2- 172.21.15.139:0/1716826537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f471410ac20 0x7f471410d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 --2- 172.21.15.139:0/1716826537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4714101850 0x7f4714101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 --2- 172.21.15.139:0/1716826537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714102170 0x7f471410a650 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 -- 172.21.15.139:0/1716826537 >> 172.21.15.139:0/1716826537 conn(0x7f47140fb030 msgr2=0x7f47140fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:27:59.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 -- 172.21.15.139:0/1716826537 shutdown_connections 2023-10-08T13:27:59.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 -- 172.21.15.139:0/1716826537 wait complete. 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.968+0000 7f471903c700 1 Processor -- start 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 -- start start 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 0x7f471419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f471410ac20 0x7f4714196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714197020 con 0x7f4714101850 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714197190 con 0x7f4714102170 2023-10-08T13:27:59.972 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471903c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714197350 con 0x7f471410ac20 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40632/0 (socket says 172.21.15.139:40632) 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 -- 172.21.15.139:0/2955049534 learned_addr learned my addr 172.21.15.139:0/2955049534 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471259c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 0x7f471419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471359e700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f471410ac20 0x7f4714196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 -- 172.21.15.139:0/2955049534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f471410ac20 msgr2=0x7f4714196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f471410ac20 0x7f4714196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 -- 172.21.15.139:0/2955049534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 msgr2=0x7f471419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 0x7f471419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f4712d9d700 1 -- 172.21.15.139:0/2955049534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080095f0 con 0x7f4714101850 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.969+0000 7f471259c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 0x7f471419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:27:59.973 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f4712d9d700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f470400c970 tx=0x7f470400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040078d0 con 0x7f4714101850 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4714197630 con 0x7f4714101850 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4704018480 con 0x7f4714101850 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400f690 con 0x7f4714101850 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.970+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47141a37d0 con 0x7f4714101850 2023-10-08T13:27:59.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.971+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4714105d40 con 0x7f4714101850 2023-10-08T13:27:59.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.972+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f47040185f0 con 0x7f4714101850 2023-10-08T13:27:59.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.973+0000 7f46fbfff700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 0x7f46fc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:27:59.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.973+0000 7f471259c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 0x7f46fc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:27:59.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.973+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4704013070 con 0x7f4714101850 2023-10-08T13:27:59.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.974+0000 7f471259c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 0x7f46fc0a3a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f470800b2e0 tx=0x7f4708005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:27:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:27:59 smithi187 ceph-mon[104336]: pgmap v314: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-08T13:27:59.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:27:59.976+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4704096900 con 0x7f4714101850 2023-10-08T13:28:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:27:59 smithi155 ceph-mon[103467]: pgmap v314: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-08T13:28:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:27:59 smithi139 ceph-mon[99506]: pgmap v314: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2023-10-08T13:28:00.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.224+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47140680b0 con 0x7f4714101850 2023-10-08T13:28:00.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.225+0000 7f46fbfff700 1 -- 172.21.15.139:0/2955049534 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f47140680b0 con 0x7f4714101850 2023-10-08T13:28:00.226 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:28:00.226 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 msgr2=0x7f46fc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 0x7f46fc0a3a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f470800b2e0 tx=0x7f4708005960 comp rx=0 tx=0).stop 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 msgr2=0x7f471419c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f470400c970 tx=0x7f470400cc80 comp rx=0 tx=0).stop 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 shutdown_connections 2023-10-08T13:28:00.228 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f46fc0a1560 0x7f46fc0a3a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f471410ac20 0x7f4714196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4714101850 0x7f471419c730 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 --2- 172.21.15.139:0/2955049534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4714102170 0x7f471419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 >> 172.21.15.139:0/2955049534 conn(0x7f47140fb030 msgr2=0x7f47140fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 shutdown_connections 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.227+0000 7f471903c700 1 -- 172.21.15.139:0/2955049534 wait complete. 2023-10-08T13:28:00.229 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:28:00.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T13:28:00.382 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 -- 172.21.15.139:0/1651841815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 msgr2=0x7f982c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 --2- 172.21.15.139:0/1651841815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c0ffaa0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f9820009990 tx=0x7f9820009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 -- 172.21.15.139:0/1651841815 shutdown_connections 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 --2- 172.21.15.139:0/1651841815 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c0fffe0 0x7f982c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 --2- 172.21.15.139:0/1651841815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c1056b0 0x7f982c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 --2- 172.21.15.139:0/1651841815 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c0ffaa0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 -- 172.21.15.139:0/1651841815 >> 172.21.15.139:0/1651841815 conn(0x7f982c076780 msgr2=0x7f982c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 -- 172.21.15.139:0/1651841815 shutdown_connections 2023-10-08T13:28:00.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.381+0000 7f9830b94700 1 -- 172.21.15.139:0/1651841815 wait complete. 2023-10-08T13:28:00.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 Processor -- start 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 -- start start 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 0x7f982c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c1056b0 0x7f982c1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c198700 con 0x7f982c0ff620 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1a2f10 con 0x7f982c0fffe0 2023-10-08T13:28:00.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f9830b94700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c1a3050 con 0x7f982c1056b0 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.382+0000 7f982a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40662/0 (socket says 172.21.15.139:40662) 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 -- 172.21.15.139:0/1130961376 learned_addr learned my addr 172.21.15.139:0/1130961376 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982ad9d700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c1056b0 0x7f982c1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f9829d9b700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 0x7f982c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 -- 172.21.15.139:0/1130961376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c1056b0 msgr2=0x7f982c1a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c1056b0 0x7f982c1a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 -- 172.21.15.139:0/1130961376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 msgr2=0x7f982c197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 0x7f982c197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 -- 172.21.15.139:0/1130961376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200095f0 con 0x7f982c0ff620 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f9829d9b700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 0x7f982c197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f982a59c700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f981c00c970 tx=0x7f981c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f981b7fe700 1 -- 172.21.15.139:0/1130961376 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c004220 con 0x7f982c0ff620 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c1a32e0 con 0x7f982c0ff620 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f981b7fe700 1 -- 172.21.15.139:0/1130961376 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981c007d60 con 0x7f982c0ff620 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f981b7fe700 1 -- 172.21.15.139:0/1130961376 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c003c90 con 0x7f982c0ff620 2023-10-08T13:28:00.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.383+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c1a37f0 con 0x7f982c0ff620 2023-10-08T13:28:00.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.386+0000 7f981b7fe700 1 -- 172.21.15.139:0/1130961376 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f981c004380 con 0x7f982c0ff620 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.386+0000 7f981b7fe700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 0x7f98140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f9829d9b700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 0x7f98140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f981b7fe700 1 -- 172.21.15.139:0/1130961376 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f981c0ccf10 con 0x7f982c0ff620 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f9829d9b700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 0x7f98140a3a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f982000b5c0 tx=0x7f9820005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f983cd7db80 1 Processor -- start 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f983cd7db80 1 -- start start 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f225616110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.387+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f983cd7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225574460 con 0x55f225616650 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f983cd7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225565c20 con 0x55f22560b7a0 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f983cd7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225563540 con 0x55f22560ae80 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40674/0 (socket says 172.21.15.139:40674) 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 -- 172.21.15.139:0/3168722623 learned_addr learned my addr 172.21.15.139:0/3168722623 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982a59c700 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f9829d9b700 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f225616110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 -- 172.21.15.139:0/3168722623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 msgr2=0x55f22560b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 -- 172.21.15.139:0/3168722623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 msgr2=0x55f225616110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f225616110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 -- 172.21.15.139:0/3168722623 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f225389de0 con 0x55f225616650 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f982ad9d700 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f98240098f0 tx=0x7f9824009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986009dbb0d0d570 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f9818ff9700 1 -- 172.21.15.139:0/3168722623 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824019070 con 0x55f225616650 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f9818ff9700 1 -- 172.21.15.139:0/3168722623 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982400f040 con 0x55f225616650 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.388+0000 7f9818ff9700 1 -- 172.21.15.139:0/3168722623 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007a90 con 0x55f225616650 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 -- 172.21.15.139:0/3168722623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 msgr2=0x55f225618a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f98240098f0 tx=0x7f9824009c00 comp rx=0 tx=0).stop 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 -- 172.21.15.139:0/3168722623 shutdown_connections 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f225616650 0x55f225618a40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 --2- 172.21.15.139:0/3168722623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f225616110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 -- 172.21.15.139:0/3168722623 >> 172.21.15.139:0/3168722623 conn(0x55f225580260 msgr2=0x55f2256072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 -- 172.21.15.139:0/3168722623 shutdown_connections 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.389+0000 7f983cd7db80 1 -- 172.21.15.139:0/3168722623 wait complete. 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 -- start start 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 Processor -- start 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f225615fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f22555ee30 con 0x55f22560b7a0 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2254fb710 con 0x55f225616650 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2254fb3b0 con 0x55f22560ae80 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f983cd7db80 10 client.0 _ll_register_callbacks cb 0x55f225358800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40678/0 (socket says 172.21.15.139:40678) 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 -- 172.21.15.139:0/353316849 learned_addr learned my addr 172.21.15.139:0/353316849 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f982ad9d700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f982a59c700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f225615fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 -- 172.21.15.139:0/353316849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 msgr2=0x55f225615fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f225615fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 -- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 msgr2=0x55f2256138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.390+0000 7f9829d9b700 1 -- 172.21.15.139:0/353316849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9824003c50 con 0x55f22560b7a0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9829d9b700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98200050a0 tx=0x7f9820009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490a7c237a8f5e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982002b070 con 0x55f22560b7a0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9820003a60 con 0x55f22560b7a0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f225526eb0 con 0x55f22560b7a0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f982001d070 con 0x55f22560b7a0 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 10 client.15987 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f225372c60 con 0x55f22560b7a0 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f225526eb0 con 0x55f22560b7a0 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f982000f460 con 0x55f22560b7a0 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 10 client.15987 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 10 client.15987 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 20 client.15987 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f2256261b0 0x55f2256285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 4 client.15987 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.391+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f225557e10 con 0x55f2256261b0 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.392+0000 7f982a59c700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f2256261b0 0x55f2256285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.392+0000 7f9811ffb700 10 client.15987 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:00.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.392+0000 7f982a59c700 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f2256261b0 0x55f2256285d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1be81f9ed947df3d server_cookie=708d1140b89cb9d6 in_seq=0 out_seq=0 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f9811ffb700 1 -- 172.21.15.139:0/353316849 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f225557e10 con 0x55f2256261b0 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f9811ffb700 10 client.15987 handle_command_reply: tid=0 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 client.15987 shutdown 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 msgr2=0x55f2256132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98200050a0 tx=0x7f9820009310 comp rx=0 tx=0).stop 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 shutdown_connections 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f2256261b0 0x55f2256285d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f9811ffb700 0 client.15987 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f225615fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 --2- 172.21.15.139:0/353316849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f2256132b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 >> 172.21.15.139:0/353316849 conn(0x55f225580260 msgr2=0x55f225606ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 shutdown_connections 2023-10-08T13:28:00.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 1 -- 172.21.15.139:0/353316849 wait complete. 2023-10-08T13:28:00.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.393+0000 7f983cd7db80 20 client.15987 trim_cache size 0 max 16384 2023-10-08T13:28:00.408 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.406+0000 7f983cd7db80 1 Processor -- start 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.406+0000 7f983cd7db80 1 -- start start 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.406+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.406+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f983cd7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2253df920 con 0x55f22560b7a0 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f983cd7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225612600 con 0x55f225616650 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f983cd7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225601570 con 0x55f22560ae80 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40686/0 (socket says 172.21.15.139:40686) 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 -- 172.21.15.139:0/245159366 learned_addr learned my addr 172.21.15.139:0/245159366 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.409 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f982ad9d700 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 -- 172.21.15.139:0/245159366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 msgr2=0x55f22560dd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560dd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 -- 172.21.15.139:0/245159366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 msgr2=0x55f2256120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 -- 172.21.15.139:0/245159366 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2253b0250 con 0x55f22560b7a0 2023-10-08T13:28:00.410 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.407+0000 7f9829d9b700 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f982000f7c0 tx=0x7f9820005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee5bc931de86ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.409+0000 7f98197fa700 1 -- 172.21.15.139:0/245159366 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982002b040 con 0x55f22560b7a0 2023-10-08T13:28:00.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.409+0000 7f98197fa700 1 -- 172.21.15.139:0/245159366 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982000f460 con 0x55f22560b7a0 2023-10-08T13:28:00.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.409+0000 7f98197fa700 1 -- 172.21.15.139:0/245159366 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200306c0 con 0x55f22560b7a0 2023-10-08T13:28:00.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.409+0000 7f983cd7db80 1 -- 172.21.15.139:0/245159366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 msgr2=0x55f225611b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.409+0000 7f983cd7db80 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f982000f7c0 tx=0x7f9820005f00 comp rx=0 tx=0).stop 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- 172.21.15.139:0/245159366 shutdown_connections 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f225616650 0x55f2256120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f22560ae80 0x55f22560dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- 172.21.15.139:0/245159366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560b7a0 0x55f225611b80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- 172.21.15.139:0/245159366 >> 172.21.15.139:0/245159366 conn(0x55f225580260 msgr2=0x55f22560e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- 172.21.15.139:0/245159366 shutdown_connections 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- 172.21.15.139:0/245159366 wait complete. 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- start start 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 Processor -- start 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f22561b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 0x55f225678fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225679520 con 0x55f22560ae80 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f225679660 con 0x55f22560b7a0 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2256797a0 con 0x55f225616650 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f983cd7db80 10 client.0 _ll_register_callbacks cb 0x7f982000bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f982a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f982a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40690/0 (socket says 172.21.15.139:40690) 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.410+0000 7f982a59c700 1 -- 172.21.15.139:0/2484822340 learned_addr learned my addr 172.21.15.139:0/2484822340 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9829d9b700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f22561b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982ad9d700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 0x55f225678fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 -- 172.21.15.139:0/2484822340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 msgr2=0x55f225678fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 0x55f225678fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 -- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 msgr2=0x55f22561b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f22561b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 -- 172.21.15.139:0/2484822340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f225372c60 con 0x55f22560ae80 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982ad9d700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 0x55f225678fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f982a59c700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f981c0074a0 tx=0x7f981c004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1fcd181b264a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9811ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b6070 con 0x55f22560ae80 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f981c0a2000 con 0x55f22560ae80 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f982400f040 con 0x55f22560ae80 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981c098010 con 0x55f22560ae80 2023-10-08T13:28:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f983cd7db80 10 client.15993 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f2253882b0 con 0x55f22560ae80 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.411+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982400f040 con 0x55f22560ae80 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f981c0991f0 con 0x55f22560ae80 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 10 client.15993 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 10 client.15993 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 20 client.15993 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f22567af20 0x55f22567d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 4 client.15993 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f225557b30 con 0x55f22567af20 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f9829d9b700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f22567af20 0x55f22567d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f9811ffb700 10 client.15993 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.412+0000 7f9829d9b700 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f22567af20 0x55f22567d340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bce1fcca3db86d8 server_cookie=7b1cf46567705c5e in_seq=0 out_seq=0 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9811ffb700 1 -- 172.21.15.139:0/2484822340 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f225557b30 con 0x55f22567af20 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9811ffb700 10 client.15993 handle_command_reply: tid=0 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 client.15993 shutdown 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 msgr2=0x55f22561af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f981c0074a0 tx=0x7f981c004680 comp rx=0 tx=0).stop 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 shutdown_connections 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f225616650 0x55f225678fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f22560ae80 0x55f22561af30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55f22567af20 0x55f22567d340 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 --2- 172.21.15.139:0/2484822340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f22560b7a0 0x55f22561b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 >> 172.21.15.139:0/2484822340 conn(0x55f225580260 msgr2=0x55f225611860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9811ffb700 0 client.15993 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 shutdown_connections 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 1 -- 172.21.15.139:0/2484822340 wait complete. 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f983cd7db80 20 client.15993 trim_cache size 0 max 16384 2023-10-08T13:28:00.420 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 msgr2=0x7f98140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 0x7f98140a3a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f982000b5c0 tx=0x7f9820005fb0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 msgr2=0x7f982c197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f981c00c970 tx=0x7f981c00cc80 comp rx=0 tx=0).stop 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 shutdown_connections 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98140a1560 0x7f98140a3a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f982c1056b0 0x7f982c1a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f982c0ff620 0x7f982c197950 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 --2- 172.21.15.139:0/1130961376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c0fffe0 0x7f982c197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.413+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 >> 172.21.15.139:0/1130961376 conn(0x7f982c076780 msgr2=0x7f982c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.414+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 shutdown_connections 2023-10-08T13:28:00.422 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.414+0000 7f9830b94700 1 -- 172.21.15.139:0/1130961376 wait complete. 2023-10-08T13:28:00.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T13:28:00.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 -- 172.21.15.139:0/2887376796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 msgr2=0x7f993c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 --2- 172.21.15.139:0/2887376796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c106b10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9938009990 tx=0x7f9938009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 -- 172.21.15.139:0/2887376796 shutdown_connections 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 --2- 172.21.15.139:0/2887376796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 0x7f993c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 --2- 172.21.15.139:0/2887376796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c106b10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 --2- 172.21.15.139:0/2887376796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 0x7f993c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.552+0000 7f9943fe5700 1 -- 172.21.15.139:0/2887376796 >> 172.21.15.139:0/2887376796 conn(0x7f993c0fc230 msgr2=0x7f993c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- 172.21.15.139:0/2887376796 shutdown_connections 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- 172.21.15.139:0/2887376796 wait complete. 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 Processor -- start 2023-10-08T13:28:00.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- start start 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 0x7f993c19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 0x7f993c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c197010 con 0x7f993c106730 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c197180 con 0x7f993c100720 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.553+0000 7f9943fe5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c197340 con 0x7f993c1010e0 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40706/0 (socket says 172.21.15.139:40706) 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 -- 172.21.15.139:0/3664489278 learned_addr learned my addr 172.21.15.139:0/3664489278 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9941580700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 0x7f993c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9941d81700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 0x7f993c19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 -- 172.21.15.139:0/3664489278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 msgr2=0x7f993c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 0x7f993c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 -- 172.21.15.139:0/3664489278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 msgr2=0x7f993c19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 0x7f993c19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 -- 172.21.15.139:0/3664489278 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380095f0 con 0x7f993c106730 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9942582700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f993400ef30 tx=0x7f993400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9932ffd700 1 -- 172.21.15.139:0/3664489278 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9934018070 con 0x7f993c106730 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c1975c0 con 0x7f993c106730 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9932ffd700 1 -- 172.21.15.139:0/3664489278 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f993400f040 con 0x7f993c106730 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9932ffd700 1 -- 172.21.15.139:0/3664489278 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400cd00 con 0x7f993c106730 2023-10-08T13:28:00.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.554+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c1a3870 con 0x7f993c106730 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.557+0000 7f9932ffd700 1 -- 172.21.15.139:0/3664489278 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f9934003a00 con 0x7f993c106730 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.557+0000 7f9932ffd700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 0x7f99280a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.557+0000 7f9932ffd700 1 -- 172.21.15.139:0/3664489278 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f99340cce10 con 0x7f993c106730 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.557+0000 7f9941d81700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 0x7f99280a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.558+0000 7f9941d81700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 0x7f99280a3a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99380098e0 tx=0x7f9938005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.558+0000 7f99501ceb80 1 Processor -- start 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.558+0000 7f99501ceb80 1 -- start start 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b399260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b302460 con 0x558b2b3997a0 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b2f3c20 con 0x558b2b398e80 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f99501ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b2f1540 con 0x558b2b3a4650 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40712/0 (socket says 172.21.15.139:40712) 2023-10-08T13:28:00.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 -- 172.21.15.139:0/917102429 learned_addr learned my addr 172.21.15.139:0/917102429 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941d81700 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b399260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9942582700 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 -- 172.21.15.139:0/917102429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 msgr2=0x558b2b3a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 -- 172.21.15.139:0/917102429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 msgr2=0x558b2b399260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b399260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 -- 172.21.15.139:0/917102429 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2b117de0 con 0x558b2b3997a0 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9941580700 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f992c009d20 tx=0x7f992c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f24a75c623d69e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9927fff700 1 -- 172.21.15.139:0/917102429 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c019630 con 0x558b2b3997a0 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9927fff700 1 -- 172.21.15.139:0/917102429 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c019c50 con 0x558b2b3997a0 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.559+0000 7f9927fff700 1 -- 172.21.15.139:0/917102429 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00ebd0 con 0x558b2b3997a0 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 -- 172.21.15.139:0/917102429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 msgr2=0x558b2b3a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f992c009d20 tx=0x7f992c011720 comp rx=0 tx=0).stop 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 -- 172.21.15.139:0/917102429 shutdown_connections 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b399260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 --2- 172.21.15.139:0/917102429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a4110 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 -- 172.21.15.139:0/917102429 >> 172.21.15.139:0/917102429 conn(0x558b2b30e260 msgr2=0x558b2b3952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 -- 172.21.15.139:0/917102429 shutdown_connections 2023-10-08T13:28:00.570 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.560+0000 7f99501ceb80 1 -- 172.21.15.139:0/917102429 wait complete. 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 -- start start 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 Processor -- start 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b3a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b2ece30 con 0x558b2b3997a0 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b289710 con 0x558b2b398e80 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b2893b0 con 0x558b2b3a4650 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f99501ceb80 10 client.0 _ll_register_callbacks cb 0x558b2b0e6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.561+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40718/0 (socket says 172.21.15.139:40718) 2023-10-08T13:28:00.571 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 -- 172.21.15.139:0/1229146583 learned_addr learned my addr 172.21.15.139:0/1229146583 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9942582700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 -- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 msgr2=0x558b2b3a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 -- 172.21.15.139:0/1229146583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 msgr2=0x558b2b3a4050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b3a4050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 -- 172.21.15.139:0/1229146583 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c009980 con 0x558b2b3997a0 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f9941580700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f992c01c040 tx=0x7f992c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe4d3f7309e02f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.572 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99257fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c019840 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b2b2b4eb0 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f992c019dc0 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f992c005ce0 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99501ceb80 10 client.16005 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.562+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558b2b100c60 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b2b2b4eb0 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f992c0053a0 con 0x558b2b3997a0 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 10 client.16005 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 10 client.16005 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 20 client.16005 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b3b4080 0x558b2b3b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.573 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 4 client.16005 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b2b2e5e10 con 0x558b2b3b4080 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.563+0000 7f9941d81700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b3b4080 0x558b2b3b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99257fa700 10 client.16005 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f9941d81700 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b3b4080 0x558b2b3b64a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1e96d893086e762b server_cookie=f82c61c5f2e065ef in_seq=0 out_seq=0 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99257fa700 1 -- 172.21.15.139:0/1229146583 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b2b2e5e10 con 0x558b2b3b4080 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99257fa700 10 client.16005 handle_command_reply: tid=0 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 client.16005 shutdown 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 msgr2=0x558b2b3a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f992c01c040 tx=0x7f992c00ee80 comp rx=0 tx=0).stop 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 shutdown_connections 2023-10-08T13:28:00.574 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b3b4080 0x558b2b3b64a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b3a4650 0x558b2b3a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99257fa700 0 client.16005 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b398e80 0x558b2b3a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1229146583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3a1390 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.564+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 >> 172.21.15.139:0/1229146583 conn(0x558b2b30e260 msgr2=0x558b2b394ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.565+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 shutdown_connections 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.565+0000 7f99501ceb80 1 -- 172.21.15.139:0/1229146583 wait complete. 2023-10-08T13:28:00.575 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.565+0000 7f99501ceb80 20 client.16005 trim_cache size 0 max 16384 2023-10-08T13:28:00.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 Processor -- start 2023-10-08T13:28:00.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 -- start start 2023-10-08T13:28:00.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b39bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3a4650 0x558b2b394c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b16d920 con 0x558b2b3997a0 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b3ab750 con 0x558b2b3a4650 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f99501ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b399c00 con 0x558b2b398e80 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f9941580700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40726/0 (socket says 172.21.15.139:40726) 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.590+0000 7f9941580700 1 -- 172.21.15.139:0/1156547339 learned_addr learned my addr 172.21.15.139:0/1156547339 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941d81700 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b39bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9942582700 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3a4650 0x558b2b394c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 -- 172.21.15.139:0/1156547339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 msgr2=0x558b2b39bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b39bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 -- 172.21.15.139:0/1156547339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3a4650 msgr2=0x558b2b394c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3a4650 0x558b2b394c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 -- 172.21.15.139:0/1156547339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2b13e250 con 0x558b2b3997a0 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9941580700 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f992c0092a0 tx=0x7f992c005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bfa2e761c6b87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9930ff9700 1 -- 172.21.15.139:0/1156547339 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c011b20 con 0x558b2b3997a0 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9930ff9700 1 -- 172.21.15.139:0/1156547339 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c019dc0 con 0x558b2b3997a0 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.591+0000 7f9930ff9700 1 -- 172.21.15.139:0/1156547339 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0042d0 con 0x558b2b3997a0 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 -- 172.21.15.139:0/1156547339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 msgr2=0x558b2b3ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f992c0092a0 tx=0x7f992c005a00 comp rx=0 tx=0).stop 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 -- 172.21.15.139:0/1156547339 shutdown_connections 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3a4650 0x558b2b394c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b39bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 --2- 172.21.15.139:0/1156547339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3997a0 0x558b2b3ab1a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 -- 172.21.15.139:0/1156547339 >> 172.21.15.139:0/1156547339 conn(0x558b2b30e260 msgr2=0x558b2b39fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 -- 172.21.15.139:0/1156547339 shutdown_connections 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.592+0000 7f99501ceb80 1 -- 172.21.15.139:0/1156547339 wait complete. 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 -- start start 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 Processor -- start 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 0x558b2b3a9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b3a9d80 con 0x558b2b3a4650 2023-10-08T13:28:00.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b3a9ef0 con 0x558b2b3997a0 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b3aa0b0 con 0x558b2b398e80 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f99501ceb80 10 client.0 _ll_register_callbacks cb 0x7f9938005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9942582700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9941d81700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9942582700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40734/0 (socket says 172.21.15.139:40734) 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9942582700 1 -- 172.21.15.139:0/3022035145 learned_addr learned my addr 172.21.15.139:0/3022035145 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9941d81700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40446/0 (socket says 172.21.15.139:40446) 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.593+0000 7f9941580700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 0x558b2b3a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 -- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 msgr2=0x558b2b3aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 -- 172.21.15.139:0/3022035145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 msgr2=0x558b2b3a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 0x558b2b3a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 -- 172.21.15.139:0/3022035145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b2b100c60 con 0x558b2b3a4650 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9941580700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 0x558b2b3a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9941d81700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f9942582700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f99340960b0 tx=0x7f993401b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d052bf4d0fd3196f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99257fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400ce60 con 0x558b2b3a4650 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f992c019c50 con 0x558b2b3a4650 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9934099c00 con 0x558b2b3a4650 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f993409dd50 con 0x558b2b3a4650 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99501ceb80 10 client.16011 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558b2b1162b0 con 0x558b2b3a4650 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.594+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f992c019c50 con 0x558b2b3a4650 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99340652a0 con 0x558b2b3a4650 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 10 client.16011 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 10 client.16011 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 20 client.16011 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b4092e0 0x558b2b40b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 4 client.16011 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558b2b2e5b30 con 0x558b2b4092e0 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f9941d81700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b4092e0 0x558b2b40b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99257fa700 10 client.16011 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f9941d81700 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b4092e0 0x558b2b40b700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d48151e39a4c80ba server_cookie=2351876cedde5263 in_seq=0 out_seq=0 2023-10-08T13:28:00.605 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99257fa700 1 -- 172.21.15.139:0/3022035145 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558b2b2e5b30 con 0x558b2b4092e0 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99257fa700 10 client.16011 handle_command_reply: tid=0 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.595+0000 7f99501ceb80 1 client.16011 shutdown 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 msgr2=0x558b2b3a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f99340960b0 tx=0x7f993401b320 comp rx=0 tx=0).stop 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 shutdown_connections 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x558b2b4092e0 0x558b2b40b700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b2b3a4650 0x558b2b3a9840 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b2b398e80 0x558b2b3aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99257fa700 0 client.16011 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 --2- 172.21.15.139:0/3022035145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b2b3997a0 0x558b2b3a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 >> 172.21.15.139:0/3022035145 conn(0x558b2b30e260 msgr2=0x558b2b394b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.606 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 shutdown_connections 2023-10-08T13:28:00.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 1 -- 172.21.15.139:0/3022035145 wait complete. 2023-10-08T13:28:00.607 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f99501ceb80 20 client.16011 trim_cache size 0 max 16384 2023-10-08T13:28:00.607 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 msgr2=0x7f99280a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 0x7f99280a3a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99380098e0 tx=0x7f9938005960 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 msgr2=0x7f993c1969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f993400ef30 tx=0x7f993400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.596+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 shutdown_connections 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f99280a1560 0x7f99280a3a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f993c106730 0x7f993c1969b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f993c100720 0x7f993c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 --2- 172.21.15.139:0/3664489278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f993c1010e0 0x7f993c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.608 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 >> 172.21.15.139:0/3664489278 conn(0x7f993c0fc230 msgr2=0x7f993c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 shutdown_connections 2023-10-08T13:28:00.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.597+0000 7f9943fe5700 1 -- 172.21.15.139:0/3664489278 wait complete. 2023-10-08T13:28:00.609 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:28:00.246+0000 7f81a53d4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:28:00.609 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:28:00.246+0000 7f81a53d4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:28:00.609 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:28:00.246+0000 7f81a53d4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:28:00.609 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:28:00.246+0000 7f81a53d4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:28:00.609 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:28:00.246+0000 7f81a53d4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T13:28:00.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T13:28:00.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 -- 172.21.15.139:0/356207155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8430106730 msgr2=0x7f8430106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 --2- 172.21.15.139:0/356207155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8430106730 0x7f8430106b10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8424009990 tx=0x7f8424009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 -- 172.21.15.139:0/356207155 shutdown_connections 2023-10-08T13:28:00.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 --2- 172.21.15.139:0/356207155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84301010e0 0x7f843010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 --2- 172.21.15.139:0/356207155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8430106730 0x7f8430106b10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 --2- 172.21.15.139:0/356207155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 0x7f8430100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 -- 172.21.15.139:0/356207155 >> 172.21.15.139:0/356207155 conn(0x7f84300fc230 msgr2=0x7f84300fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 -- 172.21.15.139:0/356207155 shutdown_connections 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 -- 172.21.15.139:0/356207155 wait complete. 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.739+0000 7f8436d88700 1 Processor -- start 2023-10-08T13:28:00.744 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 -- start start 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 0x7f8430072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8430106730 0x7f8430073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301a4ef0 con 0x7f84301010e0 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301a5060 con 0x7f8430106730 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8436d88700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84301a5220 con 0x7f8430100720 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.745 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40744/0 (socket says 172.21.15.139:40744) 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 -- 172.21.15.139:0/690422959 learned_addr learned my addr 172.21.15.139:0/690422959 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8435325700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8430106730 0x7f8430073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f8434b24700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 0x7f8430072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 -- 172.21.15.139:0/690422959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 msgr2=0x7f8430072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 0x7f8430072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 -- 172.21.15.139:0/690422959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8430106730 msgr2=0x7f8430073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8430106730 0x7f8430073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.746 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 -- 172.21.15.139:0/690422959 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240095f0 con 0x7f84301010e0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.740+0000 7f842ffff700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c9b0 tx=0x7f841c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.741+0000 7f842dffb700 1 -- 172.21.15.139:0/690422959 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c007b00 con 0x7f84301010e0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.741+0000 7f842dffb700 1 -- 172.21.15.139:0/690422959 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f841c007c60 con 0x7f84301010e0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.741+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84301a5500 con 0x7f84301010e0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.741+0000 7f842dffb700 1 -- 172.21.15.139:0/690422959 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c018660 con 0x7f84301010e0 2023-10-08T13:28:00.747 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.741+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84301a5a10 con 0x7f84301010e0 2023-10-08T13:28:00.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.743+0000 7f842dffb700 1 -- 172.21.15.139:0/690422959 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f841c00f450 con 0x7f84301010e0 2023-10-08T13:28:00.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f842dffb700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 0x7f84200a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f8434b24700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 0x7f84200a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f842dffb700 1 -- 172.21.15.139:0/690422959 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f841c0cd300 con 0x7f84301010e0 2023-10-08T13:28:00.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f8434b24700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 0x7f84200a3a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8424006010 tx=0x7f842400b260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f8442f71b80 1 Processor -- start 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.744+0000 7f8442f71b80 1 -- start start 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755f7a0 0x5562e756a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e756a650 0x5562e756ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e74c8460 con 0x5562e755ee80 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e74b9c20 con 0x5562e756a650 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8442f71b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e74b7540 con 0x5562e755f7a0 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40750/0 (socket says 172.21.15.139:40750) 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 -- 172.21.15.139:0/2747103000 learned_addr learned my addr 172.21.15.139:0/2747103000 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f842ffff700 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755f7a0 0x5562e756a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8435325700 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e756a650 0x5562e756ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 -- 172.21.15.139:0/2747103000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755f7a0 msgr2=0x5562e756a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755f7a0 0x5562e756a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 -- 172.21.15.139:0/2747103000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e756a650 msgr2=0x5562e756ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e756a650 0x5562e756ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 -- 172.21.15.139:0/2747103000 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e72ddde0 con 0x5562e755ee80 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.745+0000 7f8434b24700 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8424005780 tx=0x7f842401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b55c5fb6b53c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.756 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f841affd700 1 -- 172.21.15.139:0/2747103000 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842402b070 con 0x5562e755ee80 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f841affd700 1 -- 172.21.15.139:0/2747103000 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f842401e040 con 0x5562e755ee80 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f841affd700 1 -- 172.21.15.139:0/2747103000 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424004e20 con 0x5562e755ee80 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 -- 172.21.15.139:0/2747103000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 msgr2=0x5562e755f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8424005780 tx=0x7f842401f000 comp rx=0 tx=0).stop 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 -- 172.21.15.139:0/2747103000 shutdown_connections 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e756a650 0x5562e756ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e755f260 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2747103000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755f7a0 0x5562e756a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 -- 172.21.15.139:0/2747103000 >> 172.21.15.139:0/2747103000 conn(0x5562e74d4260 msgr2=0x5562e755b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 -- 172.21.15.139:0/2747103000 shutdown_connections 2023-10-08T13:28:00.757 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.746+0000 7f8442f71b80 1 -- 172.21.15.139:0/2747103000 wait complete. 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 -- start start 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 Processor -- start 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755ee80 0x5562e756a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e7567920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e74b2e30 con 0x5562e755f7a0 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e744f710 con 0x5562e755ee80 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e744f3b0 con 0x5562e756a650 2023-10-08T13:28:00.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8442f71b80 10 client.0 _ll_register_callbacks cb 0x5562e72ac800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f842ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f842ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40758/0 (socket says 172.21.15.139:40758) 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f842ffff700 1 -- 172.21.15.139:0/440607259 learned_addr learned my addr 172.21.15.139:0/440607259 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.747+0000 7f8434b24700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755ee80 0x5562e756a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f8435325700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e7567920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 -- 172.21.15.139:0/440607259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 msgr2=0x5562e7567920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e7567920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 -- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755ee80 msgr2=0x5562e756a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755ee80 0x5562e756a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 -- 172.21.15.139:0/440607259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843010def0 con 0x5562e755f7a0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f842ffff700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f841c096ad0 tx=0x7f841c09a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8f43e3c72abd9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c09a060 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f841c0ade40 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562e747aeb0 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841c09e1b0 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f8442f71b80 10 client.16023 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5562e72c6c60 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562e747aeb0 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.748+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f841c09a2c0 con 0x5562e755f7a0 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 10 client.16023 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 20 client.16023 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.760 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e757a030 0x5562e757c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 4 client.16023 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562e74abe10 con 0x5562e757a030 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8434b24700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e757a030 0x5562e757c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f840ffff700 10 client.16023 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.749+0000 7f8434b24700 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e757a030 0x5562e757c450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72df25c164d4ac82 server_cookie=4205c00686ee1fb3 in_seq=0 out_seq=0 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f840ffff700 1 -- 172.21.15.139:0/440607259 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562e74abe10 con 0x5562e757a030 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f840ffff700 10 client.16023 handle_command_reply: tid=0 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 client.16023 shutdown 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 msgr2=0x5562e75672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f841c096ad0 tx=0x7f841c09a7d0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 shutdown_connections 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e757a030 0x5562e757c450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e7567920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755ee80 0x5562e756a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 --2- 172.21.15.139:0/440607259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755f7a0 0x5562e75672f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f840ffff700 0 client.16023 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 >> 172.21.15.139:0/440607259 conn(0x5562e74d4260 msgr2=0x5562e755aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 shutdown_connections 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 1 -- 172.21.15.139:0/440607259 wait complete. 2023-10-08T13:28:00.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.750+0000 7f8442f71b80 20 client.16023 trim_cache size 0 max 16384 2023-10-08T13:28:00.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 Processor -- start 2023-10-08T13:28:00.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 -- start start 2023-10-08T13:28:00.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e7566100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e755ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e756cea0 con 0x5562e755ee80 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e7333920 con 0x5562e755f7a0 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.763+0000 7f8442f71b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e7557ae0 con 0x5562e756a650 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40764/0 (socket says 172.21.15.139:40764) 2023-10-08T13:28:00.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 -- 172.21.15.139:0/2405479849 learned_addr learned my addr 172.21.15.139:0/2405479849 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f842ffff700 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e7566100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 -- 172.21.15.139:0/2405479849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 msgr2=0x5562e755ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.769 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e755ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 -- 172.21.15.139:0/2405479849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 msgr2=0x5562e7566100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e7566100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 -- 172.21.15.139:0/2405479849 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562e7304250 con 0x5562e755ee80 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f8434b24700 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f84240049f0 tx=0x7f8424004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03d602ad9f68f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f841b7fe700 1 -- 172.21.15.139:0/2405479849 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842402b040 con 0x5562e755ee80 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f841b7fe700 1 -- 172.21.15.139:0/2405479849 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8424028040 con 0x5562e755ee80 2023-10-08T13:28:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.764+0000 7f841b7fe700 1 -- 172.21.15.139:0/2405479849 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424004df0 con 0x5562e755ee80 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- 172.21.15.139:0/2405479849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 msgr2=0x5562e7565bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f84240049f0 tx=0x7f8424004a20 comp rx=0 tx=0).stop 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- 172.21.15.139:0/2405479849 shutdown_connections 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e756a650 0x5562e755ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e755ee80 0x5562e7565bc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 --2- 172.21.15.139:0/2405479849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e7566100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- 172.21.15.139:0/2405479849 >> 172.21.15.139:0/2405479849 conn(0x5562e74d4260 msgr2=0x5562e7562610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- 172.21.15.139:0/2405479849 shutdown_connections 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- 172.21.15.139:0/2405479849 wait complete. 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 -- start start 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.765+0000 7f8442f71b80 1 Processor -- start 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755ee80 0x5562e7564c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e75635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e75652e0 con 0x5562e756a650 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e7564060 con 0x5562e755f7a0 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562e7564220 con 0x5562e755ee80 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8442f71b80 10 client.0 _ll_register_callbacks cb 0x5562e72ac800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f842ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e75635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40774/0 (socket says 172.21.15.139:40774) 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 -- 172.21.15.139:0/1774023863 learned_addr learned my addr 172.21.15.139:0/1774023863 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8434b24700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755ee80 0x5562e7564c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 -- 172.21.15.139:0/1774023863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755ee80 msgr2=0x5562e7564c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755ee80 0x5562e7564c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 -- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 msgr2=0x5562e75635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e75635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f8435325700 1 -- 172.21.15.139:0/1774023863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562e72ddde0 con 0x5562e756a650 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.766+0000 7f842ffff700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e75635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8435325700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8428017ec0 tx=0x7f8428011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cad542c1c2e9070 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800e040 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8428009270 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f842401e040 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8428003a00 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 10 client.16029 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5562e72dc2b0 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f842401e040 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8428008440 con 0x5562e756a650 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 10 client.16029 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 20 client.16029 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e75cf230 0x5562e75d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 4 client.16029 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.767+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562e74abb30 con 0x5562e75cf230 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8434b24700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e75cf230 0x5562e75d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8434b24700 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e75cf230 0x5562e75d1650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76a09b7679ffecd server_cookie=3bdc0a99e7089f37 in_seq=0 out_seq=0 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f840ffff700 10 client.16029 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f840ffff700 1 -- 172.21.15.139:0/1774023863 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562e74abb30 con 0x5562e75cf230 2023-10-08T13:28:00.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f840ffff700 10 client.16029 handle_command_reply: tid=0 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 client.16029 shutdown 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 msgr2=0x5562e7563b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8428017ec0 tx=0x7f8428011700 comp rx=0 tx=0).stop 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 shutdown_connections 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5562e75cf230 0x5562e75d1650 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5562e756a650 0x5562e7563b20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f840ffff700 0 client.16029 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5562e755ee80 0x5562e7564c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 --2- 172.21.15.139:0/1774023863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5562e755f7a0 0x5562e75635e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.768+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 >> 172.21.15.139:0/1774023863 conn(0x5562e74d4260 msgr2=0x5562e7565ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 shutdown_connections 2023-10-08T13:28:00.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8442f71b80 1 -- 172.21.15.139:0/1774023863 wait complete. 2023-10-08T13:28:00.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8442f71b80 20 client.16029 trim_cache size 0 max 16384 2023-10-08T13:28:00.781 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:00.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 msgr2=0x7f84200a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 0x7f84200a3a20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8424006010 tx=0x7f842400b260 comp rx=0 tx=0).stop 2023-10-08T13:28:00.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 msgr2=0x7f8430073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c9b0 tx=0x7f841c00ccc0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 shutdown_connections 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f84200a1560 0x7f84200a3a20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8430106730 0x7f8430073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8430100720 0x7f8430072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 --2- 172.21.15.139:0/690422959 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84301010e0 0x7f8430073030 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.769+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 >> 172.21.15.139:0/690422959 conn(0x7f84300fc230 msgr2=0x7f84300fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.770+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 shutdown_connections 2023-10-08T13:28:00.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.770+0000 7f8436d88700 1 -- 172.21.15.139:0/690422959 wait complete. 2023-10-08T13:28:00.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T13:28:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 -- 172.21.15.139:0/4026231534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c072bc0 msgr2=0x7fa97c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 --2- 172.21.15.139:0/4026231534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c072bc0 0x7fa97c072fa0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009990 tx=0x7fa96c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 -- 172.21.15.139:0/4026231534 shutdown_connections 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 --2- 172.21.15.139:0/4026231534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c10cfe0 0x7fa97c10f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 --2- 172.21.15.139:0/4026231534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c072bc0 0x7fa97c072fa0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 --2- 172.21.15.139:0/4026231534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c10caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 -- 172.21.15.139:0/4026231534 >> 172.21.15.139:0/4026231534 conn(0x7fa97c0fc230 msgr2=0x7fa97c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 -- 172.21.15.139:0/4026231534 shutdown_connections 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.917+0000 7fa980bd6700 1 -- 172.21.15.139:0/4026231534 wait complete. 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 Processor -- start 2023-10-08T13:28:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 -- start start 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 0x7fa97c198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c19dd10 con 0x7fa97c10cfe0 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c19de80 con 0x7fa97c0734e0 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.918+0000 7fa980bd6700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c19e040 con 0x7fa97c072bc0 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40788/0 (socket says 172.21.15.139:40788) 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 -- 172.21.15.139:0/3081704108 learned_addr learned my addr 172.21.15.139:0/3081704108 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa979d9b700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97a59c700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 0x7fa97c198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 -- 172.21.15.139:0/3081704108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 msgr2=0x7fa97c198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 0x7fa97c198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 -- 172.21.15.139:0/3081704108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 msgr2=0x7fa97c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 -- 172.21.15.139:0/3081704108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0095f0 con 0x7fa97c10cfe0 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa979d9b700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97a59c700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 0x7fa97c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa974007d40 tx=0x7fa97400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa96b7fe700 1 -- 172.21.15.139:0/3081704108 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97400ad40 con 0x7fa97c10cfe0 2023-10-08T13:28:00.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c19e320 con 0x7fa97c10cfe0 2023-10-08T13:28:00.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa96b7fe700 1 -- 172.21.15.139:0/3081704108 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9740128e0 con 0x7fa97c10cfe0 2023-10-08T13:28:00.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa96b7fe700 1 -- 172.21.15.139:0/3081704108 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974011820 con 0x7fa97c10cfe0 2023-10-08T13:28:00.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.919+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c1a5b60 con 0x7fa97c10cfe0 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.922+0000 7fa96b7fe700 1 -- 172.21.15.139:0/3081704108 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7fa974012420 con 0x7fa97c10cfe0 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 Processor -- start 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 -- start start 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa96b7fe700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 0x7fa9640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e66260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e71110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3dcf460 con 0x55e1f3e71650 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3dc0c20 con 0x55e1f3e65e80 2023-10-08T13:28:00.931 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3dbe540 con 0x55e1f3e667a0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa979d9b700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 0x7fa9640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa96b7fe700 1 -- 172.21.15.139:0/3081704108 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa9740cd510 con 0x7fa97c10cfe0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40796/0 (socket says 172.21.15.139:40796) 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4111018598 learned_addr learned my addr 172.21.15.139:0/4111018598 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.923+0000 7fa979d9b700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e71110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e66260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4111018598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 msgr2=0x55e1f3e71110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e71110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4111018598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 msgr2=0x55e1f3e66260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e66260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4111018598 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f3be4de0 con 0x55e1f3e71650 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e66260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa979d9b700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 0x7fa9640a3a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa97c19a340 tx=0x7fa97000b740 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa97400afd0 tx=0x7fa97409a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35110d8e10de4ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa968ff9700 1 -- 172.21.15.139:0/4111018598 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974019310 con 0x55e1f3e71650 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa968ff9700 1 -- 172.21.15.139:0/4111018598 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa97409aa80 con 0x55e1f3e71650 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.924+0000 7fa968ff9700 1 -- 172.21.15.139:0/4111018598 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974012dc0 con 0x55e1f3e71650 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4111018598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 msgr2=0x55e1f3e73a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa97400afd0 tx=0x7fa97409a280 comp rx=0 tx=0).stop 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4111018598 shutdown_connections 2023-10-08T13:28:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e73a40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e66260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4111018598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e71110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4111018598 >> 172.21.15.139:0/4111018598 conn(0x55e1f3ddb260 msgr2=0x55e1f3e622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4111018598 shutdown_connections 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4111018598 wait complete. 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- start start 2023-10-08T13:28:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 Processor -- start 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 0x55e1f3e71040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e667a0 0x55e1f3e6e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3db9e30 con 0x55e1f3e71650 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.925+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3d56710 con 0x55e1f3e667a0 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3d563b0 con 0x55e1f3e65e80 2023-10-08T13:28:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa98cdbfb80 10 client.0 _ll_register_callbacks cb 0x55e1f3bb3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40802/0 (socket says 172.21.15.139:40802) 2023-10-08T13:28:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4203664770 learned_addr learned my addr 172.21.15.139:0/4203664770 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 0x55e1f3e71040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa979d9b700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e667a0 0x55e1f3e6e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 msgr2=0x55e1f3e71040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 0x55e1f3e71040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4203664770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e667a0 msgr2=0x55e1f3e6e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e667a0 0x55e1f3e6e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 -- 172.21.15.139:0/4203664770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c1a5b60 con 0x55e1f3e71650 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 0x55e1f3e71040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:00.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa974007d10 tx=0x7fa97409a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd6f02c4909f9a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa961ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97409e170 con 0x55e1f3e71650 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa9740b2e40 con 0x55e1f3e71650 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1f3d81eb0 con 0x55e1f3e71650 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa97409e2d0 con 0x55e1f3e71650 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa98cdbfb80 10 client.16041 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.926+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e1f3bcdc60 con 0x55e1f3e71650 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e1f3d81eb0 con 0x55e1f3e71650 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa9740b2020 con 0x55e1f3e71650 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 10 client.16041 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 10 client.16041 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 20 client.16041 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3e80d60 0x55e1f3e83180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 4 client.16041 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1f3db2e10 con 0x55e1f3e80d60 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3e80d60 0x55e1f3e83180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa97a59c700 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3e80d60 0x55e1f3e83180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4fb942bed8e0f24 server_cookie=42c5d559095d81d1 in_seq=0 out_seq=0 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.927+0000 7fa961ffb700 10 client.16041 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa961ffb700 1 -- 172.21.15.139:0/4203664770 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e1f3db2e10 con 0x55e1f3e80d60 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa961ffb700 10 client.16041 handle_command_reply: tid=0 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 client.16041 shutdown 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 msgr2=0x55e1f3e6e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa974007d10 tx=0x7fa97409a430 comp rx=0 tx=0).stop 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 shutdown_connections 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e6e940 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3e80d60 0x55e1f3e83180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e65e80 0x55e1f3e71040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/4203664770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e667a0 0x55e1f3e6e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa961ffb700 0 client.16041 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 >> 172.21.15.139:0/4203664770 conn(0x55e1f3ddb260 msgr2=0x55e1f3e61ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 shutdown_connections 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.928+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/4203664770 wait complete. 2023-10-08T13:28:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.929+0000 7fa98cdbfb80 20 client.16041 trim_cache size 0 max 16384 2023-10-08T13:28:00.941 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:00 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2955049534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 Processor -- start 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 -- start start 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e7d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3c3a920 con 0x55e1f3e71650 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3e5eb10 con 0x55e1f3e65e80 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3e66660 con 0x55e1f3e667a0 2023-10-08T13:28:00.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40810/0 (socket says 172.21.15.139:40810) 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97ad9d700 1 -- 172.21.15.139:0/1961380485 learned_addr learned my addr 172.21.15.139:0/1961380485 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97a59c700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa979d9b700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e7d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97ad9d700 1 -- 172.21.15.139:0/1961380485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 msgr2=0x55e1f3e7d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.942+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e7d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa97ad9d700 1 -- 172.21.15.139:0/1961380485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 msgr2=0x55e1f3e781a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e781a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa97ad9d700 1 -- 172.21.15.139:0/1961380485 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1f3e87d90 con 0x55e1f3e71650 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa97a59c700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa9740cafe0 tx=0x7fa9740967f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d0f735dce8800d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa9697fa700 1 -- 172.21.15.139:0/1961380485 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740cd170 con 0x55e1f3e71650 2023-10-08T13:28:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa9697fa700 1 -- 172.21.15.139:0/1961380485 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa974007a70 con 0x55e1f3e71650 2023-10-08T13:28:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.943+0000 7fa9697fa700 1 -- 172.21.15.139:0/1961380485 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740cabf0 con 0x55e1f3e71650 2023-10-08T13:28:00.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1961380485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 msgr2=0x55e1f3e70b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.949 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa9740cafe0 tx=0x7fa9740967f0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1961380485 shutdown_connections 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e71650 0x55e1f3e70b70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e65e80 0x55e1f3e781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1961380485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e7d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1961380485 >> 172.21.15.139:0/1961380485 conn(0x55e1f3ddb260 msgr2=0x55e1f3e7c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1961380485 shutdown_connections 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1961380485 wait complete. 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- start start 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 Processor -- start 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.950 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e76440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e71650 0x55e1f3e76980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3e77070 con 0x55e1f3e65e80 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3e771e0 con 0x55e1f3e71650 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.944+0000 7fa98cdbfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1f3ed4b80 con 0x55e1f3e667a0 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa98cdbfb80 10 client.0 _ll_register_callbacks cb 0x7fa974099f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40812/0 (socket says 172.21.15.139:40812) 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 -- 172.21.15.139:0/1630847002 learned_addr learned my addr 172.21.15.139:0/1630847002 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:00.951 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97ad9d700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e71650 0x55e1f3e76980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa979d9b700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e76440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 -- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 msgr2=0x55e1f3e76440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e76440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 -- 172.21.15.139:0/1630847002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e71650 msgr2=0x55e1f3e76980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e71650 0x55e1f3e76980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 -- 172.21.15.139:0/1630847002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1f3bcdc60 con 0x55e1f3e65e80 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa979d9b700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e76440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa97a59c700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009990 tx=0x7fa96c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfc83b022632bff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa961ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c025990 con 0x55e1f3e65e80 2023-10-08T13:28:00.952 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa97409aa80 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa96c025af0 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa96c025cd0 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa98cdbfb80 10 client.16047 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.945+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e1f3c0b250 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa97409aa80 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa96c003a60 con 0x55e1f3e65e80 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 10 client.16047 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 10 client.16047 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 20 client.16047 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3ed6320 0x55e1f3ed8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 4 client.16047 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:00.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e1f3db2b30 con 0x55e1f3ed6320 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.946+0000 7fa979d9b700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3ed6320 0x55e1f3ed8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa961ffb700 10 client.16047 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa979d9b700 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3ed6320 0x55e1f3ed8740 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6288efd00e4e6f71 server_cookie=1b8c2f28b2a7fac3 in_seq=0 out_seq=0 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa961ffb700 1 -- 172.21.15.139:0/1630847002 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e1f3db2b30 con 0x55e1f3ed6320 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa961ffb700 10 client.16047 handle_command_reply: tid=0 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 client.16047 shutdown 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 msgr2=0x55e1f3e78070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009990 tx=0x7fa96c009f90 comp rx=0 tx=0).stop 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 shutdown_connections 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e1f3e71650 0x55e1f3e76980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e1f3e65e80 0x55e1f3e78070 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55e1f3ed6320 0x55e1f3ed8740 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 --2- 172.21.15.139:0/1630847002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e1f3e667a0 0x55e1f3e76440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa961ffb700 0 client.16047 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 >> 172.21.15.139:0/1630847002 conn(0x55e1f3ddb260 msgr2=0x55e1f3e7d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 shutdown_connections 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 1 -- 172.21.15.139:0/1630847002 wait complete. 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.947+0000 7fa98cdbfb80 20 client.16047 trim_cache size 0 max 16384 2023-10-08T13:28:00.955 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 msgr2=0x7fa9640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 0x7fa9640a3a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa97c19a340 tx=0x7fa97000b740 comp rx=0 tx=0).stop 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 msgr2=0x7fa97c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa974007d40 tx=0x7fa97400a340 comp rx=0 tx=0).stop 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 shutdown_connections 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa9640a1560 0x7fa9640a3a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa97c10cfe0 0x7fa97c19d6d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa97c072bc0 0x7fa97c198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 --2- 172.21.15.139:0/3081704108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa97c0734e0 0x7fa97c199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:00.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 >> 172.21.15.139:0/3081704108 conn(0x7fa97c0fc230 msgr2=0x7fa97c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:00.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 shutdown_connections 2023-10-08T13:28:00.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:00.948+0000 7fa980bd6700 1 -- 172.21.15.139:0/3081704108 wait complete. 2023-10-08T13:28:00.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:28:00.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:00 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2955049534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 -- 172.21.15.139:0/1377782577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8106750 msgr2=0x7f2af8106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/1377782577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8106750 0x7f2af8106b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009990 tx=0x7f2ae8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 -- 172.21.15.139:0/1377782577 shutdown_connections 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/1377782577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8101100 0x7f2af810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/1377782577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8106750 0x7f2af8106b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/1377782577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8100740 0x7f2af8100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 -- 172.21.15.139:0/1377782577 >> 172.21.15.139:0/1377782577 conn(0x7f2af80fc230 msgr2=0x7f2af80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 -- 172.21.15.139:0/1377782577 shutdown_connections 2023-10-08T13:28:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.088+0000 7f2afcb5a700 1 -- 172.21.15.139:0/1377782577 wait complete. 2023-10-08T13:28:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 Processor -- start 2023-10-08T13:28:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 -- start start 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8100740 0x7f2af819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8101100 0x7f2af819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8196fc0 con 0x7f2af8106750 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8197130 con 0x7f2af8100740 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.089+0000 7f2afcb5a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af81972f0 con 0x7f2af8101100 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40830/0 (socket says 172.21.15.139:40830) 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 -- 172.21.15.139:0/3644558135 learned_addr learned my addr 172.21.15.139:0/3644558135 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af659c700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8100740 0x7f2af819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8101100 0x7f2af819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 -- 172.21.15.139:0/3644558135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8101100 msgr2=0x7f2af819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8101100 0x7f2af819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 -- 172.21.15.139:0/3644558135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8100740 msgr2=0x7f2af819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8100740 0x7f2af819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 -- 172.21.15.139:0/3644558135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80095f0 con 0x7f2af8106750 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ef30 tx=0x7f2af000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2ae77fe700 1 -- 172.21.15.139:0/3644558135 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0018070 con 0x7f2af8106750 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2ae77fe700 1 -- 172.21.15.139:0/3644558135 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x7f2af8106750 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af8197570 con 0x7f2af8106750 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2ae77fe700 1 -- 172.21.15.139:0/3644558135 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000cdb0 con 0x7f2af8106750 2023-10-08T13:28:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.090+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af81a3820 con 0x7f2af8106750 2023-10-08T13:28:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.092+0000 7f2ae77fe700 1 -- 172.21.15.139:0/3644558135 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) v1 ==== 136078+0+0 (secure 0 0 0) 0x7f2af0003a00 con 0x7f2af8106750 2023-10-08T13:28:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.093+0000 7f2ae77fe700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 0x7f2ae00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.093+0000 7f2af659c700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 0x7f2ae00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.093+0000 7f2ae77fe700 1 -- 172.21.15.139:0/3644558135 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2af00cce80 con 0x7f2af8106750 2023-10-08T13:28:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.094+0000 7f2af659c700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 0x7f2ae00a3a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b2e0 tx=0x7f2ae8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 Processor -- start 2023-10-08T13:28:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:00 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2955049534' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:01.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 -- start start 2023-10-08T13:28:01.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b36e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.104 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b2d7460 con 0x557a3b36e7a0 2023-10-08T13:28:01.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b2c8c20 con 0x557a3b379650 2023-10-08T13:28:01.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b2c6540 con 0x557a3b36de80 2023-10-08T13:28:01.105 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40836/0 (socket says 172.21.15.139:40836) 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1832064507 learned_addr learned my addr 172.21.15.139:0/1832064507 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.095+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af659c700 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b36e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1832064507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 msgr2=0x557a3b36e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.106 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b36e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1832064507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 msgr2=0x557a3b37ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1832064507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3b0ecde0 con 0x557a3b36e7a0 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009cb0 tx=0x7f2aec0113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47f62581c28dfe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2ae4ff9700 1 -- 172.21.15.139:0/1832064507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0097b0 con 0x557a3b36e7a0 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2ae4ff9700 1 -- 172.21.15.139:0/1832064507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2aec011c60 con 0x557a3b36e7a0 2023-10-08T13:28:01.107 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.096+0000 7f2ae4ff9700 1 -- 172.21.15.139:0/1832064507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00f7c0 con 0x557a3b36e7a0 2023-10-08T13:28:01.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1832064507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 msgr2=0x557a3b379110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009cb0 tx=0x7f2aec0113e0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1832064507 shutdown_connections 2023-10-08T13:28:01.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.108 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b36e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1832064507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b379110 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1832064507 >> 172.21.15.139:0/1832064507 conn(0x557a3b2e3260 msgr2=0x557a3b36a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1832064507 shutdown_connections 2023-10-08T13:28:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1832064507 wait complete. 2023-10-08T13:28:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.097+0000 7f2b08d43b80 1 -- start start 2023-10-08T13:28:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 Processor -- start 2023-10-08T13:28:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 0x557a3b379050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b376a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b2c1e30 con 0x557a3b36e7a0 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b25e710 con 0x557a3b36de80 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b25e3b0 con 0x557a3b379650 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2b08d43b80 10 client.0 _ll_register_callbacks cb 0x557a3b0bb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40844/0 (socket says 172.21.15.139:40844) 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1679678310 learned_addr learned my addr 172.21.15.139:0/1679678310 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b376a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af659c700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 0x557a3b379050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 msgr2=0x557a3b376a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b376a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1679678310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 msgr2=0x557a3b379050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 0x557a3b379050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 -- 172.21.15.139:0/1679678310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec009910 con 0x557a3b36e7a0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af659c700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 0x557a3b379050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.098+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014fd0 tx=0x7f2aec005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fd495317c0690a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec012450 con 0x557a3b36e7a0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2aec0125b0 con 0x557a3b36e7a0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a3b289eb0 con 0x557a3b36e7a0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aec012770 con 0x557a3b36e7a0 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 10 client.16059 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a3b0d5c60 con 0x557a3b36e7a0 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a3b289eb0 con 0x557a3b36e7a0 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2aec023430 con 0x557a3b36e7a0 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 10 client.16059 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 20 client.16059 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b388f10 0x557a3b38b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 4 client.16059 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.099+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a3b2bae10 con 0x557a3b388f10 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.100+0000 7f2af659c700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b388f10 0x557a3b38b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.100+0000 7f2af659c700 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b388f10 0x557a3b38b330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e53c89a83e0631a server_cookie=daf91ddc464de857 in_seq=0 out_seq=0 2023-10-08T13:28:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.100+0000 7f2addffb700 10 client.16059 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2addffb700 1 -- 172.21.15.139:0/1679678310 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a3b2bae10 con 0x557a3b388f10 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2addffb700 10 client.16059 handle_command_reply: tid=0 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 client.16059 shutdown 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 msgr2=0x557a3b376440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2aec014fd0 tx=0x7f2aec005ce0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 shutdown_connections 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b376a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b388f10 0x557a3b38b330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36de80 0x557a3b379050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2addffb700 0 client.16059 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/1679678310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b376440 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 >> 172.21.15.139:0/1679678310 conn(0x557a3b2e3260 msgr2=0x557a3b369ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 shutdown_connections 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 1 -- 172.21.15.139:0/1679678310 wait complete. 2023-10-08T13:28:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.101+0000 7f2b08d43b80 20 client.16059 trim_cache size 0 max 16384 2023-10-08T13:28:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 Processor -- start 2023-10-08T13:28:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 -- start start 2023-10-08T13:28:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36e7a0 0x557a3b3801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b3716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b142920 con 0x557a3b36de80 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b36f0d0 con 0x557a3b36e7a0 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.120+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b364570 con 0x557a3b379650 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40848/0 (socket says 172.21.15.139:40848) 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 -- 172.21.15.139:0/2887813473 learned_addr learned my addr 172.21.15.139:0/2887813473 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36e7a0 0x557a3b3801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b3716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 -- 172.21.15.139:0/2887813473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 msgr2=0x557a3b3716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b3716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 -- 172.21.15.139:0/2887813473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36e7a0 msgr2=0x557a3b3801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36e7a0 0x557a3b3801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 -- 172.21.15.139:0/2887813473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a3b113250 con 0x557a3b36de80 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2af659c700 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e0b8bf479b0c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2ae57fa700 1 -- 172.21.15.139:0/2887813473 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8035a90 con 0x557a3b36de80 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2ae57fa700 1 -- 172.21.15.139:0/2887813473 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ae801e040 con 0x557a3b36de80 2023-10-08T13:28:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.121+0000 7f2ae57fa700 1 -- 172.21.15.139:0/2887813473 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80049f0 con 0x557a3b36de80 2023-10-08T13:28:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- 172.21.15.139:0/2887813473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 msgr2=0x557a3b38b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae8020000 comp rx=0 tx=0).stop 2023-10-08T13:28:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- 172.21.15.139:0/2887813473 shutdown_connections 2023-10-08T13:28:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b379650 0x557a3b3716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36de80 0x557a3b38b300 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/2887813473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b36e7a0 0x557a3b3801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- 172.21.15.139:0/2887813473 >> 172.21.15.139:0/2887813473 conn(0x557a3b2e3260 msgr2=0x557a3b378e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- 172.21.15.139:0/2887813473 shutdown_connections 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- 172.21.15.139:0/2887813473 wait complete. 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.122+0000 7f2b08d43b80 1 -- start start 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 Processor -- start 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b37ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b37eda0 con 0x557a3b36e7a0 2023-10-08T13:28:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b37ef10 con 0x557a3b379650 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a3b37f0d0 con 0x557a3b36de80 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2b08d43b80 10 client.0 _ll_register_callbacks cb 0x7f2af0009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40856/0 (socket says 172.21.15.139:40856) 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 -- 172.21.15.139:0/845387753 learned_addr learned my addr 172.21.15.139:0/845387753 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af659c700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b37ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af6d9d700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 -- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 msgr2=0x557a3b37ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b37ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 -- 172.21.15.139:0/845387753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 msgr2=0x557a3b37e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 -- 172.21.15.139:0/845387753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af810df10 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af659c700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b37ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2af5d9b700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2aec011420 tx=0x7f2aec012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fe12b59304f549 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.123+0000 7f2addffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec023640 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2aec012450 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2aec011c60 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aec023bd0 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 10 client.16065 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a3b0eb2b0 con 0x557a3b36e7a0 2023-10-08T13:28:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2aec011c60 con 0x557a3b36e7a0 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2aec005450 con 0x557a3b36e7a0 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 20 client.16065 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b3dde40 0x557a3b3e0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 4 client.16065 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557a3b2bab30 con 0x557a3b3dde40 2023-10-08T13:28:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.124+0000 7f2af659c700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b3dde40 0x557a3b3e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2addffb700 10 client.16065 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2af659c700 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b3dde40 0x557a3b3e0260 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da631e8dd96717b server_cookie=ee5646a30b19592 in_seq=0 out_seq=0 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2addffb700 1 -- 172.21.15.139:0/845387753 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557a3b2bab30 con 0x557a3b3dde40 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2addffb700 10 client.16065 handle_command_reply: tid=0 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 client.16065 shutdown 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 msgr2=0x557a3b37e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2aec011420 tx=0x7f2aec012e40 comp rx=0 tx=0).stop 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 shutdown_connections 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557a3b3dde40 0x557a3b3e0260 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557a3b379650 0x557a3b37e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2addffb700 0 client.16065 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:01.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a3b36de80 0x557a3b37ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 --2- 172.21.15.139:0/845387753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557a3b36e7a0 0x557a3b37e320 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 >> 172.21.15.139:0/845387753 conn(0x557a3b2e3260 msgr2=0x557a3b3716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 shutdown_connections 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 1 -- 172.21.15.139:0/845387753 wait complete. 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.125+0000 7f2b08d43b80 20 client.16065 trim_cache size 0 max 16384 2023-10-08T13:28:01.134 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:01.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 msgr2=0x7f2ae00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 0x7f2ae00a3a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800b2e0 tx=0x7f2ae8005960 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 msgr2=0x7f2af8196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ef30 tx=0x7f2af000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 shutdown_connections 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2ae00a1560 0x7f2ae00a3a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2af8106750 0x7f2af8196960 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2af8100740 0x7f2af819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 --2- 172.21.15.139:0/3644558135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af8101100 0x7f2af819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 >> 172.21.15.139:0/3644558135 conn(0x7f2af80fc230 msgr2=0x7f2af80fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 shutdown_connections 2023-10-08T13:28:01.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:01.126+0000 7f2afcb5a700 1 -- 172.21.15.139:0/3644558135 wait complete. 2023-10-08T13:28:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:01 smithi187 ceph-mon[104336]: pgmap v315: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:28:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:01 smithi155 ceph-mon[103467]: pgmap v315: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:28:02.139 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:28:02.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:28:02.163 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:01 smithi139 ceph-mon[99506]: pgmap v315: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 9 op/s 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 -- 172.21.15.139:0/3301033527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 msgr2=0x7f7cb8106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3301033527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb8106b10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009990 tx=0x7f7ca8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 -- 172.21.15.139:0/3301033527 shutdown_connections 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3301033527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb81010e0 0x7f7cb810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3301033527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb8106b10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3301033527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb8100720 0x7f7cb8100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 -- 172.21.15.139:0/3301033527 >> 172.21.15.139:0/3301033527 conn(0x7f7cb80fc230 msgr2=0x7f7cb80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.272 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 -- 172.21.15.139:0/3301033527 shutdown_connections 2023-10-08T13:28:02.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.270+0000 7f7cbe323700 1 -- 172.21.15.139:0/3301033527 wait complete. 2023-10-08T13:28:02.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 Processor -- start 2023-10-08T13:28:02.273 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 -- start start 2023-10-08T13:28:02.274 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 0x7f7cb819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb81010e0 0x7f7cb819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8197050 con 0x7f7cb8106730 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81971c0 con 0x7f7cb81010e0 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbe323700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8197380 con 0x7f7cb8100720 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.271+0000 7f7cbc8c0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40872/0 (socket says 172.21.15.139:40872) 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/3127175707 learned_addr learned my addr 172.21.15.139:0/3127175707 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.275 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb81010e0 0x7f7cb819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 0x7f7cb819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/3127175707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 msgr2=0x7f7cb819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 0x7f7cb819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/3127175707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb81010e0 msgr2=0x7f7cb819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb81010e0 0x7f7cb819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/3127175707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80095f0 con 0x7f7cb8106730 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 0x7f7cb819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ef30 tx=0x7f7cb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb57fa700 1 -- 172.21.15.139:0/3127175707 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0018070 con 0x7f7cb8106730 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb57fa700 1 -- 172.21.15.139:0/3127175707 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cb000f040 con 0x7f7cb8106730 2023-10-08T13:28:02.276 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8197600 con 0x7f7cb8106730 2023-10-08T13:28:02.277 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cb57fa700 1 -- 172.21.15.139:0/3127175707 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000cdb0 con 0x7f7cb8106730 2023-10-08T13:28:02.277 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.272+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb81a38b0 con 0x7f7cb8106730 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.274+0000 7f7cb57fa700 1 -- 172.21.15.139:0/3127175707 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f7cb0004000 con 0x7f7cb8106730 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.275+0000 7f7cb57fa700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 0x7f7ca00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.275+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 0x7f7ca00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.275+0000 7f7cb57fa700 1 -- 172.21.15.139:0/3127175707 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7cb00cd040 con 0x7f7cb8106730 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.275+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 0x7f7ca00a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b2e0 tx=0x7f7ca8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 Processor -- start 2023-10-08T13:28:02.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 -- start start 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x55563053a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x55563053cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556304984e0 con 0x55563052ef00 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555630489ca0 con 0x55563052f820 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556304875c0 con 0x55563053a6d0 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40876/0 (socket says 172.21.15.139:40876) 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.276+0000 7f7cb7fff700 1 -- 172.21.15.139:0/2167220111 learned_addr learned my addr 172.21.15.139:0/2167220111 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x55563053cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x55563053a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 -- 172.21.15.139:0/2167220111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 msgr2=0x55563053cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x55563053cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 -- 172.21.15.139:0/2167220111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 msgr2=0x55563053a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x55563053a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 -- 172.21.15.139:0/2167220111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556302ade60 con 0x55563052ef00 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x55563053a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80057a0 tx=0x7f7ca801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eb629ca7844761 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7c9e7fc700 1 -- 172.21.15.139:0/2167220111 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca802b070 con 0x55563052ef00 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7c9e7fc700 1 -- 172.21.15.139:0/2167220111 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ca801e040 con 0x55563052ef00 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.277+0000 7f7c9e7fc700 1 -- 172.21.15.139:0/2167220111 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800f460 con 0x55563052ef00 2023-10-08T13:28:02.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2167220111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 msgr2=0x55563052f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80057a0 tx=0x7f7ca801f000 comp rx=0 tx=0).stop 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2167220111 shutdown_connections 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x55563053cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x55563052f2e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2167220111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x55563053a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2167220111 >> 172.21.15.139:0/2167220111 conn(0x5556304a42e0 msgr2=0x55563052b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2167220111 shutdown_connections 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2167220111 wait complete. 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.278+0000 7f7cca50cb80 1 -- start start 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 Processor -- start 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x55563053a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630537a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555630482eb0 con 0x55563052f820 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55563041f790 con 0x55563052ef00 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55563041f430 con 0x55563053a6d0 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cca50cb80 10 client.0 _ll_register_callbacks cb 0x55563027c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40884/0 (socket says 172.21.15.139:40884) 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 -- 172.21.15.139:0/3591009422 learned_addr learned my addr 172.21.15.139:0/3591009422 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x55563053a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.286 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 -- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 msgr2=0x555630537a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630537a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 -- 172.21.15.139:0/3591009422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 msgr2=0x55563053a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x55563053a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 -- 172.21.15.139:0/3591009422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb810def0 con 0x55563052f820 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00b9c0 tx=0x7f7cac00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907794dcf3c07e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.279+0000 7f7c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac01b470 con 0x55563052f820 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7cac01b5d0 con 0x55563052f820 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55563044af30 con 0x55563052f820 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cac01b790 con 0x55563052f820 2023-10-08T13:28:02.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 10 client.16077 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555630296ce0 con 0x55563052f820 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55563044af30 con 0x55563052f820 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7cac012a20 con 0x55563052f820 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 10 client.16077 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 20 client.16077 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55563054a1d0 0x55563054c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 4 client.16077 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.280+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55563047be90 con 0x55563054a1d0 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.281+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55563054a1d0 0x55563054c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.281+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55563054a1d0 0x55563054c5f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4dffd48e75e58d3 server_cookie=834c97a525bf96eb in_seq=0 out_seq=0 2023-10-08T13:28:02.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.281+0000 7f7c977fe700 10 client.16077 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7c977fe700 1 -- 172.21.15.139:0/3591009422 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55563047be90 con 0x55563054a1d0 2023-10-08T13:28:02.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7c977fe700 10 client.16077 handle_command_reply: tid=0 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 client.16077 shutdown 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 msgr2=0x555630537410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00b9c0 tx=0x7f7cac00bcd0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 shutdown_connections 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630537a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55563054a1d0 0x55563054c5f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x55563053a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/3591009422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052f820 0x555630537410 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7c977fe700 0 client.16077 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 >> 172.21.15.139:0/3591009422 conn(0x5556304a42e0 msgr2=0x55563052af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 shutdown_connections 2023-10-08T13:28:02.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 1 -- 172.21.15.139:0/3591009422 wait complete. 2023-10-08T13:28:02.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.282+0000 7f7cca50cb80 20 client.16077 trim_cache size 0 max 16384 2023-10-08T13:28:02.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 Processor -- start 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 -- start start 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x555630546000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x555630534690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630534bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556303039a0 con 0x55563052ef00 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556305255f0 con 0x55563052f820 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556305309f0 con 0x55563053a6d0 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x555630546000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x555630546000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40890/0 (socket says 172.21.15.139:40890) 2023-10-08T13:28:02.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cb7fff700 1 -- 172.21.15.139:0/2777316457 learned_addr learned my addr 172.21.15.139:0/2777316457 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.299+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x555630534690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630534bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 -- 172.21.15.139:0/2777316457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 msgr2=0x555630534bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630534bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 -- 172.21.15.139:0/2777316457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 msgr2=0x555630546000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x555630546000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 -- 172.21.15.139:0/2777316457 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555630551220 con 0x55563052f820 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630534bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x555630534690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cac012dd0 tx=0x7f7cac00beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d18617ce2ef84a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7c9effd700 1 -- 172.21.15.139:0/2777316457 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac003960 con 0x55563052f820 2023-10-08T13:28:02.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7c9effd700 1 -- 172.21.15.139:0/2777316457 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cac0054f0 con 0x55563052f820 2023-10-08T13:28:02.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.300+0000 7f7c9effd700 1 -- 172.21.15.139:0/2777316457 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0046b0 con 0x55563052f820 2023-10-08T13:28:02.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2777316457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 msgr2=0x555630534690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x555630534690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7cac012dd0 tx=0x7f7cac00beb0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2777316457 shutdown_connections 2023-10-08T13:28:02.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563053a6d0 0x555630534bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.308 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563052ef00 0x555630546000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/2777316457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052f820 0x555630534690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2777316457 >> 172.21.15.139:0/2777316457 conn(0x5556304a42e0 msgr2=0x5556305458f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2777316457 shutdown_connections 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- 172.21.15.139:0/2777316457 wait complete. 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.301+0000 7f7cca50cb80 1 -- start start 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 Processor -- start 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x5556305402b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563052f820 0x5556305407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555630598520 con 0x55563053a6d0 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555630598660 con 0x55563052ef00 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555630598820 con 0x55563052f820 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cca50cb80 10 client.0 _ll_register_callbacks cb 0x55563027c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40900/0 (socket says 172.21.15.139:40900) 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/562188210 learned_addr learned my addr 172.21.15.139:0/562188210 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x5556305402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cb77fe700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563052f820 0x5556305407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563052f820 msgr2=0x5556305407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563052f820 0x5556305407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/562188210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 msgr2=0x5556305402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x5556305402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cbc8c0700 1 -- 172.21.15.139:0/562188210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555630296ce0 con 0x55563053a6d0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.302+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x5556305402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cbc8c0700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c7a0 tx=0x7f7cb009a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa919fecf2f254aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb009a290 con 0x55563053a6d0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7cb0004ad0 con 0x55563053a6d0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ca801e040 con 0x55563053a6d0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cb009b2a0 con 0x55563053a6d0 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 10 client.16083 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:02.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5556302d42d0 con 0x55563053a6d0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cb00b3080 con 0x55563053a6d0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7cb00a2a10 con 0x55563053a6d0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 10 client.16083 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 20 client.16083 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5556305a00e0 0x5556305a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 4 client.16083 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.303+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55563047bbb0 con 0x5556305a00e0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.304+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5556305a00e0 0x5556305a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.304+0000 7f7c977fe700 10 client.16083 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.304+0000 7f7cb7fff700 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5556305a00e0 0x5556305a24d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f159059c51a8c06 server_cookie=7e7b1e5e1022eccd in_seq=0 out_seq=0 2023-10-08T13:28:02.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.305+0000 7f7c977fe700 1 -- 172.21.15.139:0/562188210 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55563047bbb0 con 0x5556305a00e0 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.305+0000 7f7c977fe700 10 client.16083 handle_command_reply: tid=0 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.305+0000 7f7cca50cb80 1 client.16083 shutdown 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 msgr2=0x555630597fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c7a0 tx=0x7f7cb009a5b0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 shutdown_connections 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55563053a6d0 0x555630597fe0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5556305a00e0 0x5556305a24d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55563052ef00 0x5556305402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 --2- 172.21.15.139:0/562188210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55563052f820 0x5556305407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7c977fe700 0 client.16083 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 >> 172.21.15.139:0/562188210 conn(0x5556304a42e0 msgr2=0x555630546180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 shutdown_connections 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 1 -- 172.21.15.139:0/562188210 wait complete. 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cca50cb80 20 client.16083 trim_cache size 0 max 16384 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stdout: "return_code": 0, 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_tag": "f0bfe1d0-d3e6-4509-ac5f-0f30f7a7816f", 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": "asynchronous" 2023-10-08T13:28:02.314 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:28:02.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 msgr2=0x7f7ca00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 0x7f7ca00a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b2e0 tx=0x7f7ca8005fb0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 msgr2=0x7f7cb81969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.306+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ef30 tx=0x7f7cb000c3a0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 shutdown_connections 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f7ca00a15f0 0x7f7ca00a3ab0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7cb8106730 0x7f7cb81969f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cb8100720 0x7f7cb819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 --2- 172.21.15.139:0/3127175707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb81010e0 0x7f7cb819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 >> 172.21.15.139:0/3127175707 conn(0x7f7cb80fc230 msgr2=0x7f7cb80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 shutdown_connections 2023-10-08T13:28:02.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.307+0000 7f7cbe323700 1 -- 172.21.15.139:0/3127175707 wait complete. 2023-10-08T13:28:02.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:28:02.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 -- 172.21.15.139:0/1306202194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6474105630 msgr2=0x7f6474105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1306202194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6474105630 0x7f6474105a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64640098f0 tx=0x7f6464009c00 comp rx=0 tx=0).stop 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 -- 172.21.15.139:0/1306202194 shutdown_connections 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1306202194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474100000 0x7f647410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1306202194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6474105630 0x7f6474105a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1306202194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f64740ff640 0x7f64740ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 -- 172.21.15.139:0/1306202194 >> 172.21.15.139:0/1306202194 conn(0x7f6474076790 msgr2=0x7f6474076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 -- 172.21.15.139:0/1306202194 shutdown_connections 2023-10-08T13:28:02.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.493+0000 7f6479ac4700 1 -- 172.21.15.139:0/1306202194 wait complete. 2023-10-08T13:28:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.494+0000 7f6479ac4700 1 Processor -- start 2023-10-08T13:28:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.494+0000 7f6479ac4700 1 -- start start 2023-10-08T13:28:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64740ff640 0x7f647419c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474105630 0x7f64741969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474197050 con 0x7f6474100000 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64741971c0 con 0x7f64740ff640 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6479ac4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474197380 con 0x7f6474105630 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40912/0 (socket says 172.21.15.139:40912) 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 -- 172.21.15.139:0/1578954828 learned_addr learned my addr 172.21.15.139:0/1578954828 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6473fff700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474105630 0x7f64741969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f64737fe700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64740ff640 0x7f647419c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 -- 172.21.15.139:0/1578954828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474105630 msgr2=0x7f64741969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474105630 0x7f64741969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 -- 172.21.15.139:0/1578954828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64740ff640 msgr2=0x7f647419c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64740ff640 0x7f647419c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 -- 172.21.15.139:0/1578954828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464009520 con 0x7f6474100000 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6472ffd700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f646800d980 tx=0x7f646800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.495+0000 7f6470ff9700 1 -- 172.21.15.139:0/1578954828 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468004220 con 0x7f6474100000 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.496+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6474197660 con 0x7f6474100000 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.496+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64741a38b0 con 0x7f6474100000 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.496+0000 7f6470ff9700 1 -- 172.21.15.139:0/1578954828 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6468007640 con 0x7f6474100000 2023-10-08T13:28:02.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.496+0000 7f6470ff9700 1 -- 172.21.15.139:0/1578954828 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680055d0 con 0x7f6474100000 2023-10-08T13:28:02.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.498+0000 7f6470ff9700 1 -- 172.21.15.139:0/1578954828 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f646800f690 con 0x7f6474100000 2023-10-08T13:28:02.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.499+0000 7f6470ff9700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.499+0000 7f6470ff9700 1 -- 172.21.15.139:0/1578954828 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f64680cd190 con 0x7f6474100000 2023-10-08T13:28:02.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.499+0000 7f64737fe700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f64737fe700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 0x7f645c0a3b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6464009fd0 tx=0x7f6464019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 Processor -- start 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 -- start start 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05852260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c057bb460 con 0x562c0585d650 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c057acc20 con 0x562c05851e80 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6485cadb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c057aa540 con 0x562c058527a0 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40922/0 (socket says 172.21.15.139:40922) 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6473fff700 1 -- 172.21.15.139:0/4201755693 learned_addr learned my addr 172.21.15.139:0/4201755693 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f64737fe700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05852260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.500+0000 7f6472ffd700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 -- 172.21.15.139:0/4201755693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 msgr2=0x562c0585d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 -- 172.21.15.139:0/4201755693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 msgr2=0x562c05852260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05852260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 -- 172.21.15.139:0/4201755693 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c055d0de0 con 0x562c0585d650 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6472ffd700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6473fff700 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f646c011670 tx=0x7f646c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b745d0e7b6826d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6459ffb700 1 -- 172.21.15.139:0/4201755693 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00e040 con 0x562c0585d650 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6459ffb700 1 -- 172.21.15.139:0/4201755693 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f646c00f040 con 0x562c0585d650 2023-10-08T13:28:02.504 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.501+0000 7f6459ffb700 1 -- 172.21.15.139:0/4201755693 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c004790 con 0x562c0585d650 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- 172.21.15.139:0/4201755693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 msgr2=0x562c0585fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f646c011670 tx=0x7f646c0099e0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- 172.21.15.139:0/4201755693 shutdown_connections 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c0585fa40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05852260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 --2- 172.21.15.139:0/4201755693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- 172.21.15.139:0/4201755693 >> 172.21.15.139:0/4201755693 conn(0x562c057c7260 msgr2=0x562c0584e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- 172.21.15.139:0/4201755693 shutdown_connections 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- 172.21.15.139:0/4201755693 wait complete. 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 -- start start 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.502+0000 7f6485cadb80 1 Processor -- start 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c0585d650 0x562c0585a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c057a5e30 con 0x562c05851e80 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c05742710 con 0x562c0585d650 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c057423b0 con 0x562c058527a0 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 10 client.0 _ll_register_callbacks cb 0x562c0559f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:02.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40924/0 (socket says 172.21.15.139:40924) 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 -- 172.21.15.139:0/224186491 learned_addr learned my addr 172.21.15.139:0/224186491 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6472ffd700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6473fff700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c0585d650 0x562c0585a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 -- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 msgr2=0x562c0585a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 -- 172.21.15.139:0/224186491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c0585d650 msgr2=0x562c0585a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c0585d650 0x562c0585a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 -- 172.21.15.139:0/224186491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c011350 con 0x562c05851e80 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6472ffd700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:02.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f64737fe700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f64640098f0 tx=0x7f6464009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb361ce0ee6edcf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6452ffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646402b070 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f646400f910 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.503+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c0576deb0 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6464005040 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 10 client.16095 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562c055b9c60 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6464039020 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6464003c50 con 0x562c05851e80 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 10 client.16095 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:02.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 20 client.16095 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c0586d100 0x562c0586f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 4 client.16095 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.504+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c0579ee10 con 0x562c0586d100 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.505+0000 7f6472ffd700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c0586d100 0x562c0586f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.505+0000 7f6452ffd700 10 client.16095 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.505+0000 7f6472ffd700 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c0586d100 0x562c0586f520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b4a5ba4306bdb0 server_cookie=6693b336bb6862b7 in_seq=0 out_seq=0 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6452ffd700 1 -- 172.21.15.139:0/224186491 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562c0579ee10 con 0x562c0586d100 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6452ffd700 10 client.16095 handle_command_reply: tid=0 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 client.16095 shutdown 2023-10-08T13:28:02.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 msgr2=0x562c0585cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f64640098f0 tx=0x7f6464009260 comp rx=0 tx=0).stop 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 shutdown_connections 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c0586d100 0x562c0586f520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c0585d650 0x562c0585a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6452ffd700 0 client.16095 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c05851e80 0x562c0585cf60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 --2- 172.21.15.139:0/224186491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c0585a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 >> 172.21.15.139:0/224186491 conn(0x562c057c7260 msgr2=0x562c0584dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 shutdown_connections 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 1 -- 172.21.15.139:0/224186491 wait complete. 2023-10-08T13:28:02.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.506+0000 7f6485cadb80 20 client.16095 trim_cache size 0 max 16384 2023-10-08T13:28:02.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.523+0000 7f6485cadb80 1 Processor -- start 2023-10-08T13:28:02.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.523+0000 7f6485cadb80 1 -- start start 2023-10-08T13:28:02.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.523+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05864240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05858b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6485cadb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c05626920 con 0x562c0585d650 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6485cadb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c058595a0 con 0x562c05851e80 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6485cadb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0584db80 con 0x562c058527a0 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40936/0 (socket says 172.21.15.139:40936) 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 -- 172.21.15.139:0/398045562 learned_addr learned my addr 172.21.15.139:0/398045562 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6472ffd700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05858b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f64737fe700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05864240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 -- 172.21.15.139:0/398045562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 msgr2=0x562c05858b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05858b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 -- 172.21.15.139:0/398045562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 msgr2=0x562c05864240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05864240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 -- 172.21.15.139:0/398045562 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c055f7250 con 0x562c0585d650 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f64737fe700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05864240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f6473fff700 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f646c011670 tx=0x7f646c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98867ecce9ecaf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f645a7fc700 1 -- 172.21.15.139:0/398045562 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c00e050 con 0x562c0585d650 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f645a7fc700 1 -- 172.21.15.139:0/398045562 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f646c005910 con 0x562c0585d650 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.524+0000 7f645a7fc700 1 -- 172.21.15.139:0/398045562 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c004190 con 0x562c0585d650 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- 172.21.15.139:0/398045562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 msgr2=0x562c05859060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f646c011670 tx=0x7f646c006000 comp rx=0 tx=0).stop 2023-10-08T13:28:02.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- 172.21.15.139:0/398045562 shutdown_connections 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c05859060 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05864240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 --2- 172.21.15.139:0/398045562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05858b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- 172.21.15.139:0/398045562 >> 172.21.15.139:0/398045562 conn(0x562c057c7260 msgr2=0x562c05855570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- 172.21.15.139:0/398045562 shutdown_connections 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- 172.21.15.139:0/398045562 wait complete. 2023-10-08T13:28:02.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.525+0000 7f6485cadb80 1 -- start start 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 Processor -- start 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05862860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c058632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c058c0f60 con 0x562c0585d650 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c058c10a0 con 0x562c05851e80 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c058c1210 con 0x562c058527a0 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6485cadb80 10 client.0 _ll_register_callbacks cb 0x7f646400f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:02.533 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c058632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6472ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6473fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c058632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40942/0 (socket says 172.21.15.139:40942) 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6473fff700 1 -- 172.21.15.139:0/3044920821 learned_addr learned my addr 172.21.15.139:0/3044920821 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f6472ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40656/0 (socket says 172.21.15.139:40656) 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.526+0000 7f64737fe700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05862860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 -- 172.21.15.139:0/3044920821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 msgr2=0x562c05862860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05862860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 -- 172.21.15.139:0/3044920821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 msgr2=0x562c058632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c058632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 -- 172.21.15.139:0/3044920821 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c055d0de0 con 0x562c058527a0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6472ffd700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64680ca5a0 tx=0x7f6468005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4846a4250aa399d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680b8130 con 0x562c058527a0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f646c00f040 con 0x562c058527a0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f64680981d0 con 0x562c058527a0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6468004380 con 0x562c058527a0 2023-10-08T13:28:02.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 10 client.25594 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562c055cf2b0 con 0x562c058527a0 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f646c00f040 con 0x562c058527a0 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f64680a1d30 con 0x562c058527a0 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 10 client.25594 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.527+0000 7f6485cadb80 20 client.25594 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c058c2930 0x562c058c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 4 client.25594 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562c0579eb30 con 0x562c058c2930 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f64737fe700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c058c2930 0x562c058c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:02.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f64737fe700 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c058c2930 0x562c058c4d50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a302fc3125ecad90 server_cookie=54ae10c00ce474f5 in_seq=0 out_seq=0 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6452ffd700 10 client.25594 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6452ffd700 1 -- 172.21.15.139:0/3044920821 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562c0579eb30 con 0x562c058c2930 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6452ffd700 10 client.25594 handle_command_reply: tid=0 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 client.25594 shutdown 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 msgr2=0x562c05862da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f64680ca5a0 tx=0x7f6468005dc0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 shutdown_connections 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562c0585d650 0x562c058632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x562c058c2930 0x562c058c4d50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562c05851e80 0x562c05862860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6452ffd700 0 client.25594 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.528+0000 7f6485cadb80 1 --2- 172.21.15.139:0/3044920821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c058527a0 0x562c05862da0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 >> 172.21.15.139:0/3044920821 conn(0x562c057c7260 msgr2=0x562c05858a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 shutdown_connections 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6485cadb80 1 -- 172.21.15.139:0/3044920821 wait complete. 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6485cadb80 20 client.25594 trim_cache size 0 max 16384 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:28:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "f0bfe1d0-d3e6-4509-ac5f-0f30f7a7816f": { 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "f0bfe1d0-d3e6-4509-ac5f-0f30f7a7816f", 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:28:02.539 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 msgr2=0x7f645c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 0x7f645c0a3b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6464009fd0 tx=0x7f6464019040 comp rx=0 tx=0).stop 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 msgr2=0x7f647419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f646800d980 tx=0x7f646800dc90 comp rx=0 tx=0).stop 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 shutdown_connections 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f645c0a1670 0x7f645c0a3b30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6474105630 0x7f64741969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64740ff640 0x7f647419c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 --2- 172.21.15.139:0/1578954828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6474100000 0x7f647419ce00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:02.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 >> 172.21.15.139:0/1578954828 conn(0x7f6474076790 msgr2=0x7f64740fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:02.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 shutdown_connections 2023-10-08T13:28:02.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:02.529+0000 7f6479ac4700 1 -- 172.21.15.139:0/1578954828 wait complete. 2023-10-08T13:28:02.542 INFO:tasks.cephfs.filesystem:scrub status for tag:f0bfe1d0-d3e6-4509-ac5f-0f30f7a7816f - {'path': '/', 'tag': 'f0bfe1d0-d3e6-4509-ac5f-0f30f7a7816f', 'options': 'recursive,force'} 2023-10-08T13:28:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:02 smithi139 ceph-mon[99506]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-08T13:28:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:02 smithi139 ceph-mon[99506]: scrub queued for path: / 2023-10-08T13:28:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:02 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:02 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:28:02.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:02 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:02 smithi187 ceph-mon[104336]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-08T13:28:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:02 smithi187 ceph-mon[104336]: scrub queued for path: / 2023-10-08T13:28:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:02 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:02.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:02 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:28:02.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:02 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:03.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:02 smithi155 ceph-mon[103467]: mgrmap e24: x(active, since 7m), standbys: z, y 2023-10-08T13:28:03.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:02 smithi155 ceph-mon[103467]: scrub queued for path: / 2023-10-08T13:28:03.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:02 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:02 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:28:03.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:02 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:03 smithi187 ceph-mon[104336]: pgmap v316: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T13:28:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:03 smithi155 ceph-mon[103467]: pgmap v316: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T13:28:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:03 smithi139 ceph-mon[99506]: pgmap v316: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 22 op/s 2023-10-08T13:28:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:05 smithi187 ceph-mon[104336]: pgmap v317: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:05 smithi155 ceph-mon[103467]: pgmap v317: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:05 smithi139 ceph-mon[99506]: pgmap v317: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:06 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:28:07.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:06 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:28:07.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:06 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:28:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:07 smithi187 ceph-mon[104336]: pgmap v318: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:07 smithi155 ceph-mon[103467]: pgmap v318: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:07 smithi139 ceph-mon[99506]: pgmap v318: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2023-10-08T13:28:09.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:09 smithi187 ceph-mon[104336]: pgmap v319: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2023-10-08T13:28:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:09 smithi155 ceph-mon[103467]: pgmap v319: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2023-10-08T13:28:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:09 smithi139 ceph-mon[99506]: pgmap v319: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 25 op/s 2023-10-08T13:28:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 -- 172.21.15.139:0/982732759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee000ffd70 msgr2=0x7fee001001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 --2- 172.21.15.139:0/982732759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee000ffd70 0x7fee001001f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fedec009990 tx=0x7fedec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 -- 172.21.15.139:0/982732759 shutdown_connections 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 --2- 172.21.15.139:0/982732759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee00100730 0x7fee0010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 --2- 172.21.15.139:0/982732759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee001045b0 0x7fee00104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 --2- 172.21.15.139:0/982732759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee000ffd70 0x7fee001001f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 -- 172.21.15.139:0/982732759 >> 172.21.15.139:0/982732759 conn(0x7fee00075bf0 msgr2=0x7fee000fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 -- 172.21.15.139:0/982732759 shutdown_connections 2023-10-08T13:28:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.589+0000 7fee07104700 1 -- 172.21.15.139:0/982732759 wait complete. 2023-10-08T13:28:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.590+0000 7fee07104700 1 Processor -- start 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 -- start start 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 0x7fee0010ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 0x7fee0010d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee001a4eb0 con 0x7fee001045b0 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee001a5020 con 0x7fee000ffd70 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee07104700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee001a51e0 con 0x7fee00100730 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee056a1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fedfffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 0x7fee0010d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee056a1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40956/0 (socket says 172.21.15.139:40956) 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee056a1700 1 -- 172.21.15.139:0/712887146 learned_addr learned my addr 172.21.15.139:0/712887146 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.591+0000 7fee04ea0700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 0x7fee0010ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 -- 172.21.15.139:0/712887146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 msgr2=0x7fee0010ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 0x7fee0010ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 -- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 msgr2=0x7fee0010d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 -- 172.21.15.139:0/712887146 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0095f0 con 0x7fee00100730 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fee056a1700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fee04ea0700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 0x7fee0010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfffff700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 0x7fee0010d210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedec0059d0 tx=0x7fedec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfdffb700 1 -- 172.21.15.139:0/712887146 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec01d070 con 0x7fee00100730 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee001a5460 con 0x7fee00100730 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfdffb700 1 -- 172.21.15.139:0/712887146 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedec022470 con 0x7fee00100730 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fedfdffb700 1 -- 172.21.15.139:0/712887146 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec017650 con 0x7fee00100730 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.592+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee001a5880 con 0x7fee00100730 2023-10-08T13:28:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.596+0000 7fedfdffb700 1 -- 172.21.15.139:0/712887146 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fedec0225e0 con 0x7fee00100730 2023-10-08T13:28:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.596+0000 7fedfdffb700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 0x7fedf00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.597+0000 7fedfdffb700 1 -- 172.21.15.139:0/712887146 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fedec0ce510 con 0x7fee00100730 2023-10-08T13:28:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.597+0000 7fee04ea0700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 0x7fedf00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.597+0000 7fee04ea0700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 0x7fedf00a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fedf4011490 tx=0x7fedf4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.597+0000 7fee132edb80 1 Processor -- start 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.597+0000 7fee132edb80 1 -- start start 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7c2c400 con 0x55b7f7cc9880 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7c1dbc0 con 0x55b7f7cc40b0 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee132edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7c1b4e0 con 0x55b7f7cca1a0 2023-10-08T13:28:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fedfffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40960/0 (socket says 172.21.15.139:40960) 2023-10-08T13:28:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 -- 172.21.15.139:0/1586845184 learned_addr learned my addr 172.21.15.139:0/1586845184 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee056a1700 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 -- 172.21.15.139:0/1586845184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 msgr2=0x55b7f7cc3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 -- 172.21.15.139:0/1586845184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 msgr2=0x55b7f7cc4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 -- 172.21.15.139:0/1586845184 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f7a41d80 con 0x55b7f7cc9880 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.598+0000 7fee04ea0700 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fedf40043c0 tx=0x7fedf4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157b613f586df28b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.599+0000 7fedeaffd700 1 -- 172.21.15.139:0/1586845184 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4003d10 con 0x55b7f7cc9880 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.599+0000 7fedeaffd700 1 -- 172.21.15.139:0/1586845184 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedf4003e70 con 0x55b7f7cc9880 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.599+0000 7fedeaffd700 1 -- 172.21.15.139:0/1586845184 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf400e730 con 0x55b7f7cc9880 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- 172.21.15.139:0/1586845184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 msgr2=0x55b7f7cc9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fedf40043c0 tx=0x7fedf4014000 comp rx=0 tx=0).stop 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- 172.21.15.139:0/1586845184 shutdown_connections 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cc9c60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 --2- 172.21.15.139:0/1586845184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- 172.21.15.139:0/1586845184 >> 172.21.15.139:0/1586845184 conn(0x55b7f7c38200 msgr2=0x55b7f7cbeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- 172.21.15.139:0/1586845184 shutdown_connections 2023-10-08T13:28:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- 172.21.15.139:0/1586845184 wait complete. 2023-10-08T13:28:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 -- start start 2023-10-08T13:28:10.603 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.600+0000 7fee132edb80 1 Processor -- start 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7ccdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7c16dd0 con 0x55b7f7cc9880 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7bb36b0 con 0x55b7f7cc40b0 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7bb3350 con 0x55b7f7cca1a0 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee132edb80 10 client.0 _ll_register_callbacks cb 0x55b7f7a107a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:59486/0 (socket says 172.21.15.139:59486) 2023-10-08T13:28:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee04ea0700 1 -- 172.21.15.139:0/3334640482 learned_addr learned my addr 172.21.15.139:0/3334640482 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fedfffff700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7ccdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 -- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 msgr2=0x55b7f7cce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.601+0000 7fee056a1700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 -- 172.21.15.139:0/3334640482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 msgr2=0x55b7f7ccdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7ccdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 -- 172.21.15.139:0/3334640482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4017070 con 0x55b7f7cc40b0 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee056a1700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedf4004390 tx=0x7fedf401e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b57b72baa39a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7feddffff700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:28:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf402b070 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fedf401ea30 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7f7bdee50 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedf401ecd0 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee132edb80 10 client.25625 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b7f7a2ac00 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.602+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b7f7bdee50 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fedf4024020 con 0x55b7f7cc40b0 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 10 client.25625 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 20 client.25625 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7ce6420 0x55b7f7ce8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 4 client.25625 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7f7c0fdb0 con 0x55b7f7ce6420 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fedfffff700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7ce6420 0x55b7f7ce8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7feddffff700 10 client.25625 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.603+0000 7fedfffff700 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7ce6420 0x55b7f7ce8810 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b752c3f3d83549c4 server_cookie=75789c35acce8a5a in_seq=0 out_seq=0 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7feddffff700 1 -- 172.21.15.139:0/3334640482 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b7f7c0fdb0 con 0x55b7f7ce6420 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7feddffff700 10 client.25625 handle_command_reply: tid=0 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 client.25625 shutdown 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 msgr2=0x55b7f7ccd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fedf4004390 tx=0x7fedf401e600 comp rx=0 tx=0).stop 2023-10-08T13:28:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 shutdown_connections 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7ce6420 0x55b7f7ce8810 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7ccd5b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 --2- 172.21.15.139:0/3334640482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7ccdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 >> 172.21.15.139:0/3334640482 conn(0x55b7f7c38200 msgr2=0x55b7f7cbe010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.604+0000 7feddffff700 0 client.25625 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.605+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 shutdown_connections 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.605+0000 7fee132edb80 1 -- 172.21.15.139:0/3334640482 wait complete. 2023-10-08T13:28:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.605+0000 7fee132edb80 20 client.25625 trim_cache size 0 max 16384 2023-10-08T13:28:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.632+0000 7fee132edb80 1 Processor -- start 2023-10-08T13:28:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.632+0000 7fee132edb80 1 -- start start 2023-10-08T13:28:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7a978c0 con 0x55b7f7cc9880 2023-10-08T13:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7cd0120 con 0x55b7f7cc40b0 2023-10-08T13:28:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee132edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7cc0100 con 0x55b7f7cca1a0 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40976/0 (socket says 172.21.15.139:40976) 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 -- 172.21.15.139:0/1635026034 learned_addr learned my addr 172.21.15.139:0/1635026034 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee056a1700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee04ea0700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 -- 172.21.15.139:0/1635026034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 msgr2=0x55b7f7cc62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 -- 172.21.15.139:0/1635026034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 msgr2=0x55b7f7cc3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 -- 172.21.15.139:0/1635026034 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f7a681f0 con 0x55b7f7cc9880 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fee056a1700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.633+0000 7fedfffff700 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fedec0cbf20 tx=0x7fedec009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264dcc1ce1f04053 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.634+0000 7fedeb7fe700 1 -- 172.21.15.139:0/1635026034 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec09f160 con 0x55b7f7cc9880 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.634+0000 7fedeb7fe700 1 -- 172.21.15.139:0/1635026034 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedec09b240 con 0x55b7f7cc9880 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.634+0000 7fedeb7fe700 1 -- 172.21.15.139:0/1635026034 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0ce150 con 0x55b7f7cc9880 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- 172.21.15.139:0/1635026034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 msgr2=0x55b7f7cd4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fedec0cbf20 tx=0x7fedec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- 172.21.15.139:0/1635026034 shutdown_connections 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cca1a0 0x55b7f7cc62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cc3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 --2- 172.21.15.139:0/1635026034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cc9880 0x55b7f7cd4c40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- 172.21.15.139:0/1635026034 >> 172.21.15.139:0/1635026034 conn(0x55b7f7c38200 msgr2=0x55b7f7cc7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- 172.21.15.139:0/1635026034 shutdown_connections 2023-10-08T13:28:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- 172.21.15.139:0/1635026034 wait complete. 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 -- start start 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.635+0000 7fee132edb80 1 Processor -- start 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 0x55b7f7cccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 0x55b7f7ccd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7ccd7c0 con 0x55b7f7cca1a0 2023-10-08T13:28:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7ccd930 con 0x55b7f7cc9880 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f7ccdaf0 con 0x55b7f7cc40b0 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee132edb80 10 client.0 _ll_register_callbacks cb 0x7fedf8009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee056a1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 0x55b7f7ccd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee04ea0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40696/0 (socket says 172.21.15.139:40696) 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fee04ea0700 1 -- 172.21.15.139:0/3359854353 learned_addr learned my addr 172.21.15.139:0/3359854353 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.636+0000 7fedfffff700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 0x55b7f7cccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 -- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 msgr2=0x55b7f7cbec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 -- 172.21.15.139:0/3359854353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 msgr2=0x55b7f7ccd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:10.641 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 0x55b7f7ccd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 -- 172.21.15.139:0/3359854353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf80092e0 con 0x55b7f7cc9880 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fee056a1700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 0x55b7f7ccd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fedfffff700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 0x55b7f7cccaf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedec0a3700 tx=0x7fedec005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37aca7cef1c82b3e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7feddffff700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec022ae0 con 0x55b7f7cc9880 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fedec09f160 con 0x55b7f7cc9880 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedf4003e70 con 0x55b7f7cc9880 2023-10-08T13:28:10.642 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedec0ce150 con 0x55b7f7cc9880 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fee132edb80 10 client.25631 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fee001a5880 con 0x55b7f7cc9880 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.637+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedf4003e70 con 0x55b7f7cc9880 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fedec09a730 con 0x55b7f7cc9880 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 10 client.25631 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 10 client.25631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 20 client.25631 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7d3a920 0x55b7f7d3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 4 client.25631 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b7f7c0fad0 con 0x55b7f7d3a920 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7d3a920 0x55b7f7d3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:10.643 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7feddffff700 10 client.25631 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.638+0000 7fee04ea0700 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7d3a920 0x55b7f7d3cd40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2bdbe832358cefd server_cookie=5158e81d827b8b11 in_seq=0 out_seq=0 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.649+0000 7feddffff700 1 -- 172.21.15.139:0/3359854353 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b7f7c0fad0 con 0x55b7f7d3a920 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.649+0000 7feddffff700 10 client.25631 handle_command_reply: tid=0 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.649+0000 7fee132edb80 1 client.25631 shutdown 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 msgr2=0x55b7f7cccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 0x55b7f7cccaf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedec0a3700 tx=0x7fedec005c70 comp rx=0 tx=0).stop 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 shutdown_connections 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7f7cca1a0 0x55b7f7ccd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f7cc40b0 0x55b7f7cbec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b7f7d3a920 0x55b7f7d3cd40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 --2- 172.21.15.139:0/3359854353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7f7cc9880 0x55b7f7cccaf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 >> 172.21.15.139:0/3359854353 conn(0x55b7f7c38200 msgr2=0x55b7f7cc86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7feddffff700 0 client.25631 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 shutdown_connections 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 1 -- 172.21.15.139:0/3359854353 wait complete. 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.650+0000 7fee132edb80 20 client.25631 trim_cache size 0 max 16384 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:28:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 msgr2=0x7fedf00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 0x7fedf00a3ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fedf4011490 tx=0x7fedf4009260 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 msgr2=0x7fee0010d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 0x7fee0010d210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedec0059d0 tx=0x7fedec004730 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 shutdown_connections 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fedf00a15f0 0x7fedf00a3ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee001045b0 0x7fee0010d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee000ffd70 0x7fee0010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 --2- 172.21.15.139:0/712887146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee00100730 0x7fee0010d210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 >> 172.21.15.139:0/712887146 conn(0x7fee00075bf0 msgr2=0x7fee00102340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 shutdown_connections 2023-10-08T13:28:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:10.651+0000 7fee07104700 1 -- 172.21.15.139:0/712887146 wait complete. 2023-10-08T13:28:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:11 smithi139 ceph-mon[99506]: pgmap v320: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-10-08T13:28:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:11 smithi187 ceph-mon[104336]: pgmap v320: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-10-08T13:28:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:11 smithi155 ceph-mon[103467]: pgmap v320: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2023-10-08T13:28:13.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:13 smithi187 ceph-mon[104336]: pgmap v321: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-08T13:28:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:13 smithi155 ceph-mon[103467]: pgmap v321: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-08T13:28:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:13 smithi139 ceph-mon[99506]: pgmap v321: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2023-10-08T13:28:15.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:15 smithi187 ceph-mon[104336]: pgmap v322: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2023-10-08T13:28:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:15 smithi155 ceph-mon[103467]: pgmap v322: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2023-10-08T13:28:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:15 smithi139 ceph-mon[99506]: pgmap v322: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2023-10-08T13:28:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:17 smithi187 ceph-mon[104336]: pgmap v323: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-08T13:28:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:17 smithi155 ceph-mon[103467]: pgmap v323: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-08T13:28:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:17 smithi139 ceph-mon[99506]: pgmap v323: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-10-08T13:28:19.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:19 smithi187 ceph-mon[104336]: pgmap v324: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-08T13:28:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:19 smithi155 ceph-mon[103467]: pgmap v324: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-08T13:28:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:19 smithi139 ceph-mon[99506]: pgmap v324: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2023-10-08T13:28:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:21 smithi139 ceph-mon[99506]: pgmap v325: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:21 smithi187 ceph-mon[104336]: pgmap v325: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:21 smithi155 ceph-mon[103467]: pgmap v325: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 -- 172.21.15.139:0/1492322512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc105790 msgr2=0x7f5ffc105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.820 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 --2- 172.21.15.139:0/1492322512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc105790 0x7f5ffc105b70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009990 tx=0x7f5ff8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 -- 172.21.15.139:0/1492322512 shutdown_connections 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 --2- 172.21.15.139:0/1492322512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc1004b0 0x7f5ffc10c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 --2- 172.21.15.139:0/1492322512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc105790 0x7f5ffc105b70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 --2- 172.21.15.139:0/1492322512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 -- 172.21.15.139:0/1492322512 >> 172.21.15.139:0/1492322512 conn(0x7f5ffc076460 msgr2=0x7f5ffc076870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 -- 172.21.15.139:0/1492322512 shutdown_connections 2023-10-08T13:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.820+0000 7f6003b57700 1 -- 172.21.15.139:0/1492322512 wait complete. 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 Processor -- start 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 -- start start 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc1004b0 0x7f5ffc19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc105790 0x7f5ffc195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc195e70 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc195fe0 con 0x7f5ffc1004b0 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f6003b57700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1961a0 con 0x7f5ffc105790 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.821+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:40992/0 (socket says 172.21.15.139:40992) 2023-10-08T13:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 -- 172.21.15.139:0/2597218454 learned_addr learned my addr 172.21.15.139:0/2597218454 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60020f4700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc105790 0x7f5ffc195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60010f2700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc1004b0 0x7f5ffc19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 -- 172.21.15.139:0/2597218454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc105790 msgr2=0x7f5ffc195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc105790 0x7f5ffc195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 -- 172.21.15.139:0/2597218454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc1004b0 msgr2=0x7f5ffc19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc1004b0 0x7f5ffc19bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 -- 172.21.15.139:0/2597218454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80095f0 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f60018f3700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8004760 tx=0x7f5ff8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f5ff2ffd700 1 -- 172.21.15.139:0/2597218454 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff801d070 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc196420 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.822+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc068b90 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.824+0000 7f5ff2ffd700 1 -- 172.21.15.139:0/2597218454 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ff8022470 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.824+0000 7f5ff2ffd700 1 -- 172.21.15.139:0/2597218454 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8017650 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.826+0000 7f5ff2ffd700 1 -- 172.21.15.139:0/2597218454 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5ff80177b0 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f5ff2ffd700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 0x7f5fe80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f5ff2ffd700 1 -- 172.21.15.139:0/2597218454 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5ff80ce470 con 0x7f5ffc0ffaf0 2023-10-08T13:28:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f60010f2700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 0x7f5fe80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f600fd40b80 1 Processor -- start 2023-10-08T13:28:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f60010f2700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 0x7f5fe80a3b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc196bd0 tx=0x7f5fec0073d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.827+0000 7f600fd40b80 1 -- start start 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801723380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578017238c0 0x557801723d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801683400 con 0x557801729090 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801674bc0 con 0x5578017299b0 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f600fd40b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578016724e0 con 0x5578017238c0 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41000/0 (socket says 172.21.15.139:41000) 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 -- 172.21.15.139:0/407898857 learned_addr learned my addr 172.21.15.139:0/407898857 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60010f2700 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801723380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60020f4700 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578017238c0 0x557801723d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 -- 172.21.15.139:0/407898857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578017238c0 msgr2=0x557801723d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578017238c0 0x557801723d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 -- 172.21.15.139:0/407898857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 msgr2=0x557801723380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801723380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.828+0000 7f60018f3700 1 -- 172.21.15.139:0/407898857 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557801498d80 con 0x557801729090 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.829+0000 7f60018f3700 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80a4020 tx=0x7f5ff809bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176c2cf92048c4a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.829+0000 7f5fe7fff700 1 -- 172.21.15.139:0/407898857 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80a03a0 con 0x557801729090 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.829+0000 7f5fe7fff700 1 -- 172.21.15.139:0/407898857 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ff80a4550 con 0x557801729090 2023-10-08T13:28:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.829+0000 7f5fe7fff700 1 -- 172.21.15.139:0/407898857 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff809b9a0 con 0x557801729090 2023-10-08T13:28:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 -- 172.21.15.139:0/407898857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 msgr2=0x557801729470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80a4020 tx=0x7f5ff809bbb0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 -- 172.21.15.139:0/407898857 shutdown_connections 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578017238c0 0x557801723d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557801729090 0x557801729470 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 --2- 172.21.15.139:0/407898857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801723380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.830+0000 7f600fd40b80 1 -- 172.21.15.139:0/407898857 >> 172.21.15.139:0/407898857 conn(0x55780168f200 msgr2=0x557801715b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.831+0000 7f600fd40b80 1 -- 172.21.15.139:0/407898857 shutdown_connections 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.831+0000 7f600fd40b80 1 -- 172.21.15.139:0/407898857 wait complete. 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.831+0000 7f600fd40b80 1 -- start start 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.831+0000 7f600fd40b80 1 Processor -- start 2023-10-08T13:28:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x55780172cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x55780172d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780166ddd0 con 0x5578017299b0 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780160a6b0 con 0x5578017238c0 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780160a350 con 0x557801729090 2023-10-08T13:28:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f600fd40b80 10 client.0 _ll_register_callbacks cb 0x5578014677a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:59526/0 (socket says 172.21.15.139:59526) 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 -- 172.21.15.139:0/1573759452 learned_addr learned my addr 172.21.15.139:0/1573759452 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 -- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 msgr2=0x55780172cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x55780172cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 -- 172.21.15.139:0/1573759452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 msgr2=0x55780172d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60020f4700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x55780172d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x55780172d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.835 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60018f3700 1 -- 172.21.15.139:0/1573759452 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc068b90 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.832+0000 7f60020f4700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x55780172d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f60018f3700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8098750 tx=0x7f5ff8005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c984d75f3dc891 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f5fe57fa700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b3070 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5ff80a03a0 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557801635e50 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff80a0150 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f600fd40b80 10 client.25643 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557801481c00 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.833+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557801635e50 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ff80a2160 con 0x5578017238c0 2023-10-08T13:28:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 10 client.25643 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 20 client.25643 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55780174dca0 0x5578017500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 4 client.25643 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.834+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557801666db0 con 0x55780174dca0 2023-10-08T13:28:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.835+0000 7f60010f2700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55780174dca0 0x5578017500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.835+0000 7f5fe57fa700 10 client.25643 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.835+0000 7f60010f2700 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55780174dca0 0x5578017500c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55056303d53b08f7 server_cookie=2c4dd5bfa2e17899 in_seq=0 out_seq=0 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f5fe57fa700 1 -- 172.21.15.139:0/1573759452 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557801666db0 con 0x55780174dca0 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f5fe57fa700 10 client.25643 handle_command_reply: tid=0 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 client.25643 shutdown 2023-10-08T13:28:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 msgr2=0x55780172f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8098750 tx=0x7f5ff8005fd0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 shutdown_connections 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x55780172d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55780174dca0 0x5578017500c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x55780172f960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f5fe57fa700 0 client.25643 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 --2- 172.21.15.139:0/1573759452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x55780172cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 >> 172.21.15.139:0/1573759452 conn(0x55780168f200 msgr2=0x557801715010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.836+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 shutdown_connections 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.837+0000 7f600fd40b80 1 -- 172.21.15.139:0/1573759452 wait complete. 2023-10-08T13:28:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.837+0000 7f600fd40b80 20 client.25643 trim_cache size 0 max 16384 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.864+0000 7f600fd40b80 1 Processor -- start 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.864+0000 7f600fd40b80 1 -- start start 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x557801723380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801745110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578014ee8c0 con 0x5578017299b0 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801712830 con 0x5578017238c0 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f600fd40b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780174ac00 con 0x557801729090 2023-10-08T13:28:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41016/0 (socket says 172.21.15.139:41016) 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 -- 172.21.15.139:0/2136805550 learned_addr learned my addr 172.21.15.139:0/2136805550 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60018f3700 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x557801723380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 -- 172.21.15.139:0/2136805550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 msgr2=0x557801745110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801745110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 -- 172.21.15.139:0/2136805550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 msgr2=0x557801723380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x557801723380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.865+0000 7f60020f4700 1 -- 172.21.15.139:0/2136805550 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578014bf1f0 con 0x5578017299b0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.866+0000 7f60020f4700 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4007530 tx=0x7f5ff400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04bdd04880a96f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.866+0000 7f5ff0d82700 1 -- 172.21.15.139:0/2136805550 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400e040 con 0x5578017299b0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.866+0000 7f5ff0d82700 1 -- 172.21.15.139:0/2136805550 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ff400f040 con 0x5578017299b0 2023-10-08T13:28:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.866+0000 7f5ff0d82700 1 -- 172.21.15.139:0/2136805550 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4016a80 con 0x5578017299b0 2023-10-08T13:28:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- 172.21.15.139:0/2136805550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 msgr2=0x557801715790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4007530 tx=0x7f5ff400b040 comp rx=0 tx=0).stop 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- 172.21.15.139:0/2136805550 shutdown_connections 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017299b0 0x557801715790 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017238c0 0x557801723380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 --2- 172.21.15.139:0/2136805550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801745110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- 172.21.15.139:0/2136805550 >> 172.21.15.139:0/2136805550 conn(0x55780168f200 msgr2=0x55780172b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- 172.21.15.139:0/2136805550 shutdown_connections 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- 172.21.15.139:0/2136805550 wait complete. 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 -- start start 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.867+0000 7f600fd40b80 1 Processor -- start 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801725200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.871 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801725740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801725d60 con 0x5578017238c0 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801725ed0 con 0x5578017299b0 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557801726090 con 0x557801729090 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f600fd40b80 10 client.0 _ll_register_callbacks cb 0x7f5ff809bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f60018f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41020/0 (socket says 172.21.15.139:41020) 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f60018f3700 1 -- 172.21.15.139:0/3788647871 learned_addr learned my addr 172.21.15.139:0/3788647871 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.868+0000 7f60010f2700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801725200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 -- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 msgr2=0x557801725200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801725200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 -- 172.21.15.139:0/3788647871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 msgr2=0x557801725740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:28:23.872 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801725740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 -- 172.21.15.139:0/3788647871 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff4009260 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60010f2700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801725200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f60018f3700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8004730 tx=0x7f5ff809c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979ebdda0f0d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f5fe57fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b3040 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5ff809c950 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ff80a4550 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff80a03a0 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f600fd40b80 10 client.16134 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557801497250 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.869+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ff80a4550 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ff8017af0 con 0x5578017238c0 2023-10-08T13:28:23.873 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 10 client.16134 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 20 client.16134 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578017a23a0 0x5578017a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 4 client.16134 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557801666ad0 con 0x5578017a23a0 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f60010f2700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578017a23a0 0x5578017a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f5fe57fa700 10 client.16134 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:23.874 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.870+0000 7f60010f2700 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578017a23a0 0x5578017a4790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5096d2c8f977225d server_cookie=77acf9951bb92712 in_seq=0 out_seq=0 2023-10-08T13:28:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.874+0000 7f5fe57fa700 1 -- 172.21.15.139:0/3788647871 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557801666ad0 con 0x5578017a23a0 2023-10-08T13:28:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.874+0000 7f5fe57fa700 10 client.16134 handle_command_reply: tid=0 2023-10-08T13:28:23.875 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.874+0000 7f600fd40b80 1 client.16134 shutdown 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 msgr2=0x557801724cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8004730 tx=0x7f5ff809c3d0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 shutdown_connections 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578017a23a0 0x5578017a4790 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578017299b0 0x557801725740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578017238c0 0x557801724cc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 --2- 172.21.15.139:0/3788647871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557801729090 0x557801725200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f5fe57fa700 0 client.16134 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 >> 172.21.15.139:0/3788647871 conn(0x55780168f200 msgr2=0x557801749870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 shutdown_connections 2023-10-08T13:28:23.876 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 1 -- 172.21.15.139:0/3788647871 wait complete. 2023-10-08T13:28:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.875+0000 7f600fd40b80 20 client.16134 trim_cache size 0 max 16384 2023-10-08T13:28:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:28:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:28:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:28:23.877 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 msgr2=0x7f5fe80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 0x7f5fe80a3b30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc196bd0 tx=0x7f5fec0073d0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 msgr2=0x7f5ffc19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8004760 tx=0x7f5ff8004790 comp rx=0 tx=0).stop 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 shutdown_connections 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f5fe80a1670 0x7f5fe80a3b30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ffc105790 0x7f5ffc195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ffc0ffaf0 0x7f5ffc19b680 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.878 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 --2- 172.21.15.139:0/2597218454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc1004b0 0x7f5ffc19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 >> 172.21.15.139:0/2597218454 conn(0x7f5ffc076460 msgr2=0x7f5ffc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 shutdown_connections 2023-10-08T13:28:23.879 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:23.876+0000 7f6003b57700 1 -- 172.21.15.139:0/2597218454 wait complete. 2023-10-08T13:28:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:23 smithi187 ceph-mon[104336]: pgmap v326: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:23 smithi155 ceph-mon[103467]: pgmap v326: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:23 smithi139 ceph-mon[99506]: pgmap v326: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T13:28:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:25 smithi187 ceph-mon[104336]: pgmap v327: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:25 smithi155 ceph-mon[103467]: pgmap v327: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:25 smithi139 ceph-mon[99506]: pgmap v327: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:27 smithi187 ceph-mon[104336]: pgmap v328: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:28:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:27 smithi155 ceph-mon[103467]: pgmap v328: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:28:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:27 smithi139 ceph-mon[99506]: pgmap v328: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T13:28:29.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:29 smithi187 ceph-mon[104336]: pgmap v329: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:28:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:29 smithi155 ceph-mon[103467]: pgmap v329: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:28:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:29 smithi139 ceph-mon[99506]: pgmap v329: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:28:30.640 INFO:tasks.workunit.client.0.smithi139.stderr:Note: switching to '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'. 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.641 INFO:tasks.workunit.client.0.smithi139.stderr: git switch -c 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr:Or undo this operation with: 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr: git switch - 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:28:30.642 INFO:tasks.workunit.client.0.smithi139.stderr:HEAD is now at 7b3143bae3b Merge PR #48130 into wip-batrick-testing-20231007.154158 2023-10-08T13:28:30.643 DEBUG:teuthology.orchestra.run.smithi139:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-08T13:28:30.681 INFO:tasks.workunit.client.0.smithi139.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-08T13:28:30.682 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T13:28:30.682 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-08T13:28:31.205 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-08T13:28:31.267 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-08T13:28:31.304 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-08T13:28:31.305 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T13:28:31.305 INFO:tasks.workunit.client.0.smithi139.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-08T13:28:31.341 INFO:tasks.workunit.client.0.smithi139.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-08T13:28:31.344 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:28:31.344 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-08T13:28:31.403 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2023-10-08T13:28:31.404 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2023-10-08T13:28:31.404 DEBUG:teuthology.orchestra.run.smithi139:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2023-10-08T13:28:31.465 INFO:tasks.workunit.client.0.smithi139.stderr:+ set -e 2023-10-08T13:28:31.465 INFO:tasks.workunit.client.0.smithi139.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2023-10-08T13:28:31.467 INFO:tasks.workunit.client.0.smithi139.stderr:Cloning into 'xfstests-dev'... 2023-10-08T13:28:31.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:31 smithi139 ceph-mon[99506]: pgmap v330: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:28:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:31 smithi187 ceph-mon[104336]: pgmap v330: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:28:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:31 smithi155 ceph-mon[103467]: pgmap v330: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T13:28:32.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 -- 172.21.15.139:0/2228375739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 msgr2=0x7fc73810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 --2- 172.21.15.139:0/2228375739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc73810c4e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc73000b0a0 tx=0x7fc73000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 -- 172.21.15.139:0/2228375739 shutdown_connections 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 --2- 172.21.15.139:0/2228375739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc73810c4e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 --2- 172.21.15.139:0/2228375739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 0x7fc738105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 --2- 172.21.15.139:0/2228375739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 0x7fc7380ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 -- 172.21.15.139:0/2228375739 >> 172.21.15.139:0/2228375739 conn(0x7fc738076780 msgr2=0x7fc738076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 -- 172.21.15.139:0/2228375739 shutdown_connections 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.679+0000 7fc74013a700 1 -- 172.21.15.139:0/2228375739 wait complete. 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 Processor -- start 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 -- start start 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 0x7fc7381012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 0x7fc738101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7381a4e90 con 0x7fc7380fffe0 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7381a5000 con 0x7fc7381056b0 2023-10-08T13:28:32.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc74013a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7381a51c0 con 0x7fc7380ff620 2023-10-08T13:28:32.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41044/0 (socket says 172.21.15.139:41044) 2023-10-08T13:28:32.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 -- 172.21.15.139:0/2087084176 learned_addr learned my addr 172.21.15.139:0/2087084176 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73ded6700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 0x7fc7381012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 0x7fc738101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 -- 172.21.15.139:0/2087084176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 msgr2=0x7fc7381012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 0x7fc7381012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 -- 172.21.15.139:0/2087084176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 msgr2=0x7fc738101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 0x7fc738101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.680+0000 7fc73d6d5700 1 -- 172.21.15.139:0/2087084176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009d00 con 0x7fc7380fffe0 2023-10-08T13:28:32.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e9a0 tx=0x7fc72800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc72effd700 1 -- 172.21.15.139:0/2087084176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728009790 con 0x7fc7380fffe0 2023-10-08T13:28:32.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc72effd700 1 -- 172.21.15.139:0/2087084176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728010430 con 0x7fc7380fffe0 2023-10-08T13:28:32.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc72effd700 1 -- 172.21.15.139:0/2087084176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728018680 con 0x7fc7380fffe0 2023-10-08T13:28:32.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7381a54a0 con 0x7fc7380fffe0 2023-10-08T13:28:32.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.681+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7381a5960 con 0x7fc7380fffe0 2023-10-08T13:28:32.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.684+0000 7fc72effd700 1 -- 172.21.15.139:0/2087084176 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc7280105a0 con 0x7fc7380fffe0 2023-10-08T13:28:32.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.684+0000 7fc72effd700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 0x7fc7240a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.684+0000 7fc72effd700 1 -- 172.21.15.139:0/2087084176 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc728014070 con 0x7fc7380fffe0 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.684+0000 7fc73ded6700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 0x7fc7240a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc73ded6700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 0x7fc7240a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc738077ab0 tx=0x7fc734007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 Processor -- start 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 -- start start 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb86260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb91650 0x563c1bb93a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1baef460 con 0x563c1bb867a0 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bae0c20 con 0x563c1bb91650 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc74c323b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bade540 con 0x563c1bb85e80 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.685+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41052/0 (socket says 172.21.15.139:41052) 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 -- 172.21.15.139:0/277215473 learned_addr learned my addr 172.21.15.139:0/277215473 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73ded6700 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb86260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb91650 0x563c1bb93a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 -- 172.21.15.139:0/277215473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 msgr2=0x563c1bb86260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb86260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 -- 172.21.15.139:0/277215473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb91650 msgr2=0x563c1bb93a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb91650 0x563c1bb93a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 -- 172.21.15.139:0/277215473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c1b904de0 con 0x563c1bb867a0 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc7280a2100 tx=0x7fc72809a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cdb084f6cadab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc723fff700 1 -- 172.21.15.139:0/277215473 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a2630 con 0x563c1bb867a0 2023-10-08T13:28:32.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc723fff700 1 -- 172.21.15.139:0/277215473 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728098640 con 0x563c1bb867a0 2023-10-08T13:28:32.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.686+0000 7fc723fff700 1 -- 172.21.15.139:0/277215473 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72809a720 con 0x563c1bb867a0 2023-10-08T13:28:32.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- 172.21.15.139:0/277215473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 msgr2=0x563c1bb91110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc7280a2100 tx=0x7fc72809a9a0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.693 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- 172.21.15.139:0/277215473 shutdown_connections 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb91650 0x563c1bb93a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb86260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 --2- 172.21.15.139:0/277215473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb867a0 0x563c1bb91110 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- 172.21.15.139:0/277215473 >> 172.21.15.139:0/277215473 conn(0x563c1bafb260 msgr2=0x563c1bb822d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- 172.21.15.139:0/277215473 shutdown_connections 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- 172.21.15.139:0/277215473 wait complete. 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 -- start start 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.687+0000 7fc74c323b80 1 Processor -- start 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb8e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bad9e30 con 0x563c1bb91650 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1ba76710 con 0x563c1bb867a0 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1ba763b0 con 0x563c1bb85e80 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc74c323b80 10 client.0 _ll_register_callbacks cb 0x563c1b8d3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc73e6d7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc73e6d7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41060/0 (socket says 172.21.15.139:41060) 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc73e6d7700 1 -- 172.21.15.139:0/510156896 learned_addr learned my addr 172.21.15.139:0/510156896 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.688+0000 7fc73ded6700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb8e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 -- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 msgr2=0x563c1bb8e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb8e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 -- 172.21.15.139:0/510156896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 msgr2=0x563c1bb8e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 -- 172.21.15.139:0/510156896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7381a5960 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73ded6700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb8e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc730006130 tx=0x7fc73000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3932f4b01bf1ca7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000e040 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c1baa1eb0 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc730003e10 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc730009b80 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 10 client.16146 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563c1b8edc60 con 0x563c1bb91650 2023-10-08T13:28:32.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563c1baa1eb0 con 0x563c1bb91650 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc730019030 con 0x563c1bb91650 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 20 client.16146 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bba1270 0x563c1bba3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 4 client.16146 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.689+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c1bad2e10 con 0x563c1bba1270 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.690+0000 7fc73ded6700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bba1270 0x563c1bba3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.690+0000 7fc7217fa700 10 client.16146 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.690+0000 7fc73ded6700 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bba1270 0x563c1bba3690 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a2fd11609d21577 server_cookie=3f0b518403fd21c5 in_seq=0 out_seq=0 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc7217fa700 1 -- 172.21.15.139:0/510156896 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563c1bad2e10 con 0x563c1bba1270 2023-10-08T13:28:32.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc7217fa700 10 client.16146 handle_command_reply: tid=0 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 client.16146 shutdown 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 msgr2=0x563c1bb8ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc730006130 tx=0x7fc73000bd90 comp rx=0 tx=0).stop 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 shutdown_connections 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb91650 0x563c1bb8ef30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb8e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bba1270 0x563c1bba3690 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 --2- 172.21.15.139:0/510156896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc7217fa700 0 client.16146 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 >> 172.21.15.139:0/510156896 conn(0x563c1bafb260 msgr2=0x563c1bb81ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 shutdown_connections 2023-10-08T13:28:32.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 1 -- 172.21.15.139:0/510156896 wait complete. 2023-10-08T13:28:32.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.691+0000 7fc74c323b80 20 client.16146 trim_cache size 0 max 16384 2023-10-08T13:28:32.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.709+0000 7fc74c323b80 1 Processor -- start 2023-10-08T13:28:32.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.709+0000 7fc74c323b80 1 -- start start 2023-10-08T13:28:32.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.709+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.709+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb90350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc74c323b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1b95a920 con 0x563c1bafb260 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc74c323b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bba3cf0 con 0x563c1bb867a0 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc74c323b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bb82ea0 con 0x563c1bb85e80 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41064/0 (socket says 172.21.15.139:41064) 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 -- 172.21.15.139:0/463952757 learned_addr learned my addr 172.21.15.139:0/463952757 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb90350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 -- 172.21.15.139:0/463952757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 msgr2=0x563c1bb90350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb90350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 -- 172.21.15.139:0/463952757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 msgr2=0x563c1bb8b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 -- 172.21.15.139:0/463952757 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c1b92b250 con 0x563c1bafb260 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb90350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc73ded6700 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc734011010 tx=0x7fc734013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b914def12f75a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc72cff9700 1 -- 172.21.15.139:0/463952757 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734026130 con 0x563c1bafb260 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc72cff9700 1 -- 172.21.15.139:0/463952757 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc734026c60 con 0x563c1bafb260 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.710+0000 7fc72cff9700 1 -- 172.21.15.139:0/463952757 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734003a40 con 0x563c1bafb260 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- 172.21.15.139:0/463952757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 msgr2=0x563c1bb8dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc734011010 tx=0x7fc734013000 comp rx=0 tx=0).stop 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- 172.21.15.139:0/463952757 shutdown_connections 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bb867a0 0x563c1bb8b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bafb260 0x563c1bb8dd70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 --2- 172.21.15.139:0/463952757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb85e80 0x563c1bb90350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- 172.21.15.139:0/463952757 >> 172.21.15.139:0/463952757 conn(0x563c1bb7e2a0 msgr2=0x563c1bb8fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- 172.21.15.139:0/463952757 shutdown_connections 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- 172.21.15.139:0/463952757 wait complete. 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.711+0000 7fc74c323b80 1 -- start start 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 Processor -- start 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bafb260 0x563c1bbee570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb867a0 0x563c1bb97310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bb978e0 con 0x563c1bb85e80 2023-10-08T13:28:32.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bb97a50 con 0x563c1bafb260 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1bb97c10 con 0x563c1bb867a0 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc74c323b80 10 client.0 _ll_register_callbacks cb 0x563c1b8d3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc73d6d5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41072/0 (socket says 172.21.15.139:41072) 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc73ded6700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bafb260 0x563c1bbee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc73d6d5700 1 -- 172.21.15.139:0/1413543211 learned_addr learned my addr 172.21.15.139:0/1413543211 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.712+0000 7fc73e6d7700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb867a0 0x563c1bb97310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 -- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb867a0 msgr2=0x563c1bb97310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb867a0 0x563c1bb97310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 -- 172.21.15.139:0/1413543211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bafb260 msgr2=0x563c1bbee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bafb260 0x563c1bbee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 -- 172.21.15.139:0/1413543211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c1b904de0 con 0x563c1bb85e80 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc73d6d5700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc72809a230 tx=0x7fc72809a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c9a2fc10b26498 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7280a2630 con 0x563c1bb85e80 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc728099790 con 0x563c1bb85e80 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc728098640 con 0x563c1bb85e80 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc728099950 con 0x563c1bb85e80 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc74c323b80 10 client.16152 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:32.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fc734010a50 con 0x563c1bb85e80 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc728098640 con 0x563c1bb85e80 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.713+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc7280a21a0 con 0x563c1bb85e80 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 10 client.16152 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 20 client.16152 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bb91650 0x563c1bbf9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 4 client.16152 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563c1bad2b30 con 0x563c1bb91650 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc73ded6700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bb91650 0x563c1bbf9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc7217fa700 10 client.16152 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc73ded6700 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bb91650 0x563c1bbf9220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d5a3d99099d75c3 server_cookie=d16f4097f839db41 in_seq=0 out_seq=0 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc7217fa700 1 -- 172.21.15.139:0/1413543211 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563c1bad2b30 con 0x563c1bb91650 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc7217fa700 10 client.16152 handle_command_reply: tid=0 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 1 client.16152 shutdown 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 msgr2=0x563c1bbeeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.714+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc72809a230 tx=0x7fc72809a070 comp rx=0 tx=0).stop 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 shutdown_connections 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563c1bb867a0 0x563c1bb97310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x563c1bb91650 0x563c1bbf9220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.725 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c1bafb260 0x563c1bbee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 --2- 172.21.15.139:0/1413543211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563c1bb85e80 0x563c1bbeeab0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc7217fa700 0 client.16152 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 >> 172.21.15.139:0/1413543211 conn(0x563c1bb7e2a0 msgr2=0x563c1bb904d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 shutdown_connections 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 1 -- 172.21.15.139:0/1413543211 wait complete. 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74c323b80 20 client.16152 trim_cache size 0 max 16384 2023-10-08T13:28:32.726 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:28:32.727 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "no active scrubs running", 2023-10-08T13:28:32.727 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": {} 2023-10-08T13:28:32.727 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:28:32.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 msgr2=0x7fc7240a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 0x7fc7240a3ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc738077ab0 tx=0x7fc734007400 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 msgr2=0x7fc7381017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc72800e9a0 tx=0x7fc72800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 shutdown_connections 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7240a15f0 0x7fc7240a3ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7381056b0 0x7fc738101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7380ff620 0x7fc7381012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 --2- 172.21.15.139:0/2087084176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7380fffe0 0x7fc7381017f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 >> 172.21.15.139:0/2087084176 conn(0x7fc738076780 msgr2=0x7fc7380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.729 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 shutdown_connections 2023-10-08T13:28:32.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.715+0000 7fc74013a700 1 -- 172.21.15.139:0/2087084176 wait complete. 2023-10-08T13:28:32.730 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:28:32.730 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:28:32.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- 172.21.15.139:0/2433192078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54441021d0 msgr2=0x7f544410a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 --2- 172.21.15.139:0/2433192078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54441021d0 0x7f544410a6b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5438009990 tx=0x7f5438009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- 172.21.15.139:0/2433192078 shutdown_connections 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 --2- 172.21.15.139:0/2433192078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544410ac80 0x7f544410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 --2- 172.21.15.139:0/2433192078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441018b0 0x7f5444101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 --2- 172.21.15.139:0/2433192078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54441021d0 0x7f544410a6b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- 172.21.15.139:0/2433192078 >> 172.21.15.139:0/2433192078 conn(0x7f54440fb030 msgr2=0x7f54440fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- 172.21.15.139:0/2433192078 shutdown_connections 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- 172.21.15.139:0/2433192078 wait complete. 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 Processor -- start 2023-10-08T13:28:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.857+0000 7f544a49d700 1 -- start start 2023-10-08T13:28:32.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54441018b0 0x7f5444196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441021d0 0x7f5444196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419b910 con 0x7f544410ac80 2023-10-08T13:28:32.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419ba80 con 0x7f54441018b0 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419bc40 con 0x7f54441021d0 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f54437fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441021d0 0x7f5444196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41086/0 (socket says 172.21.15.139:41086) 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 -- 172.21.15.139:0/2082859995 learned_addr learned my addr 172.21.15.139:0/2082859995 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5443fff700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54441018b0 0x7f5444196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 -- 172.21.15.139:0/2082859995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441021d0 msgr2=0x7f5444196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441021d0 0x7f5444196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 -- 172.21.15.139:0/2082859995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54441018b0 msgr2=0x7f5444196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:32.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54441018b0 0x7f5444196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 -- 172.21.15.139:0/2082859995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380095f0 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f5448a3a700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f543c007d70 tx=0x7f543c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00ac90 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f543c00adf0 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544419bf20 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.858+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0115e0 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.859+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54441a37d0 con 0x7f544410ac80 2023-10-08T13:28:32.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.859+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5444105da0 con 0x7f544410ac80 2023-10-08T13:28:32.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.861+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f543c012420 con 0x7f544410ac80 2023-10-08T13:28:32.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.862+0000 7f54417fa700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 0x7f542c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:32.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.862+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f543c0cd8d0 con 0x7f544410ac80 2023-10-08T13:28:32.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.862+0000 7f5443fff700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 0x7f542c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:32.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.862+0000 7f5443fff700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 0x7f542c0a3ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5434009c60 tx=0x7f5434009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:32.866 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:32.866+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f543c0969c0 con 0x7f544410ac80 2023-10-08T13:28:33.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.151+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5444068050 con 0x7f544410ac80 2023-10-08T13:28:33.153 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.152+0000 7f54417fa700 1 -- 172.21.15.139:0/2082859995 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f543c099fe0 con 0x7f544410ac80 2023-10-08T13:28:33.153 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:28:33.153 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:26:04.411259+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 msgr2=0x7f542c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 0x7f542c0a3ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5434009c60 tx=0x7f5434009260 comp rx=0 tx=0).stop 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 msgr2=0x7f544419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f543c007d70 tx=0x7f543c00a340 comp rx=0 tx=0).stop 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 shutdown_connections 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f542c0a15f0 0x7f542c0a3ab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f544410ac80 0x7f544419b340 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54441018b0 0x7f5444196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 --2- 172.21.15.139:0/2082859995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54441021d0 0x7f5444196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 >> 172.21.15.139:0/2082859995 conn(0x7f54440fb030 msgr2=0x7f54440fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 shutdown_connections 2023-10-08T13:28:33.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.155+0000 7f544a49d700 1 -- 172.21.15.139:0/2082859995 wait complete. 2023-10-08T13:28:33.157 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 26 2023-10-08T13:28:33.169 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.294+0000 7f5524877700 1 -- 172.21.15.139:0/989875808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520105650 msgr2=0x7f5520105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.294+0000 7f5524877700 1 --2- 172.21.15.139:0/989875808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520105650 0x7f5520105a30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5510009990 tx=0x7f5510009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 -- 172.21.15.139:0/989875808 shutdown_connections 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 --2- 172.21.15.139:0/989875808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5520100000 0x7f552010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 --2- 172.21.15.139:0/989875808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520105650 0x7f5520105a30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 --2- 172.21.15.139:0/989875808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55200ff640 0x7f55200ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 -- 172.21.15.139:0/989875808 >> 172.21.15.139:0/989875808 conn(0x7f55200767c0 msgr2=0x7f5520076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 -- 172.21.15.139:0/989875808 shutdown_connections 2023-10-08T13:28:33.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.295+0000 7f5524877700 1 -- 172.21.15.139:0/989875808 wait complete. 2023-10-08T13:28:33.298 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 Processor -- start 2023-10-08T13:28:33.298 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 -- start start 2023-10-08T13:28:33.298 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55200ff640 0x7f552019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5520105650 0x7f55201947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520194e60 con 0x7f5520100000 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520194fd0 con 0x7f55200ff640 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f5524877700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5520195190 con 0x7f5520105650 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41098/0 (socket says 172.21.15.139:41098) 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 -- 172.21.15.139:0/1167725075 learned_addr learned my addr 172.21.15.139:0/1167725075 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551e59c700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55200ff640 0x7f552019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551ed9d700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5520105650 0x7f55201947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 -- 172.21.15.139:0/1167725075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5520105650 msgr2=0x7f55201947f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.299 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5520105650 0x7f55201947f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 -- 172.21.15.139:0/1167725075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55200ff640 msgr2=0x7f552019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55200ff640 0x7f552019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.296+0000 7f551dd9b700 1 -- 172.21.15.139:0/1167725075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100095f0 con 0x7f5520100000 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f551dd9b700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f551400d980 tx=0x7f551400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f550f7fe700 1 -- 172.21.15.139:0/1167725075 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514004220 con 0x7f5520100000 2023-10-08T13:28:33.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5520195470 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55201a1660 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f550f7fe700 1 -- 172.21.15.139:0/1167725075 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5514007640 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.297+0000 7f550f7fe700 1 -- 172.21.15.139:0/1167725075 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140055c0 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.299+0000 7f550f7fe700 1 -- 172.21.15.139:0/1167725075 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5514004380 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.300+0000 7f550f7fe700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 0x7f55080a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.300+0000 7f551e59c700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 0x7f55080a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.300+0000 7f550f7fe700 1 -- 172.21.15.139:0/1167725075 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f55140cd150 con 0x7f5520100000 2023-10-08T13:28:33.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.300+0000 7f551e59c700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 0x7f55080a7ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f55100098e0 tx=0x7f5510005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 Processor -- start 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 -- start start 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba027a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba027ae60 0x563ba027d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba01d0460 con 0x563ba0266e80 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba01c1c20 con 0x563ba02677a0 2023-10-08T13:28:33.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f5530a60b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba01bf540 con 0x563ba027ae60 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f551e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f551e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41104/0 (socket says 172.21.15.139:41104) 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.302+0000 7f551e59c700 1 -- 172.21.15.139:0/3098303697 learned_addr learned my addr 172.21.15.139:0/3098303697 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba027a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551ed9d700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba027ae60 0x563ba027d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 -- 172.21.15.139:0/3098303697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba027ae60 msgr2=0x563ba027d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba027ae60 0x563ba027d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 -- 172.21.15.139:0/3098303697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 msgr2=0x563ba0267260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 -- 172.21.15.139:0/3098303697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9ffe5de0 con 0x563ba02677a0 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551e59c700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba027a920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55140ca530 tx=0x7f551409a570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be50d3b45fdb127 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f550cff9700 1 -- 172.21.15.139:0/3098303697 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551409df40 con 0x563ba02677a0 2023-10-08T13:28:33.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f550cff9700 1 -- 172.21.15.139:0/3098303697 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55140a2180 con 0x563ba02677a0 2023-10-08T13:28:33.306 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.303+0000 7f550cff9700 1 -- 172.21.15.139:0/3098303697 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140a1cf0 con 0x563ba02677a0 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 -- 172.21.15.139:0/3098303697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 msgr2=0x563ba027a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba027a920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f55140ca530 tx=0x7f551409a570 comp rx=0 tx=0).stop 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 -- 172.21.15.139:0/3098303697 shutdown_connections 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba027ae60 0x563ba027d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba0266e80 0x563ba0267260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3098303697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba027a920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 -- 172.21.15.139:0/3098303697 >> 172.21.15.139:0/3098303697 conn(0x563ba01dc260 msgr2=0x563ba02632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 -- 172.21.15.139:0/3098303697 shutdown_connections 2023-10-08T13:28:33.309 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.304+0000 7f5530a60b80 1 -- 172.21.15.139:0/3098303697 wait complete. 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 -- start start 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 Processor -- start 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba02677a0 0x563ba0274760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba027ae60 0x563ba0279f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba01bae30 con 0x563ba02677a0 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba0157710 con 0x563ba027ae60 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba01573b0 con 0x563ba0266e80 2023-10-08T13:28:33.310 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f5530a60b80 10 client.0 _ll_register_callbacks cb 0x563b9ffb4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f551e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f551e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40826/0 (socket says 172.21.15.139:40826) 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.305+0000 7f551e59c700 1 -- 172.21.15.139:0/4215363596 learned_addr learned my addr 172.21.15.139:0/4215363596 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551ed9d700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba027ae60 0x563ba0279f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 -- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba027ae60 msgr2=0x563ba0279f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba027ae60 0x563ba0279f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 -- 172.21.15.139:0/4215363596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba02677a0 msgr2=0x563ba0274760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba02677a0 0x563ba0274760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 -- 172.21.15.139:0/4215363596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552010ce10 con 0x563ba0266e80 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f551e59c700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55100059d0 tx=0x7f5510009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb161130ff67d01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f5505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:28:33.311 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510029050 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ba0182eb0 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.306+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f551000f660 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551000bb30 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 10 client.25657 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f55201a1660 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563ba0182eb0 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5510022a10 con 0x563ba0266e80 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 10 client.25657 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 10 client.25657 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 20 client.25657 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02931f0 0x563ba0295610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.312 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 4 client.25657 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:33.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.307+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ba01b3e10 con 0x563ba02931f0 2023-10-08T13:28:33.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.308+0000 7f551dd9b700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02931f0 0x563ba0295610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.308+0000 7f551dd9b700 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02931f0 0x563ba0295610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=da2ca0abe721e600 server_cookie=631f6d18bbeac080 in_seq=0 out_seq=0 2023-10-08T13:28:33.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.308+0000 7f5505ffb700 10 client.25657 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5505ffb700 1 -- 172.21.15.139:0/4215363596 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563ba01b3e10 con 0x563ba02931f0 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5505ffb700 10 client.25657 handle_command_reply: tid=0 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 client.25657 shutdown 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 msgr2=0x563ba0274220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55100059d0 tx=0x7f5510009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 shutdown_connections 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02931f0 0x563ba0295610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba027ae60 0x563ba0279f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0274220 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 --2- 172.21.15.139:0/4215363596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba02677a0 0x563ba0274760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 >> 172.21.15.139:0/4215363596 conn(0x563ba01dc260 msgr2=0x563ba0262ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5505ffb700 0 client.25657 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 shutdown_connections 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 1 -- 172.21.15.139:0/4215363596 wait complete. 2023-10-08T13:28:33.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.309+0000 7f5530a60b80 20 client.25657 trim_cache size 0 max 16384 2023-10-08T13:28:33.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 Processor -- start 2023-10-08T13:28:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 -- start start 2023-10-08T13:28:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0279ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba026eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba003b920 con 0x563ba027ae60 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba026f9e0 con 0x563ba02677a0 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f5530a60b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba026afa0 con 0x563ba0266e80 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.322+0000 7f551ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41120/0 (socket says 172.21.15.139:41120) 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0279ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 -- 172.21.15.139:0/1794344189 learned_addr learned my addr 172.21.15.139:0/1794344189 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551dd9b700 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba026eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 -- 172.21.15.139:0/1794344189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 msgr2=0x563ba0279ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0279ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 -- 172.21.15.139:0/1794344189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 msgr2=0x563ba026eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba026eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 -- 172.21.15.139:0/1794344189 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b9ffcec60 con 0x563ba027ae60 2023-10-08T13:28:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f551ed9d700 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5518009f60 tx=0x7f5518009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48a5b683cc85036 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f550d7fa700 1 -- 172.21.15.139:0/1794344189 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518007da0 con 0x563ba027ae60 2023-10-08T13:28:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f550d7fa700 1 -- 172.21.15.139:0/1794344189 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f551800f040 con 0x563ba027ae60 2023-10-08T13:28:33.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.323+0000 7f550d7fa700 1 -- 172.21.15.139:0/1794344189 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518004600 con 0x563ba027ae60 2023-10-08T13:28:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 -- 172.21.15.139:0/1794344189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 msgr2=0x563ba026efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5518009f60 tx=0x7f5518009130 comp rx=0 tx=0).stop 2023-10-08T13:28:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 -- 172.21.15.139:0/1794344189 shutdown_connections 2023-10-08T13:28:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba026efe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba0266e80 0x563ba0279ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 --2- 172.21.15.139:0/1794344189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba02677a0 0x563ba026eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 -- 172.21.15.139:0/1794344189 >> 172.21.15.139:0/1794344189 conn(0x563ba01dc260 msgr2=0x563ba026a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 -- 172.21.15.139:0/1794344189 shutdown_connections 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.324+0000 7f5530a60b80 1 -- 172.21.15.139:0/1794344189 wait complete. 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 -- start start 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 Processor -- start 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 0x563ba0277c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba02677a0 0x563ba0278160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba02e6560 con 0x563ba027ae60 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba02e66a0 con 0x563ba0266e80 2023-10-08T13:28:33.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ba02e6860 con 0x563ba02677a0 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f5530a60b80 10 client.0 _ll_register_callbacks cb 0x7f55100053e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f551ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f551ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41126/0 (socket says 172.21.15.139:41126) 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.325+0000 7f551ed9d700 1 -- 172.21.15.139:0/3273835960 learned_addr learned my addr 172.21.15.139:0/3273835960 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 0x563ba0277c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba02677a0 0x563ba0278160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 -- 172.21.15.139:0/3273835960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba02677a0 msgr2=0x563ba0278160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba02677a0 0x563ba0278160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 -- 172.21.15.139:0/3273835960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 msgr2=0x563ba02e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 -- 172.21.15.139:0/3273835960 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5518009c10 con 0x563ba0266e80 2023-10-08T13:28:33.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551ed9d700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f551e59c700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 0x563ba0277c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5510009990 tx=0x7f5510022620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6be05d5f011129 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510029040 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55140a2180 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f551000f460 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f551000b6f0 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.326+0000 7f5530a60b80 10 client.25679 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563ba000c250 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f551004b080 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5510038490 con 0x563ba0266e80 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 10 client.25679 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 10 client.25679 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:28:33.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 20 client.25679 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02e7c20 0x563ba02ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 4 client.25679 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.327+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563ba01b3b30 con 0x563ba02e7c20 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.328+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02e7c20 0x563ba02ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.328+0000 7f5505ffb700 10 client.25679 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.328+0000 7f551dd9b700 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02e7c20 0x563ba02ea010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5d660a8fb6e82407 server_cookie=8c246e7ba7137d7e in_seq=0 out_seq=0 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5505ffb700 1 -- 172.21.15.139:0/3273835960 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563ba01b3b30 con 0x563ba02e7c20 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5505ffb700 10 client.25679 handle_command_reply: tid=0 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 client.25679 shutdown 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 msgr2=0x563ba0277c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 0x563ba0277c20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5510009990 tx=0x7f5510022620 comp rx=0 tx=0).stop 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 shutdown_connections 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ba027ae60 0x563ba02e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x563ba02e7c20 0x563ba02ea010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563ba0266e80 0x563ba0277c20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 --2- 172.21.15.139:0/3273835960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ba02677a0 0x563ba0278160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 >> 172.21.15.139:0/3273835960 conn(0x563ba01dc260 msgr2=0x563ba026eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5505ffb700 0 client.25679 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 shutdown_connections 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 1 -- 172.21.15.139:0/3273835960 wait complete. 2023-10-08T13:28:33.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5530a60b80 20 client.25679 trim_cache size 0 max 16384 2023-10-08T13:28:33.336 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:33.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 msgr2=0x7f55080a7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.336 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.329+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 0x7f55080a7ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f55100098e0 tx=0x7f5510005960 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 msgr2=0x7f552019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f551400d980 tx=0x7f551400dc90 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 shutdown_connections 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f55080a5a00 0x7f55080a7ec0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5520105650 0x7f55201947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55200ff640 0x7f552019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 --2- 172.21.15.139:0/1167725075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5520100000 0x7f552019abb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 >> 172.21.15.139:0/1167725075 conn(0x7f55200767c0 msgr2=0x7f55200fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 shutdown_connections 2023-10-08T13:28:33.337 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.330+0000 7f5524877700 1 -- 172.21.15.139:0/1167725075 wait complete. 2023-10-08T13:28:33.344 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T13:28:33.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1205451043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b40fffe0 msgr2=0x7f14b410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1205451043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b40fffe0 0x7f14b410c4e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00b0a0 tx=0x7f14ac00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1205451043 shutdown_connections 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1205451043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b40fffe0 0x7f14b410c4e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1205451043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b41056b0 0x7f14b4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1205451043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 0x7f14b40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1205451043 >> 172.21.15.139:0/1205451043 conn(0x7f14b4076780 msgr2=0x7f14b4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1205451043 shutdown_connections 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.475+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1205451043 wait complete. 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 Processor -- start 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 -- start start 2023-10-08T13:28:33.479 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 0x7f14b4194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b40fffe0 0x7f14b4194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4199930 con 0x7f14b41056b0 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4199aa0 con 0x7f14b40ff620 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14bb2c7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4199c60 con 0x7f14b40fffe0 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41146/0 (socket says 172.21.15.139:41146) 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 -- 172.21.15.139:0/1008324943 learned_addr learned my addr 172.21.15.139:0/1008324943 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9063700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 0x7f14b4194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b8862700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b40fffe0 0x7f14b4194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 -- 172.21.15.139:0/1008324943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b40fffe0 msgr2=0x7f14b4194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b40fffe0 0x7f14b4194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 -- 172.21.15.139:0/1008324943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 msgr2=0x7f14b4194a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 0x7f14b4194a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.476+0000 7f14b9864700 1 -- 172.21.15.139:0/1008324943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac009d00 con 0x7f14b41056b0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14b9864700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f14ac01a040 tx=0x7f14ac00bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14aa7fc700 1 -- 172.21.15.139:0/1008324943 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004e60 con 0x7f14b41056b0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14aa7fc700 1 -- 172.21.15.139:0/1008324943 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14ac0075c0 con 0x7f14b41056b0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b4199ee0 con 0x7f14b41056b0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14aa7fc700 1 -- 172.21.15.139:0/1008324943 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0216a0 con 0x7f14b41056b0 2023-10-08T13:28:33.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.477+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b419a1c0 con 0x7f14b41056b0 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.479+0000 7f14aa7fc700 1 -- 172.21.15.139:0/1008324943 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f14ac007730 con 0x7f14b41056b0 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.480+0000 7f14aa7fc700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 0x7f14a00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.480+0000 7f14aa7fc700 1 -- 172.21.15.139:0/1008324943 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f14ac0d3100 con 0x7f14b41056b0 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.480+0000 7f14b9063700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 0x7f14a00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.480+0000 7f14b9063700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 0x7f14a00a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f14b4077ab0 tx=0x7f14a4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 Processor -- start 2023-10-08T13:28:33.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 -- start start 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 0x557108120a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710807c460 con 0x5571081137a0 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710806dc20 con 0x557108112e80 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55710806b540 con 0x55710811e650 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14b9063700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.489 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14b9063700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:59670/0 (socket says 172.21.15.139:59670) 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14b9063700 1 -- 172.21.15.139:0/1971790795 learned_addr learned my addr 172.21.15.139:0/1971790795 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.481+0000 7f14b8862700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9864700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 0x557108120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 -- 172.21.15.139:0/1971790795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 msgr2=0x557108120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 0x557108120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 -- 172.21.15.139:0/1971790795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 msgr2=0x55710811e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 -- 172.21.15.139:0/1971790795 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557107e91de0 con 0x557108112e80 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9864700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 0x557108120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b8862700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f14b9063700 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14a4011d80 tx=0x7f14a4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec746b17ec78019e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f149f7fe700 1 -- 172.21.15.139:0/1971790795 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400ed20 con 0x557108112e80 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f149f7fe700 1 -- 172.21.15.139:0/1971790795 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14a4021070 con 0x557108112e80 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.482+0000 7f149f7fe700 1 -- 172.21.15.139:0/1971790795 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4025630 con 0x557108112e80 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- 172.21.15.139:0/1971790795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 msgr2=0x557108113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f14a4011d80 tx=0x7f14a4014000 comp rx=0 tx=0).stop 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- 172.21.15.139:0/1971790795 shutdown_connections 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55710811e650 0x557108120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557108112e80 0x557108113260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/1971790795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- 172.21.15.139:0/1971790795 >> 172.21.15.139:0/1971790795 conn(0x557108088260 msgr2=0x55710810f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- 172.21.15.139:0/1971790795 shutdown_connections 2023-10-08T13:28:33.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- 172.21.15.139:0/1971790795 wait complete. 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 -- start start 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.483+0000 7f14c74b0b80 1 Processor -- start 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x55710811b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108066e30 con 0x5571081137a0 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108003710 con 0x55710811e650 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571080033b0 con 0x557108112e80 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14c74b0b80 10 client.0 _ll_register_callbacks cb 0x557107e60800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b8862700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40872/0 (socket says 172.21.15.139:40872) 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b8862700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41158/0 (socket says 172.21.15.139:41158) 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 -- 172.21.15.139:0/957702692 learned_addr learned my addr 172.21.15.139:0/957702692 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9864700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x55710811b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 -- 172.21.15.139:0/957702692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 msgr2=0x55710811b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x55710811b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 -- 172.21.15.139:0/957702692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 msgr2=0x55710811b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 -- 172.21.15.139:0/957702692 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b000b940 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b8862700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f14b9063700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14a4005920 tx=0x7f14a400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2f2374b8c84128 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.484+0000 7f149cff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401d410 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55710802eeb0 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f14a401d570 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14a401d730 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 10 client.25672 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f14a4017070 con 0x557108112e80 2023-10-08T13:28:33.494 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55710802eeb0 con 0x557108112e80 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f14a4004a20 con 0x557108112e80 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 10 client.25672 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 10 client.25672 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 20 client.25672 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55710812e040 0x557108130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 4 client.25672 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55710805fe10 con 0x55710812e040 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.485+0000 7f14b8862700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55710812e040 0x557108130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14b8862700 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55710812e040 0x557108130460 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=106bfde0822196e4 server_cookie=310fb1a3b670b962 in_seq=0 out_seq=0 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f149cff9700 10 client.25672 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f149cff9700 1 -- 172.21.15.139:0/957702692 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55710805fe10 con 0x55710812e040 2023-10-08T13:28:33.495 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f149cff9700 10 client.25672 handle_command_reply: tid=0 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 client.25672 shutdown 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 msgr2=0x55710811e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14a4005920 tx=0x7f14a400eb20 comp rx=0 tx=0).stop 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 shutdown_connections 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55710812e040 0x557108130460 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x55710811b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f149cff9700 0 client.25672 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x55710811e050 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/957702692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x55710811b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.486+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 >> 172.21.15.139:0/957702692 conn(0x557108088260 msgr2=0x55710810eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.496 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.487+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 shutdown_connections 2023-10-08T13:28:33.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.487+0000 7f14c74b0b80 1 -- 172.21.15.139:0/957702692 wait complete. 2023-10-08T13:28:33.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.487+0000 7f14c74b0b80 20 client.25672 trim_cache size 0 max 16384 2023-10-08T13:28:33.506 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 Processor -- start 2023-10-08T13:28:33.506 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 -- start start 2023-10-08T13:28:33.506 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 0x5571081251a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108119c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557107ee7920 con 0x557108112e80 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108110090 con 0x55710811e650 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108125710 con 0x5571081137a0 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41164/0 (socket says 172.21.15.139:41164) 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b8862700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 0x5571081251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 -- 172.21.15.139:0/887991149 learned_addr learned my addr 172.21.15.139:0/887991149 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9864700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.507 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 -- 172.21.15.139:0/887991149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 msgr2=0x5571081251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 0x5571081251a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 -- 172.21.15.139:0/887991149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 msgr2=0x557108119c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108119c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 -- 172.21.15.139:0/887991149 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557107e7ac60 con 0x557108112e80 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b8862700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 0x5571081251a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9864700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108119c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.500+0000 7f14b9063700 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14a4016040 tx=0x7f14a400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8507884aceedd908 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f149ffff700 1 -- 172.21.15.139:0/887991149 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a40046f0 con 0x557108112e80 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f149ffff700 1 -- 172.21.15.139:0/887991149 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14a401ee90 con 0x557108112e80 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f149ffff700 1 -- 172.21.15.139:0/887991149 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401d7d0 con 0x557108112e80 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 -- 172.21.15.139:0/887991149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 msgr2=0x557108115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.508 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14a4016040 tx=0x7f14a400eb90 comp rx=0 tx=0).stop 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 -- 172.21.15.139:0/887991149 shutdown_connections 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108119c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557108112e80 0x557108115db0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/887991149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571081137a0 0x5571081251a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 -- 172.21.15.139:0/887991149 >> 172.21.15.139:0/887991149 conn(0x557108088260 msgr2=0x55710810ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 -- 172.21.15.139:0/887991149 shutdown_connections 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.501+0000 7f14c74b0b80 1 -- 172.21.15.139:0/887991149 wait complete. 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 -- start start 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 Processor -- start 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x557108124920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.509 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108122e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108123420 con 0x5571081137a0 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108123590 con 0x55710811e650 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557108123750 con 0x557108112e80 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14c74b0b80 10 client.0 _ll_register_callbacks cb 0x7f14b000b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14b8862700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14b9063700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x557108124920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14b8862700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41172/0 (socket says 172.21.15.139:41172) 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14b8862700 1 -- 172.21.15.139:0/3201634928 learned_addr learned my addr 172.21.15.139:0/3201634928 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.502+0000 7f14b9864700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 -- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 msgr2=0x557108124920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.510 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x557108124920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 -- 172.21.15.139:0/3201634928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 msgr2=0x557108122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 -- 172.21.15.139:0/3201634928 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0014740 con 0x5571081137a0 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b9063700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x557108124920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b9864700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14b8862700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14b4195fa0 tx=0x7f14b000b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289898e6d25ad311 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b001d040 con 0x5571081137a0 2023-10-08T13:28:33.511 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f14b001ebb0 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14a4021070 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14b0010040 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 10 client.16191 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f14a4011e70 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14a4021070 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f14b0018400 con 0x5571081137a0 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 10 client.16191 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 10 client.16191 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 20 client.16191 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5571081830e0 0x557108185500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 4 client.16191 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:33.512 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.503+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55710805fb30 con 0x5571081830e0 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14b9063700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5571081830e0 0x557108185500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f149cff9700 10 client.16191 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14b9063700 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5571081830e0 0x557108185500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2ee9ae7b23d613f9 server_cookie=3351c65b2e249f3e in_seq=0 out_seq=0 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f149cff9700 1 -- 172.21.15.139:0/3201634928 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55710805fb30 con 0x5571081830e0 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f149cff9700 10 client.16191 handle_command_reply: tid=0 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 client.16191 shutdown 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 msgr2=0x557108124e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14b4195fa0 tx=0x7f14b000b470 comp rx=0 tx=0).stop 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 shutdown_connections 2023-10-08T13:28:33.513 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x5571081830e0 0x557108185500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55710811e650 0x557108122e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557108112e80 0x557108124920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f149cff9700 0 client.16191 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 --2- 172.21.15.139:0/3201634928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571081137a0 0x557108124e60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 >> 172.21.15.139:0/3201634928 conn(0x557108088260 msgr2=0x557108119b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 shutdown_connections 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.504+0000 7f14c74b0b80 1 -- 172.21.15.139:0/3201634928 wait complete. 2023-10-08T13:28:33.514 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14c74b0b80 20 client.16191 trim_cache size 0 max 16384 2023-10-08T13:28:33.515 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 msgr2=0x7f14a00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 0x7f14a00a3ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f14b4077ab0 tx=0x7f14a4009260 comp rx=0 tx=0).stop 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 msgr2=0x7f14b4199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f14ac01a040 tx=0x7f14ac00bcc0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 shutdown_connections 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14a00a15f0 0x7f14a00a3ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14b41056b0 0x7f14b4199360 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14b40ff620 0x7f14b4194a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 --2- 172.21.15.139:0/1008324943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14b40fffe0 0x7f14b4194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 >> 172.21.15.139:0/1008324943 conn(0x7f14b4076780 msgr2=0x7f14b40fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 shutdown_connections 2023-10-08T13:28:33.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.505+0000 7f14bb2c7700 1 -- 172.21.15.139:0/1008324943 wait complete. 2023-10-08T13:28:33.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T13:28:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.648+0000 7fa514bac700 1 -- 172.21.15.139:0/59066276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5100ff620 msgr2=0x7fa5100ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.648+0000 7fa514bac700 1 --2- 172.21.15.139:0/59066276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5100ff620 0x7fa5100ffaa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa504009990 tx=0x7fa504009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 -- 172.21.15.139:0/59066276 shutdown_connections 2023-10-08T13:28:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 --2- 172.21.15.139:0/59066276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 0x7fa51010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 --2- 172.21.15.139:0/59066276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5101056b0 0x7fa510105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 --2- 172.21.15.139:0/59066276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5100ff620 0x7fa5100ffaa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 -- 172.21.15.139:0/59066276 >> 172.21.15.139:0/59066276 conn(0x7fa510076780 msgr2=0x7fa510076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 -- 172.21.15.139:0/59066276 shutdown_connections 2023-10-08T13:28:33.651 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 -- 172.21.15.139:0/59066276 wait complete. 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 Processor -- start 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.649+0000 7fa514bac700 1 -- start start 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 0x7fa510197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 0x7fa510197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa510198700 con 0x7fa5101056b0 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101a2f10 con 0x7fa5100fffe0 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101a3050 con 0x7fa5100ff620 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41188/0 (socket says 172.21.15.139:41188) 2023-10-08T13:28:33.653 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 0x7fa510197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 -- 172.21.15.139:0/1995798829 learned_addr learned my addr 172.21.15.139:0/1995798829 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 0x7fa510197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 -- 172.21.15.139:0/1995798829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 msgr2=0x7fa510197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 0x7fa510197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 -- 172.21.15.139:0/1995798829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 msgr2=0x7fa510197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 0x7fa510197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 -- 172.21.15.139:0/1995798829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009520 con 0x7fa5101056b0 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 0x7fa510197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa508007ee0 tx=0x7fa50800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa4ff7fe700 1 -- 172.21.15.139:0/1995798829 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508017070 con 0x7fa5101056b0 2023-10-08T13:28:33.654 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040095f0 con 0x7fa5101056b0 2023-10-08T13:28:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa4ff7fe700 1 -- 172.21.15.139:0/1995798829 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50800f040 con 0x7fa5101056b0 2023-10-08T13:28:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.650+0000 7fa4ff7fe700 1 -- 172.21.15.139:0/1995798829 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508005580 con 0x7fa5101056b0 2023-10-08T13:28:33.655 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.651+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5101a35e0 con 0x7fa5101056b0 2023-10-08T13:28:33.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.653+0000 7fa4ff7fe700 1 -- 172.21.15.139:0/1995798829 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa50800db20 con 0x7fa5101056b0 2023-10-08T13:28:33.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.654+0000 7fa4ff7fe700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 0x7fa4f80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.660 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.654+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 0x7fa4f80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.654+0000 7fa4ff7fe700 1 -- 172.21.15.139:0/1995798829 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa5080ccbb0 con 0x7fa5101056b0 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.654+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 0x7fa4f80a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa500009fd0 tx=0x7fa500009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.654+0000 7fa520d95b80 1 Processor -- start 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 -- start start 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212ee2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212e3e460 con 0x55b212ed4e80 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212e2fc20 con 0x55b212ee0650 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa520d95b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212e2d540 con 0x55b212ed57a0 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.661 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41192/0 (socket says 172.21.15.139:41192) 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 -- 172.21.15.139:0/1208090779 learned_addr learned my addr 172.21.15.139:0/1208090779 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212ee2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 -- 172.21.15.139:0/1208090779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 msgr2=0x55b212ee0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 -- 172.21.15.139:0/1208090779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 msgr2=0x55b212ee2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212ee2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.655+0000 7fa50e59c700 1 -- 172.21.15.139:0/1208090779 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b212c53de0 con 0x55b212ed4e80 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa5000043b0 tx=0x7fa500018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c643ef0c1542cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa4fcff9700 1 -- 172.21.15.139:0/1208090779 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500003ce0 con 0x55b212ed4e80 2023-10-08T13:28:33.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa4fcff9700 1 -- 172.21.15.139:0/1208090779 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa500003e40 con 0x55b212ed4e80 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa4fcff9700 1 -- 172.21.15.139:0/1208090779 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50001e840 con 0x55b212ed4e80 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 -- 172.21.15.139:0/1208090779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 msgr2=0x55b212ed5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa5000043b0 tx=0x7fa500018000 comp rx=0 tx=0).stop 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 -- 172.21.15.139:0/1208090779 shutdown_connections 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212ee2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed4e80 0x55b212ed5260 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.656+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1208090779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- 172.21.15.139:0/1208090779 >> 172.21.15.139:0/1208090779 conn(0x55b212e4a260 msgr2=0x55b212ed12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- 172.21.15.139:0/1208090779 shutdown_connections 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- 172.21.15.139:0/1208090779 wait complete. 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- start start 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 Processor -- start 2023-10-08T13:28:33.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212eddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212e28e30 con 0x55b212ed57a0 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212dc5710 con 0x55b212ee0650 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212dc53b0 con 0x55b212ed4e80 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa520d95b80 10 client.0 _ll_register_callbacks cb 0x55b212c22800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41200/0 (socket says 172.21.15.139:41200) 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.657+0000 7fa50dd9b700 1 -- 172.21.15.139:0/1166670078 learned_addr learned my addr 172.21.15.139:0/1166670078 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212eddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 -- 172.21.15.139:0/1166670078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 msgr2=0x55b212ee0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 -- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 msgr2=0x55b212eddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212eddb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 -- 172.21.15.139:0/1166670078 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa500017050 con 0x55b212ed57a0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa504000c00 tx=0x7fa504005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128b37031964c48a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa4f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401d070 con 0x55b212ed57a0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa504004500 con 0x55b212ed57a0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b212df0eb0 con 0x55b212ed57a0 2023-10-08T13:28:33.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5040046c0 con 0x55b212ed57a0 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa520d95b80 10 client.16203 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b212c3cc60 con 0x55b212ed57a0 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.658+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b212df0eb0 con 0x55b212ed57a0 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa50400f8a0 con 0x55b212ed57a0 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 20 client.16203 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212ef0260 0x55b212ef2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 4 client.16203 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:33.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b212e21e10 con 0x55b212ef0260 2023-10-08T13:28:33.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212ef0260 0x55b212ef2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa4f5ffb700 10 client.16203 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:33.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.659+0000 7fa50e59c700 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212ef0260 0x55b212ef2680 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf7c71bb282ef65f server_cookie=64c188cca8f3e035 in_seq=0 out_seq=0 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/1166670078 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b212e21e10 con 0x55b212ef0260 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa4f5ffb700 10 client.16203 handle_command_reply: tid=0 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 client.16203 shutdown 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 msgr2=0x55b212edd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa504000c00 tx=0x7fa504005800 comp rx=0 tx=0).stop 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 shutdown_connections 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212ef0260 0x55b212ef2680 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212eddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa4f5ffb700 0 client.16203 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 --2- 172.21.15.139:0/1166670078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212edd420 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 >> 172.21.15.139:0/1166670078 conn(0x55b212e4a260 msgr2=0x55b212ed0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 shutdown_connections 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 1 -- 172.21.15.139:0/1166670078 wait complete. 2023-10-08T13:28:33.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.660+0000 7fa520d95b80 20 client.16203 trim_cache size 0 max 16384 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.673+0000 7fa520d95b80 1 Processor -- start 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.673+0000 7fa520d95b80 1 -- start start 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ed4e80 0x55b212eddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212ca9920 con 0x55b212ee0650 2023-10-08T13:28:33.676 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212ed5b80 con 0x55b212ed4e80 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa520d95b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212ed60d0 con 0x55b212ed57a0 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41210/0 (socket says 172.21.15.139:41210) 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 -- 172.21.15.139:0/3969440378 learned_addr learned my addr 172.21.15.139:0/3969440378 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50e59c700 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ed4e80 0x55b212eddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 -- 172.21.15.139:0/3969440378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 msgr2=0x55b212ee71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 -- 172.21.15.139:0/3969440378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ed4e80 msgr2=0x55b212eddb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ed4e80 0x55b212eddb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 -- 172.21.15.139:0/3969440378 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b212c7a250 con 0x55b212ee0650 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa50ed9d700 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa5080997e0 tx=0x7fa508084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26d9827a88cf621 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa4fd7fa700 1 -- 172.21.15.139:0/3969440378 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50809d9a0 con 0x55b212ee0650 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa4fd7fa700 1 -- 172.21.15.139:0/3969440378 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5080a1be0 con 0x55b212ee0650 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.674+0000 7fa4fd7fa700 1 -- 172.21.15.139:0/3969440378 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa508095f60 con 0x55b212ee0650 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- 172.21.15.139:0/3969440378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 msgr2=0x55b212ed8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa5080997e0 tx=0x7fa508084040 comp rx=0 tx=0).stop 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- 172.21.15.139:0/3969440378 shutdown_connections 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ee0650 0x55b212ed8750 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ed4e80 0x55b212eddb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 --2- 172.21.15.139:0/3969440378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed57a0 0x55b212ee71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- 172.21.15.139:0/3969440378 >> 172.21.15.139:0/3969440378 conn(0x55b212e4a260 msgr2=0x55b212eeb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- 172.21.15.139:0/3969440378 shutdown_connections 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- 172.21.15.139:0/3969440378 wait complete. 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 -- start start 2023-10-08T13:28:33.679 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.675+0000 7fa520d95b80 1 Processor -- start 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212f474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212f479e0 con 0x55b212ed57a0 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212f47b20 con 0x55b212ee0650 2023-10-08T13:28:33.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b212f47c90 con 0x55b212ed4e80 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 10 client.0 _ll_register_callbacks cb 0x7fa504005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41214/0 (socket says 172.21.15.139:41214) 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 -- 172.21.15.139:0/2141554097 learned_addr learned my addr 172.21.15.139:0/2141554097 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 -- 172.21.15.139:0/2141554097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 msgr2=0x55b212ee5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 -- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 msgr2=0x55b212f474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212f474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 -- 172.21.15.139:0/2141554097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5101a35e0 con 0x55b212ed57a0 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa50dd9b700 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa50400fd00 tx=0x7fa504005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83c4f255df27fa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.683 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa4f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50401d070 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa50400f660 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa500003e40 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa504005c40 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 10 client.16209 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.676+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b212c522b0 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa500003e40 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa504004500 con 0x55b212ed57a0 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 10 client.16209 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 20 client.16209 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212f49030 0x55b212f4b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 4 client.16209 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b212e21b30 con 0x55b212f49030 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa50e59c700 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212f49030 0x55b212f4b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa4f5ffb700 10 client.16209 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.677+0000 7fa50e59c700 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212f49030 0x55b212f4b450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b137dbfacfdb20e server_cookie=6812c6d0312b9b1f in_seq=0 out_seq=0 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa4f5ffb700 1 -- 172.21.15.139:0/2141554097 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b212e21b30 con 0x55b212f49030 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa4f5ffb700 10 client.16209 handle_command_reply: tid=0 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 client.16209 shutdown 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 msgr2=0x55b212ee58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa50400fd00 tx=0x7fa504005ac0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 shutdown_connections 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b212f49030 0x55b212f4b450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b212ee0650 0x55b212f474a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b212ed4e80 0x55b212ee5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa4f5ffb700 0 client.16209 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 --2- 172.21.15.139:0/2141554097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b212ed57a0 0x55b212ee58b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 >> 172.21.15.139:0/2141554097 conn(0x55b212e4a260 msgr2=0x55b212ed8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 shutdown_connections 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 1 -- 172.21.15.139:0/2141554097 wait complete. 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa520d95b80 20 client.16209 trim_cache size 0 max 16384 2023-10-08T13:28:33.686 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:33.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 msgr2=0x7fa4f80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 0x7fa4f80a3ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa500009fd0 tx=0x7fa500009260 comp rx=0 tx=0).stop 2023-10-08T13:28:33.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 msgr2=0x7fa5101a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.687 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fa508007ee0 tx=0x7fa50800d3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 shutdown_connections 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa4f80a15f0 0x7fa4f80a3ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa5101056b0 0x7fa5101a29d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5100ff620 0x7fa510197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 --2- 172.21.15.139:0/1995798829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5100fffe0 0x7fa510197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 >> 172.21.15.139:0/1995798829 conn(0x7fa510076780 msgr2=0x7fa5100fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 shutdown_connections 2023-10-08T13:28:33.688 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.678+0000 7fa514bac700 1 -- 172.21.15.139:0/1995798829 wait complete. 2023-10-08T13:28:33.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T13:28:33.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 -- 172.21.15.139:0/2480914145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 msgr2=0x7ffb7c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 --2- 172.21.15.139:0/2480914145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c105a90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b0a0 tx=0x7ffb7400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 -- 172.21.15.139:0/2480914145 shutdown_connections 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 --2- 172.21.15.139:0/2480914145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 --2- 172.21.15.139:0/2480914145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c105a90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 --2- 172.21.15.139:0/2480914145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 -- 172.21.15.139:0/2480914145 >> 172.21.15.139:0/2480914145 conn(0x7ffb7c076780 msgr2=0x7ffb7c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 -- 172.21.15.139:0/2480914145 shutdown_connections 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.821+0000 7ffb813ef700 1 -- 172.21.15.139:0/2480914145 wait complete. 2023-10-08T13:28:33.823 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 Processor -- start 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 -- start start 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c19bce0 con 0x7ffb7c1056b0 2023-10-08T13:28:33.825 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c19be50 con 0x7ffb7c0ff620 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb813ef700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c19c010 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb7a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41230/0 (socket says 172.21.15.139:41230) 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.822+0000 7ffb7b7fe700 1 -- 172.21.15.139:0/772513735 learned_addr learned my addr 172.21.15.139:0/772513735 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7affd700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/772513735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 msgr2=0x7ffb7c196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 msgr2=0x7ffb7c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.826 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/772513735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64009520 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.827 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7affd700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c197300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400e9f0 tx=0x7ffb6400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb73fff700 1 -- 172.21.15.139:0/772513735 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400cb70 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb74009d00 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb73fff700 1 -- 172.21.15.139:0/772513735 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb640044e0 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c19c4e0 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.829 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.823+0000 7ffb73fff700 1 -- 172.21.15.139:0/772513735 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64003d00 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.826+0000 7ffb73fff700 1 -- 172.21.15.139:0/772513735 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7ffb64003fa0 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.835 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb73fff700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 0x7ffb680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb7affd700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 0x7ffb680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb73fff700 1 -- 172.21.15.139:0/772513735 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffb64014070 con 0x7ffb7c0fffe0 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 Processor -- start 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 -- start start 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb7affd700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 0x7ffb680a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b780 tx=0x7ffb74009c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251bd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251bda60 0x5557251bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555725117460 con 0x5557251ade80 2023-10-08T13:28:33.836 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555725108c20 con 0x5557251ae7a0 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555725106540 con 0x5557251bda60 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.827+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41234/0 (socket says 172.21.15.139:41234) 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 -- 172.21.15.139:0/2513677299 learned_addr learned my addr 172.21.15.139:0/2513677299 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251bda60 0x5557251bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 -- 172.21.15.139:0/2513677299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251bda60 msgr2=0x5557251bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251bda60 0x5557251bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 -- 172.21.15.139:0/2513677299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 msgr2=0x5557251bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251bd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 -- 172.21.15.139:0/2513677299 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555724f2cde0 con 0x5557251ade80 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009cd0 tx=0x7ffb7401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2663a1bc14c159 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.837 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb717fa700 1 -- 172.21.15.139:0/2513677299 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74004c50 con 0x5557251ade80 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb717fa700 1 -- 172.21.15.139:0/2513677299 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb74007e90 con 0x5557251ade80 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.828+0000 7ffb717fa700 1 -- 172.21.15.139:0/2513677299 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740056b0 con 0x5557251ade80 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2513677299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 msgr2=0x5557251ae260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009cd0 tx=0x7ffb7401b000 comp rx=0 tx=0).stop 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2513677299 shutdown_connections 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251bda60 0x5557251bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251ae260 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2513677299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251bd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2513677299 >> 172.21.15.139:0/2513677299 conn(0x555725123260 msgr2=0x5557251aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2513677299 shutdown_connections 2023-10-08T13:28:33.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2513677299 wait complete. 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 -- start start 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.829+0000 7ffb8d5d8b80 1 Processor -- start 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 0x5557251bae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555725101e30 con 0x5557251ade80 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572509e710 con 0x5557251bda60 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572509e3b0 con 0x5557251ae7a0 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41240/0 (socket says 172.21.15.139:41240) 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 -- 172.21.15.139:0/2444738137 learned_addr learned my addr 172.21.15.139:0/2444738137 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb8d5d8b80 10 client.0 _ll_register_callbacks cb 0x555724efb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 0x5557251bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 -- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 msgr2=0x5557251ba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251ba7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 -- 172.21.15.139:0/2444738137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 msgr2=0x5557251bae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 0x5557251bae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 -- 172.21.15.139:0/2444738137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c067830 con 0x5557251ade80 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 0x5557251bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251ba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb7affd700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400afe0 tx=0x7ffb740099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaf257360ce3ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb627fc700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:33.840 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74005500 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.830+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffb74023050 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557250c9eb0 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb74005660 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 10 client.16221 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555724f15c60 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5557250c9eb0 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffb74033ce0 con 0x5557251ade80 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 20 client.16221 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5557251cd0e0 0x5557251cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.841 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 4 client.16221 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557250fae10 con 0x5557251cd0e0 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.831+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5557251cd0e0 0x5557251cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb627fc700 10 client.16221 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5557251cd0e0 0x5557251cf4d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=608fd96a05d7c1ef server_cookie=8e8549c4e7497fae in_seq=0 out_seq=0 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb627fc700 1 -- 172.21.15.139:0/2444738137 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557250fae10 con 0x5557251cd0e0 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb627fc700 10 client.16221 handle_command_reply: tid=0 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 client.16221 shutdown 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 msgr2=0x5557251bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400afe0 tx=0x7ffb740099e0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 shutdown_connections 2023-10-08T13:28:33.842 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251bda60 0x5557251bae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251ade80 0x5557251bd460 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5557251cd0e0 0x5557251cf4d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/2444738137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251ba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb627fc700 0 client.16221 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 >> 172.21.15.139:0/2444738137 conn(0x555725123260 msgr2=0x5557251a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.832+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 shutdown_connections 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.833+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/2444738137 wait complete. 2023-10-08T13:28:33.843 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.833+0000 7ffb8d5d8b80 20 client.16221 trim_cache size 0 max 16384 2023-10-08T13:28:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.845+0000 7ffb8d5d8b80 1 Processor -- start 2023-10-08T13:28:33.846 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.845+0000 7ffb8d5d8b80 1 -- start start 2023-10-08T13:28:33.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ade80 0x5557251bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.852 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555724f82920 con 0x5557251bda60 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557251b0d50 con 0x5557251ade80 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557251af0d0 con 0x5557251ae7a0 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41252/0 (socket says 172.21.15.139:41252) 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7b7fe700 1 -- 172.21.15.139:0/3057059625 learned_addr learned my addr 172.21.15.139:0/3057059625 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7affd700 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ade80 0x5557251bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/3057059625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ade80 msgr2=0x5557251bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ade80 0x5557251bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/3057059625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 msgr2=0x5557251b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.853 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 -- 172.21.15.139:0/3057059625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555724f53250 con 0x5557251ae7a0 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251c4590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb640cac30 tx=0x7ffb64003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b37e51c38668fc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb71ffb700 1 -- 172.21.15.139:0/3057059625 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6401e2e0 con 0x5557251ae7a0 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb71ffb700 1 -- 172.21.15.139:0/3057059625 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb6409abc0 con 0x5557251ae7a0 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.846+0000 7ffb71ffb700 1 -- 172.21.15.139:0/3057059625 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400cd60 con 0x5557251ae7a0 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/3057059625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 msgr2=0x5557251c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251c4590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb640cac30 tx=0x7ffb64003f30 comp rx=0 tx=0).stop 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/3057059625 shutdown_connections 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x5557251b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ade80 0x5557251bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.854 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/3057059625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ae7a0 0x5557251c4590 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/3057059625 >> 172.21.15.139:0/3057059625 conn(0x555725123260 msgr2=0x5557251a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/3057059625 shutdown_connections 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/3057059625 wait complete. 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 -- start start 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.847+0000 7ffb8d5d8b80 1 Processor -- start 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 0x5557251c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572521a390 con 0x5557251bda60 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572521a500 con 0x5557251ae7a0 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55572521a6c0 con 0x5557251ade80 2023-10-08T13:28:33.855 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 10 client.0 _ll_register_callbacks cb 0x7ffb6c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 0x5557251c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 0x5557251c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:40970/0 (socket says 172.21.15.139:40970) 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41258/0 (socket says 172.21.15.139:41258) 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7affd700 1 -- 172.21.15.139:0/1301147270 learned_addr learned my addr 172.21.15.139:0/1301147270 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7a7fc700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 -- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 msgr2=0x5557251c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 0x5557251c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 -- 172.21.15.139:0/1301147270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 msgr2=0x5557251c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 -- 172.21.15.139:0/1301147270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c007e20 con 0x5557251bda60 2023-10-08T13:28:33.856 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb7b7fe700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005e90 tx=0x7ffb6c012ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38977507dce183e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb627fc700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c020070 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb74007e90 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.848+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffb6c010b40 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb6c010d00 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 10 client.16227 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ffb7c19c4e0 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb74007e90 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffb6c023020 con 0x5557251bda60 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 10 client.16227 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:28:33.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 20 client.16227 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x555725221f60 0x555725224380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 4 client.16227 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5557250fab30 con 0x555725221f60 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb7affd700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x555725221f60 0x555725224380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb627fc700 10 client.16227 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.849+0000 7ffb7affd700 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x555725221f60 0x555725224380 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aff12f96471486ab server_cookie=f6923b489a9f0b83 in_seq=0 out_seq=0 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb627fc700 1 -- 172.21.15.139:0/1301147270 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5557250fab30 con 0x555725221f60 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb627fc700 10 client.16227 handle_command_reply: tid=0 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 client.16227 shutdown 2023-10-08T13:28:33.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 msgr2=0x555725219e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c005e90 tx=0x7ffb6c012ce0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 shutdown_connections 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5557251bda60 0x555725219e50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x555725221f60 0x555725224380 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5557251ade80 0x5557251c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb627fc700 0 client.16227 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 --2- 172.21.15.139:0/1301147270 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5557251ae7a0 0x5557251c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 >> 172.21.15.139:0/1301147270 conn(0x555725123260 msgr2=0x5557251b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 shutdown_connections 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 1 -- 172.21.15.139:0/1301147270 wait complete. 2023-10-08T13:28:33.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb8d5d8b80 20 client.16227 trim_cache size 0 max 16384 2023-10-08T13:28:33.860 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 msgr2=0x7ffb680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 0x7ffb680a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400b780 tx=0x7ffb74009c60 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 msgr2=0x7ffb7c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c197300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400e9f0 tx=0x7ffb6400ed00 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 shutdown_connections 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffb680a15f0 0x7ffb680a3ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb7c1056b0 0x7ffb7c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb7c0ff620 0x7ffb7c196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 --2- 172.21.15.139:0/772513735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb7c0fffe0 0x7ffb7c197300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.850+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 >> 172.21.15.139:0/772513735 conn(0x7ffb7c076780 msgr2=0x7ffb7c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.851+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 shutdown_connections 2023-10-08T13:28:33.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.851+0000 7ffb813ef700 1 -- 172.21.15.139:0/772513735 wait complete. 2023-10-08T13:28:33.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:33 smithi139 ceph-mon[99506]: pgmap v331: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:33.862 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2082859995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:33.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:28:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:33 smithi187 ceph-mon[104336]: pgmap v331: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2082859995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.986+0000 7ff8043c8700 1 -- 172.21.15.139:0/2511627935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc0fef50 msgr2=0x7ff7fc0ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.986+0000 7ff8043c8700 1 --2- 172.21.15.139:0/2511627935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc0ff330 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009990 tx=0x7ff7f8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- 172.21.15.139:0/2511627935 shutdown_connections 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- 172.21.15.139:0/2511627935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- 172.21.15.139:0/2511627935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc0ff330 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- 172.21.15.139:0/2511627935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc0ff900 0x7ff7fc1053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- 172.21.15.139:0/2511627935 >> 172.21.15.139:0/2511627935 conn(0x7ff7fc075c20 msgr2=0x7ff7fc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- 172.21.15.139:0/2511627935 shutdown_connections 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- 172.21.15.139:0/2511627935 wait complete. 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 Processor -- start 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- start start 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc197440 con 0x7ff7fc1969c0 2023-10-08T13:28:33.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1975b0 con 0x7ff7fc105aa0 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.987+0000 7ff8043c8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc197770 con 0x7ff7fc0fef50 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41272/0 (socket says 172.21.15.139:41272) 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 -- 172.21.15.139:0/1558302486 learned_addr learned my addr 172.21.15.139:0/1558302486 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802164700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff801963700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 -- 172.21.15.139:0/1558302486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0fef50 msgr2=0x7ff7fc19c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc19c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 -- 172.21.15.139:0/1558302486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 msgr2=0x7ff7fc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 -- 172.21.15.139:0/1558302486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80095f0 con 0x7ff7fc1969c0 2023-10-08T13:28:33.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff801963700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff802965700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400ef30 tx=0x7ff7f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff7f37fe700 1 -- 172.21.15.139:0/1558302486 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4018070 con 0x7ff7fc1969c0 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc1a3700 con 0x7ff7fc1969c0 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff7f37fe700 1 -- 172.21.15.139:0/1558302486 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7f400f040 con 0x7ff7fc1969c0 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff7f37fe700 1 -- 172.21.15.139:0/1558302486 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400cdb0 con 0x7ff7fc1969c0 2023-10-08T13:28:33.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.988+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1a3c30 con 0x7ff7fc1969c0 2023-10-08T13:28:33.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.990+0000 7ff7f37fe700 1 -- 172.21.15.139:0/1558302486 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7ff7f4003a00 con 0x7ff7fc1969c0 2023-10-08T13:28:33.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.991+0000 7ff7f37fe700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 0x7ff7e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:33.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.991+0000 7ff7f37fe700 1 -- 172.21.15.139:0/1558302486 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff7f40ccfc0 con 0x7ff7fc1969c0 2023-10-08T13:28:33.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.991+0000 7ff802164700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 0x7ff7e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.991+0000 7ff802164700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 0x7ff7e80a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800b2e0 tx=0x7ff7f8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 Processor -- start 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 -- start start 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0cfe80 0x55d39c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c039460 con 0x55d39c0db650 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c02ac20 con 0x55d39c0cfe80 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c028540 con 0x55d39c0d07a0 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41280/0 (socket says 172.21.15.139:41280) 2023-10-08T13:28:34.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 -- 172.21.15.139:0/610522273 learned_addr learned my addr 172.21.15.139:0/610522273 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff801963700 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802164700 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0cfe80 0x55d39c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 -- 172.21.15.139:0/610522273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 msgr2=0x55d39c0db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 -- 172.21.15.139:0/610522273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0cfe80 msgr2=0x55d39c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.992+0000 7ff802965700 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0cfe80 0x55d39c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff802965700 1 -- 172.21.15.139:0/610522273 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39be4ede0 con 0x55d39c0db650 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff802965700 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40961f0 tx=0x7ff7f4099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcdd045e3135eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff7f0d82700 1 -- 172.21.15.139:0/610522273 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4004ad0 con 0x55d39c0db650 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff7f0d82700 1 -- 172.21.15.139:0/610522273 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7f401b320 con 0x55d39c0db650 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff7f0d82700 1 -- 172.21.15.139:0/610522273 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4099f50 con 0x55d39c0db650 2023-10-08T13:28:34.001 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff8105b1b80 1 -- 172.21.15.139:0/610522273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 msgr2=0x55d39c0dda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40961f0 tx=0x7ff7f4099b40 comp rx=0 tx=0).stop 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.993+0000 7ff8105b1b80 1 -- 172.21.15.139:0/610522273 shutdown_connections 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0db650 0x55d39c0dda40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0cfe80 0x55d39c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/610522273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- 172.21.15.139:0/610522273 >> 172.21.15.139:0/610522273 conn(0x55d39c045260 msgr2=0x55d39c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- 172.21.15.139:0/610522273 shutdown_connections 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- 172.21.15.139:0/610522273 wait complete. 2023-10-08T13:28:34.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- start start 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 Processor -- start 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 0x55d39c0d8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 0x55d39c0d8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c023e30 con 0x55d39c0cfe80 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39bfc0710 con 0x55d39c0d07a0 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39bfc03b0 con 0x55d39c0db650 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff8105b1b80 10 client.0 _ll_register_callbacks cb 0x55d39be1d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff802164700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff802164700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41282/0 (socket says 172.21.15.139:41282) 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.994+0000 7ff802164700 1 -- 172.21.15.139:0/2645787810 learned_addr learned my addr 172.21.15.139:0/2645787810 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802965700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 0x55d39c0d8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff801963700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 0x55d39c0d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 -- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 msgr2=0x55d39c0d8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 0x55d39c0d8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 -- 172.21.15.139:0/2645787810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 msgr2=0x55d39c0d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 0x55d39c0d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 -- 172.21.15.139:0/2645787810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40b9040 con 0x55d39c0cfe80 2023-10-08T13:28:34.004 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff801963700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 0x55d39c0d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802965700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 0x55d39c0d8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff802164700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8015000 tx=0x7ff7f801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a67ff5579d5b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff7e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800be80 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff7f800f460 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d39bfebeb0 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f800f620 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff8105b1b80 10 client.16239 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d39be37c60 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.995+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d39bfebeb0 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff7f80307c0 con 0x55d39c0cfe80 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 10 client.16239 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:34.005 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 20 client.16239 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c0eb2e0 0x55d39c0ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 4 client.16239 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d39c01ce10 con 0x55d39c0eb2e0 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff801963700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c0eb2e0 0x55d39c0ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff7e5ffb700 10 client.16239 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.996+0000 7ff801963700 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c0eb2e0 0x55d39c0ed700 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8533936e655c3bf8 server_cookie=7532396793e64ee0 in_seq=0 out_seq=0 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2645787810 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d39c01ce10 con 0x55d39c0eb2e0 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff7e5ffb700 10 client.16239 handle_command_reply: tid=0 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 client.16239 shutdown 2023-10-08T13:28:34.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 msgr2=0x55d39c0db110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8015000 tx=0x7ff7f801a050 comp rx=0 tx=0).stop 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 shutdown_connections 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0db650 0x55d39c0d8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0db110 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c0eb2e0 0x55d39c0ed700 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2645787810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0d07a0 0x55d39c0d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff7e5ffb700 0 client.16239 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 >> 172.21.15.139:0/2645787810 conn(0x55d39c045260 msgr2=0x55d39c0cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 shutdown_connections 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2645787810 wait complete. 2023-10-08T13:28:34.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:33.997+0000 7ff8105b1b80 20 client.16239 trim_cache size 0 max 16384 2023-10-08T13:28:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 Processor -- start 2023-10-08T13:28:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 -- start start 2023-10-08T13:28:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39bea4920 con 0x55d39c0cfe80 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c0d9a00 con 0x55d39c0db650 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c0d10d0 con 0x55d39c0d07a0 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff802164700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff802164700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41290/0 (socket says 172.21.15.139:41290) 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.010+0000 7ff802164700 1 -- 172.21.15.139:0/693815059 learned_addr learned my addr 172.21.15.139:0/693815059 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff801963700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802965700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.021 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 -- 172.21.15.139:0/693815059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 msgr2=0x55d39c0e21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 -- 172.21.15.139:0/693815059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 msgr2=0x55d39c0d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 -- 172.21.15.139:0/693815059 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d39be75250 con 0x55d39c0cfe80 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802965700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff802164700 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009990 tx=0x7ff7f8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f7b9808989bd5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff7f1583700 1 -- 172.21.15.139:0/693815059 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8004b70 con 0x55d39c0cfe80 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff7f1583700 1 -- 172.21.15.139:0/693815059 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7f801e040 con 0x55d39c0cfe80 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.011+0000 7ff7f1583700 1 -- 172.21.15.139:0/693815059 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8024a40 con 0x55d39c0cfe80 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- 172.21.15.139:0/693815059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 msgr2=0x55d39c0ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.022 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009990 tx=0x7ff7f8005e80 comp rx=0 tx=0).stop 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- 172.21.15.139:0/693815059 shutdown_connections 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0cfe80 0x55d39c0ed6d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/693815059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0d07a0 0x55d39c0e21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- 172.21.15.139:0/693815059 >> 172.21.15.139:0/693815059 conn(0x55d39c045260 msgr2=0x55d39c0cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- 172.21.15.139:0/693815059 shutdown_connections 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- 172.21.15.139:0/693815059 wait complete. 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- start start 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 Processor -- start 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0cfe80 0x55d39c0e0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c13e0d0 con 0x55d39c0d07a0 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c13e210 con 0x55d39c0db650 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d39c13e350 con 0x55d39c0cfe80 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff8105b1b80 10 client.0 _ll_register_callbacks cb 0x7ff7f800ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff801963700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff801963700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41298/0 (socket says 172.21.15.139:41298) 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.012+0000 7ff801963700 1 -- 172.21.15.139:0/2280171884 learned_addr learned my addr 172.21.15.139:0/2280171884 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff802965700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 -- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0cfe80 msgr2=0x55d39c0e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0cfe80 0x55d39c0e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 -- 172.21.15.139:0/2280171884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 msgr2=0x55d39c0e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0e0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 -- 172.21.15.139:0/2280171884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d39be37c60 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff802965700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0e0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff801963700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc197b80 tx=0x7ff7ec011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d86f73dd999e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec019810 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ff7ec019970 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7f401b320 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7ec019b30 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 10 client.16245 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d39be4d2b0 con 0x55d39c0d07a0 2023-10-08T13:28:34.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7f401b320 con 0x55d39c0d07a0 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff7ec004980 con 0x55d39c0d07a0 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 10 client.16245 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 20 client.16245 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c13fac0 0x55d39c141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 4 client.16245 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.013+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d39c01cb30 con 0x55d39c13fac0 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff802164700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c13fac0 0x55d39c141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff7e5ffb700 10 client.16245 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff802164700 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c13fac0 0x55d39c141ee0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e95bb647e2cd4a51 server_cookie=b979b9f4e75aeb43 in_seq=0 out_seq=0 2023-10-08T13:28:34.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff7e5ffb700 1 -- 172.21.15.139:0/2280171884 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d39c01cb30 con 0x55d39c13fac0 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff7e5ffb700 10 client.16245 handle_command_reply: tid=0 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 client.16245 shutdown 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 msgr2=0x55d39c0e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc197b80 tx=0x7ff7ec011720 comp rx=0 tx=0).stop 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 shutdown_connections 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55d39c13fac0 0x55d39c141ee0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39c0db650 0x55d39c0e0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff7e5ffb700 0 client.16245 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d39c0cfe80 0x55d39c0e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 --2- 172.21.15.139:0/2280171884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d39c0d07a0 0x55d39c0e06c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 >> 172.21.15.139:0/2280171884 conn(0x55d39c045260 msgr2=0x55d39c0d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 shutdown_connections 2023-10-08T13:28:34.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 1 -- 172.21.15.139:0/2280171884 wait complete. 2023-10-08T13:28:34.028 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.014+0000 7ff8105b1b80 20 client.16245 trim_cache size 0 max 16384 2023-10-08T13:28:34.028 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 msgr2=0x7ff7e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 0x7ff7e80a3ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800b2e0 tx=0x7ff7f8005960 comp rx=0 tx=0).stop 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 msgr2=0x7ff7fc196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400ef30 tx=0x7ff7f400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 shutdown_connections 2023-10-08T13:28:34.029 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff7e80a15f0 0x7ff7e80a3ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7fc1969c0 0x7ff7fc196e70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0fef50 0x7ff7fc19c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 --2- 172.21.15.139:0/1558302486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7fc105aa0 0x7ff7fc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 >> 172.21.15.139:0/1558302486 conn(0x7ff7fc075c20 msgr2=0x7ff7fc103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 shutdown_connections 2023-10-08T13:28:34.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:34.015+0000 7ff8043c8700 1 -- 172.21.15.139:0/1558302486 wait complete. 2023-10-08T13:28:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:33 smithi155 ceph-mon[103467]: pgmap v331: 129 pgs: 129 active+clean; 1.3 MiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T13:28:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2082859995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:28:35.031 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:28:35.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.169+0000 7f851ae4c700 1 -- 172.21.15.139:0/3725295705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 msgr2=0x7f8514105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.169+0000 7f851ae4c700 1 --2- 172.21.15.139:0/3725295705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f8514105a90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8508009990 tx=0x7f8508009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.169+0000 7f851ae4c700 1 -- 172.21.15.139:0/3725295705 shutdown_connections 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- 172.21.15.139:0/3725295705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f851410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- 172.21.15.139:0/3725295705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f8514105a90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- 172.21.15.139:0/3725295705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 0x7f85140ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- 172.21.15.139:0/3725295705 >> 172.21.15.139:0/3725295705 conn(0x7f8514076780 msgr2=0x7f8514076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- 172.21.15.139:0/3725295705 shutdown_connections 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- 172.21.15.139:0/3725295705 wait complete. 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 Processor -- start 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- start start 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 0x7f85141979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f8514197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141987a0 con 0x7f85141056b0 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141a2f80 con 0x7f85140fffe0 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.170+0000 7f851ae4c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141a30c0 con 0x7f85140ff620 2023-10-08T13:28:35.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41314/0 (socket says 172.21.15.139:41314) 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 -- 172.21.15.139:0/2489064971 learned_addr learned my addr 172.21.15.139:0/2489064971 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8518be8700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 0x7f85141979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8513fff700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f8514197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 -- 172.21.15.139:0/2489064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 msgr2=0x7f85141979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 0x7f85141979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 -- 172.21.15.139:0/2489064971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 msgr2=0x7f8514197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f8514197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 -- 172.21.15.139:0/2489064971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85080095f0 con 0x7f85141056b0 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8513fff700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f8514197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:35.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f85193e9700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f850c007f10 tx=0x7f850c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8511ffb700 1 -- 172.21.15.139:0/2489064971 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00ddd0 con 0x7f85141056b0 2023-10-08T13:28:35.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85141a3370 con 0x7f85141056b0 2023-10-08T13:28:35.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8511ffb700 1 -- 172.21.15.139:0/2489064971 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f850c00f040 con 0x7f85141056b0 2023-10-08T13:28:35.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f8511ffb700 1 -- 172.21.15.139:0/2489064971 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c015400 con 0x7f85141056b0 2023-10-08T13:28:35.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.171+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85141a3880 con 0x7f85141056b0 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.174+0000 7f8511ffb700 1 -- 172.21.15.139:0/2489064971 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f850c004020 con 0x7f85141056b0 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.174+0000 7f8511ffb700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 0x7f85040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.175+0000 7f8518be8700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 0x7f85040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.175+0000 7f8511ffb700 1 -- 172.21.15.139:0/2489064971 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f850c0cce10 con 0x7f85141056b0 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.175+0000 7f8518be8700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 0x7f85040a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8508005850 tx=0x7f850801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 Processor -- start 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 -- start start 2023-10-08T13:28:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d12ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5c6e4e0 con 0x5647b5d05820 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5c5fca0 con 0x5647b5d106d0 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8527035b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5c5d5c0 con 0x5647b5d04f00 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41320/0 (socket says 172.21.15.139:41320) 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 -- 172.21.15.139:0/911649688 learned_addr learned my addr 172.21.15.139:0/911649688 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8518be8700 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f85193e9700 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d12ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 -- 172.21.15.139:0/911649688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 msgr2=0x5647b5d052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 -- 172.21.15.139:0/911649688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 msgr2=0x5647b5d12ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d12ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 -- 172.21.15.139:0/911649688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647b5a83e60 con 0x5647b5d05820 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.176+0000 7f8513fff700 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8500009c70 tx=0x7f8500009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2a7ec08f27f14b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f84feffd700 1 -- 172.21.15.139:0/911649688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000eb00 con 0x5647b5d05820 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f84feffd700 1 -- 172.21.15.139:0/911649688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8500004cf0 con 0x5647b5d05820 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f84feffd700 1 -- 172.21.15.139:0/911649688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500005680 con 0x5647b5d05820 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 -- 172.21.15.139:0/911649688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 msgr2=0x5647b5d10190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8500009c70 tx=0x7f8500009f80 comp rx=0 tx=0).stop 2023-10-08T13:28:35.181 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 -- 172.21.15.139:0/911649688 shutdown_connections 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d12ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 --2- 172.21.15.139:0/911649688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d10190 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 -- 172.21.15.139:0/911649688 >> 172.21.15.139:0/911649688 conn(0x5647b5c7a2e0 msgr2=0x5647b5d01350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 -- 172.21.15.139:0/911649688 shutdown_connections 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.177+0000 7f8527035b80 1 -- 172.21.15.139:0/911649688 wait complete. 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 -- start start 2023-10-08T13:28:35.182 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 Processor -- start 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d106d0 0x5647b5d0dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5c58eb0 con 0x5647b5d05820 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5bf5790 con 0x5647b5d04f00 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.178+0000 7f8527035b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5bf5430 con 0x5647b5d106d0 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8527035b80 10 client.0 _ll_register_callbacks cb 0x5647b5a52880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:35.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41326/0 (socket says 172.21.15.139:41326) 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 -- 172.21.15.139:0/1399658993 learned_addr learned my addr 172.21.15.139:0/1399658993 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8518be8700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f85193e9700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d106d0 0x5647b5d0dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 -- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d106d0 msgr2=0x5647b5d0dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d106d0 0x5647b5d0dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 -- 172.21.15.139:0/1399658993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 msgr2=0x5647b5d100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 -- 172.21.15.139:0/1399658993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85000098a0 con 0x5647b5d05820 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8513fff700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f85000059d0 tx=0x7f85000055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc6db3249a6923e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f84f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500021070 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8500004960 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647b5c20f30 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8500005ee0 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8527035b80 10 client.16257 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.179+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5647b5a6cce0 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f850002e080 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f850000c070 con 0x5647b5d05820 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 10 client.16257 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:35.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 20 client.16257 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d200e0 0x5647b5d22500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 4 client.16257 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647b5c51e90 con 0x5647b5d200e0 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8518be8700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d200e0 0x5647b5d22500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f84f3fff700 10 client.16257 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.180+0000 7f8518be8700 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d200e0 0x5647b5d22500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e4ff868af3df749 server_cookie=cc5a0517a2a3e165 in_seq=0 out_seq=0 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f84f3fff700 1 -- 172.21.15.139:0/1399658993 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5647b5c51e90 con 0x5647b5d200e0 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f84f3fff700 10 client.16257 handle_command_reply: tid=0 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 client.16257 shutdown 2023-10-08T13:28:35.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 msgr2=0x5647b5d0d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f85000059d0 tx=0x7f85000055e0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 shutdown_connections 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d106d0 0x5647b5d0dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d200e0 0x5647b5d22500 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f84f3fff700 0 client.16257 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 --2- 172.21.15.139:0/1399658993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d0d4c0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 >> 172.21.15.139:0/1399658993 conn(0x5647b5c7a2e0 msgr2=0x5647b5d00f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 shutdown_connections 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.181+0000 7f8527035b80 1 -- 172.21.15.139:0/1399658993 wait complete. 2023-10-08T13:28:35.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.182+0000 7f8527035b80 20 client.16257 trim_cache size 0 max 16384 2023-10-08T13:28:35.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.198+0000 7f8527035b80 1 Processor -- start 2023-10-08T13:28:35.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.198+0000 7f8527035b80 1 -- start start 2023-10-08T13:28:35.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d17220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d05820 0x5647b5d1b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5ad99a0 con 0x5647b5d106d0 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5d061b0 con 0x5647b5d04f00 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8527035b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5d1ff40 con 0x5647b5d05820 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41336/0 (socket says 172.21.15.139:41336) 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 -- 172.21.15.139:0/1767605127 learned_addr learned my addr 172.21.15.139:0/1767605127 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8513fff700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d05820 0x5647b5d1b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8518be8700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d17220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 -- 172.21.15.139:0/1767605127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d05820 msgr2=0x5647b5d1b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d05820 0x5647b5d1b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 -- 172.21.15.139:0/1767605127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 msgr2=0x5647b5d17220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d17220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 -- 172.21.15.139:0/1767605127 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647b5aaa2d0 con 0x5647b5d106d0 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f8518be8700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d17220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f85193e9700 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f850c099750 tx=0x7f850c0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d75893e4961b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f84ff7fe700 1 -- 172.21.15.139:0/1767605127 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c09a150 con 0x5647b5d106d0 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f84ff7fe700 1 -- 172.21.15.139:0/1767605127 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f850c099a50 con 0x5647b5d106d0 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.199+0000 7f84ff7fe700 1 -- 172.21.15.139:0/1767605127 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c099f10 con 0x5647b5d106d0 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- 172.21.15.139:0/1767605127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 msgr2=0x5647b5d1beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f850c099750 tx=0x7f850c0049e0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- 172.21.15.139:0/1767605127 shutdown_connections 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d106d0 0x5647b5d1beb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d04f00 0x5647b5d17220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 --2- 172.21.15.139:0/1767605127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d05820 0x5647b5d1b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- 172.21.15.139:0/1767605127 >> 172.21.15.139:0/1767605127 conn(0x5647b5c7a2e0 msgr2=0x5647b5d0bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- 172.21.15.139:0/1767605127 shutdown_connections 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- 172.21.15.139:0/1767605127 wait complete. 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 -- start start 2023-10-08T13:28:35.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.200+0000 7f8527035b80 1 Processor -- start 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d69eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d6a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5d74f30 con 0x5647b5d05820 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5d75070 con 0x5647b5d106d0 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b5d751b0 con 0x5647b5d04f00 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8527035b80 10 client.0 _ll_register_callbacks cb 0x7f850c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:35.208 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41340/0 (socket says 172.21.15.139:41340) 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 -- 172.21.15.139:0/4127362897 learned_addr learned my addr 172.21.15.139:0/4127362897 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8518be8700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d69eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f85193e9700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d6a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 -- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 msgr2=0x5647b5d69eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d69eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 -- 172.21.15.139:0/4127362897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 msgr2=0x5647b5d6a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d6a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 -- 172.21.15.139:0/4127362897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85141a3880 con 0x5647b5d05820 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f8513fff700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f8500005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474baa95542addcc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f84f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500021040 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.201+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8500011670 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8500004cf0 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8500011830 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 10 client.16263 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5647b5a82330 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8500004cf0 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f850000e2f0 con 0x5647b5d05820 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:35.210 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 20 client.16263 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d76570 0x5647b5d78990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 4 client.16263 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5647b5c51bb0 con 0x5647b5d76570 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.202+0000 7f8518be8700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d76570 0x5647b5d78990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.203+0000 7f84f3fff700 10 client.16263 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.203+0000 7f8518be8700 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d76570 0x5647b5d78990 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3b72724ac00a2f server_cookie=e585bb9ec7ae14e2 in_seq=0 out_seq=0 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f84f3fff700 1 -- 172.21.15.139:0/4127362897 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5647b5c51bb0 con 0x5647b5d76570 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f84f3fff700 10 client.16263 handle_command_reply: tid=0 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 client.16263 shutdown 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 msgr2=0x5647b5d6a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.211 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8500000c00 tx=0x7f8500005ee0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 shutdown_connections 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5647b5d76570 0x5647b5d78990 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647b5d106d0 0x5647b5d6a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647b5d04f00 0x5647b5d69eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 --2- 172.21.15.139:0/4127362897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647b5d05820 0x5647b5d6a3f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f84f3fff700 0 client.16263 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 >> 172.21.15.139:0/4127362897 conn(0x5647b5c7a2e0 msgr2=0x5647b5d1b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 shutdown_connections 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 1 -- 172.21.15.139:0/4127362897 wait complete. 2023-10-08T13:28:35.212 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.204+0000 7f8527035b80 20 client.16263 trim_cache size 0 max 16384 2023-10-08T13:28:35.213 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:28:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "return_code": 0, 2023-10-08T13:28:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_tag": "e7769183-d810-471b-83ef-40b69b61b27d", 2023-10-08T13:28:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": "asynchronous" 2023-10-08T13:28:35.213 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 msgr2=0x7f85040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 0x7f85040a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8508005850 tx=0x7f850801a040 comp rx=0 tx=0).stop 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 msgr2=0x7f85141a2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f850c007f10 tx=0x7f850c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 shutdown_connections 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f85040a15f0 0x7f85040a3ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85141056b0 0x7f85141a2a40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85140ff620 0x7f85141979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 --2- 172.21.15.139:0/2489064971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85140fffe0 0x7f8514197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 >> 172.21.15.139:0/2489064971 conn(0x7f8514076780 msgr2=0x7f85140fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 shutdown_connections 2023-10-08T13:28:35.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.205+0000 7f851ae4c700 1 -- 172.21.15.139:0/2489064971 wait complete. 2023-10-08T13:28:35.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:28:35.341 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 -- 172.21.15.139:0/2355765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18900ff620 msgr2=0x7f189010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 --2- 172.21.15.139:0/2355765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18900ff620 0x7f189010d600 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f188800b0d0 tx=0x7f188800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 -- 172.21.15.139:0/2355765858 shutdown_connections 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 --2- 172.21.15.139:0/2355765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f18900ff620 0x7f189010d600 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 --2- 172.21.15.139:0/2355765858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1890106720 0x7f1890106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 --2- 172.21.15.139:0/2355765858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f18900ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 -- 172.21.15.139:0/2355765858 >> 172.21.15.139:0/2355765858 conn(0x7f1890075c20 msgr2=0x7f18900fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 -- 172.21.15.139:0/2355765858 shutdown_connections 2023-10-08T13:28:35.342 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.340+0000 7f1897474700 1 -- 172.21.15.139:0/2355765858 wait complete. 2023-10-08T13:28:35.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 Processor -- start 2023-10-08T13:28:35.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 -- start start 2023-10-08T13:28:35.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f1890198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18900ff620 0x7f1890199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.344 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189019de70 con 0x7f1890106720 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189019dfe0 con 0x7f18900ff620 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1897474700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189019e1a0 con 0x7f18900fec60 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41356/0 (socket says 172.21.15.139:41356) 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1895a11700 1 -- 172.21.15.139:0/1275810754 learned_addr learned my addr 172.21.15.139:0/1275810754 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1895210700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f1890198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.341+0000 7f1894a0f700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18900ff620 0x7f1890199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 -- 172.21.15.139:0/1275810754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 msgr2=0x7f1890198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.345 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f1890198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 -- 172.21.15.139:0/1275810754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18900ff620 msgr2=0x7f1890199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18900ff620 0x7f1890199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 -- 172.21.15.139:0/1275810754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888009d00 con 0x7f1890106720 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895210700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f1890198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1895a11700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f188800bd50 tx=0x7f188800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f18867fc700 1 -- 172.21.15.139:0/1275810754 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188800e040 con 0x7f1890106720 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f18867fc700 1 -- 172.21.15.139:0/1275810754 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f188801b8e0 con 0x7f1890106720 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189019e420 con 0x7f1890106720 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f18867fc700 1 -- 172.21.15.139:0/1275810754 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880128f0 con 0x7f1890106720 2023-10-08T13:28:35.346 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.342+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18901a5cc0 con 0x7f1890106720 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.344+0000 7f18867fc700 1 -- 172.21.15.139:0/1275810754 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f188801b420 con 0x7f1890106720 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.345+0000 7f18867fc700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 0x7f187c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.345+0000 7f1895210700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 0x7f187c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.345+0000 7f18867fc700 1 -- 172.21.15.139:0/1275810754 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f18880ce8f0 con 0x7f1890106720 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.345+0000 7f1895210700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 0x7f187c0a3b30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1880009bc0 tx=0x7f1880009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 Processor -- start 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 -- start start 2023-10-08T13:28:35.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f801d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f80140460 con 0x557f801e2650 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f80131c20 con 0x557f801d6e80 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f18a365db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8012f540 con 0x557f801d77a0 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41364/0 (socket says 172.21.15.139:41364) 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 -- 172.21.15.139:0/708533280 learned_addr learned my addr 172.21.15.139:0/708533280 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895210700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f801d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1894a0f700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 -- 172.21.15.139:0/708533280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 msgr2=0x557f801e2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 -- 172.21.15.139:0/708533280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 msgr2=0x557f801d7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f801d7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 -- 172.21.15.139:0/708533280 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f7ff55de0 con 0x557f801e2650 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1894a0f700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f1895a11700 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1888097ac0 tx=0x7f188800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db21d7bc29314341 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.346+0000 7f187b7fe700 1 -- 172.21.15.139:0/708533280 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188809af20 con 0x557f801e2650 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f187b7fe700 1 -- 172.21.15.139:0/708533280 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f188801ba50 con 0x557f801e2650 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f187b7fe700 1 -- 172.21.15.139:0/708533280 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888099960 con 0x557f801e2650 2023-10-08T13:28:35.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 -- 172.21.15.139:0/708533280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 msgr2=0x557f801e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1888097ac0 tx=0x7f188800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 -- 172.21.15.139:0/708533280 shutdown_connections 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f801e4a40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f801d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 --2- 172.21.15.139:0/708533280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 -- 172.21.15.139:0/708533280 >> 172.21.15.139:0/708533280 conn(0x557f8014c260 msgr2=0x557f801d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 -- 172.21.15.139:0/708533280 shutdown_connections 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.347+0000 7f18a365db80 1 -- 172.21.15.139:0/708533280 wait complete. 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 -- start start 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 Processor -- start 2023-10-08T13:28:35.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d6e80 0x557f801e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801edab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8012ae30 con 0x557f801d77a0 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f800c7710 con 0x557f801e2650 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f800c73b0 con 0x557f801d6e80 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f18a365db80 10 client.0 _ll_register_callbacks cb 0x557f7ff24800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f1894a0f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f1894a0f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41368/0 (socket says 172.21.15.139:41368) 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f1894a0f700 1 -- 172.21.15.139:0/3836848397 learned_addr learned my addr 172.21.15.139:0/3836848397 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f1895a11700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.348+0000 7f1895210700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d6e80 0x557f801e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 -- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d6e80 msgr2=0x557f801e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d6e80 0x557f801e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 -- 172.21.15.139:0/3836848397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 msgr2=0x557f801edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 -- 172.21.15.139:0/3836848397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18901a5cc0 con 0x557f801d77a0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1894a0f700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f188c011430 tx=0x7f188c011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138ebbecb16cad93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c004220 con 0x557f801d77a0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f188c004380 con 0x557f801d77a0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f800f2eb0 con 0x557f801d77a0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f188c004540 con 0x557f801d77a0 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 10 client.16275 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:35.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557f7ff3ec60 con 0x557f801d77a0 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f188c022020 con 0x557f801d77a0 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f188c003680 con 0x557f801d77a0 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 10 client.16275 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 20 client.16275 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f801f4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 4 client.16275 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.349+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f80123e10 con 0x557f801f1ee0 2023-10-08T13:28:35.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.350+0000 7f1895210700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f801f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.350+0000 7f1878ff9700 10 client.16275 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.350+0000 7f1895210700 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f801f4300 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96ce5dcd31e5ade server_cookie=4736f58ab58a292e in_seq=0 out_seq=0 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f1878ff9700 1 -- 172.21.15.139:0/3836848397 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557f80123e10 con 0x557f801f1ee0 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f1878ff9700 10 client.16275 handle_command_reply: tid=0 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 client.16275 shutdown 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 msgr2=0x557f801e2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f188c011430 tx=0x7f188c011740 comp rx=0 tx=0).stop 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 shutdown_connections 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f801f4300 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f1878ff9700 0 client.16275 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d6e80 0x557f801e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 --2- 172.21.15.139:0/3836848397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d77a0 0x557f801e2f70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 >> 172.21.15.139:0/3836848397 conn(0x557f8014c260 msgr2=0x557f801d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 shutdown_connections 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 1 -- 172.21.15.139:0/3836848397 wait complete. 2023-10-08T13:28:35.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.351+0000 7f18a365db80 20 client.16275 trim_cache size 0 max 16384 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.367+0000 7f18a365db80 1 Processor -- start 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.367+0000 7f18a365db80 1 -- start start 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f7ffab920 con 0x557f801d6e80 2023-10-08T13:28:35.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f801d86a0 con 0x557f801e2650 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f18a365db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f801cd570 con 0x557f801d77a0 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41374/0 (socket says 172.21.15.139:41374) 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 -- 172.21.15.139:0/2494125946 learned_addr learned my addr 172.21.15.139:0/2494125946 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1894a0f700 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 -- 172.21.15.139:0/2494125946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 msgr2=0x557f801e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 -- 172.21.15.139:0/2494125946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 msgr2=0x557f801e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 -- 172.21.15.139:0/2494125946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f7ff7c250 con 0x557f801d6e80 2023-10-08T13:28:35.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1894a0f700 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f1895210700 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1880010010 tx=0x7f1880012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c2a7a48411745a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f187bfff700 1 -- 172.21.15.139:0/2494125946 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880024040 con 0x557f801d6e80 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f187bfff700 1 -- 172.21.15.139:0/2494125946 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18800044f0 con 0x557f801d6e80 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.368+0000 7f187bfff700 1 -- 172.21.15.139:0/2494125946 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011620 con 0x557f801d6e80 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- 172.21.15.139:0/2494125946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 msgr2=0x557f801e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f1880010010 tx=0x7f1880012000 comp rx=0 tx=0).stop 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- 172.21.15.139:0/2494125946 shutdown_connections 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801e2650 0x557f801e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801d6e80 0x557f801e7a70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 --2- 172.21.15.139:0/2494125946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f801e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- 172.21.15.139:0/2494125946 >> 172.21.15.139:0/2494125946 conn(0x557f8014c260 msgr2=0x557f801e0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- 172.21.15.139:0/2494125946 shutdown_connections 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- 172.21.15.139:0/2494125946 wait complete. 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 -- start start 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.369+0000 7f18a365db80 1 Processor -- start 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f8023efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f8023f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8023e290 con 0x557f801e2650 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8023e400 con 0x557f801d6e80 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8023e5c0 con 0x557f801d77a0 2023-10-08T13:28:35.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 10 client.0 _ll_register_callbacks cb 0x7f188c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41384/0 (socket says 172.21.15.139:41384) 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 -- 172.21.15.139:0/953155335 learned_addr learned my addr 172.21.15.139:0/953155335 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1894a0f700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f8023f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895210700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f8023efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 -- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 msgr2=0x557f8023f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f8023f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 -- 172.21.15.139:0/953155335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 msgr2=0x557f8023efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f8023efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 -- 172.21.15.139:0/953155335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188000fdf0 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1895a11700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1888097a70 tx=0x7f188809f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff8e3d03ac2006 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1878ff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880a38c0 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f188809b5c0 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.370+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f188801ba50 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f188801bd30 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 10 client.16281 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557f7ff542b0 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f188801ba50 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f188809aab0 con 0x557f801e2650 2023-10-08T13:28:35.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 10 client.16281 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 20 client.16281 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f80248d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 4 client.16281 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f80123b30 con 0x557f801f1ee0 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.371+0000 7f1895210700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f80248d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f1878ff9700 10 client.16281 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f1895210700 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f80248d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc234b0a719de54d server_cookie=77cf72fc49d035a1 in_seq=0 out_seq=0 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f1878ff9700 1 -- 172.21.15.139:0/953155335 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557f80123b30 con 0x557f801f1ee0 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f1878ff9700 10 client.16281 handle_command_reply: tid=0 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 client.16281 shutdown 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 msgr2=0x557f8023dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1888097a70 tx=0x7f188809f7c0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 shutdown_connections 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f801e2650 0x557f8023dd50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557f801f1ee0 0x557f80248d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557f801d6e80 0x557f8023efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 --2- 172.21.15.139:0/953155335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f801d77a0 0x557f8023f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f1878ff9700 0 client.16281 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 >> 172.21.15.139:0/953155335 conn(0x557f8014c260 msgr2=0x557f801e2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 shutdown_connections 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 1 -- 172.21.15.139:0/953155335 wait complete. 2023-10-08T13:28:35.381 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.372+0000 7f18a365db80 20 client.16281 trim_cache size 0 max 16384 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "e7769183-d810-471b-83ef-40b69b61b27d": { 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "e7769183-d810-471b-83ef-40b69b61b27d", 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:28:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:28:35.383 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:28:35.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 msgr2=0x7f187c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 0x7f187c0a3b30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1880009bc0 tx=0x7f1880009260 comp rx=0 tx=0).stop 2023-10-08T13:28:35.383 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 msgr2=0x7f189019d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f188800bd50 tx=0x7f188800be30 comp rx=0 tx=0).stop 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 shutdown_connections 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f187c0a1670 0x7f187c0a3b30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1890106720 0x7f189019d830 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18900fec60 0x7f1890198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 --2- 172.21.15.139:0/1275810754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18900ff620 0x7f1890199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 >> 172.21.15.139:0/1275810754 conn(0x7f1890075c20 msgr2=0x7f18900fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 shutdown_connections 2023-10-08T13:28:35.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:28:35.373+0000 7f1897474700 1 -- 172.21.15.139:0/1275810754 wait complete. 2023-10-08T13:28:35.386 INFO:tasks.cephfs.filesystem:scrub status for tag:e7769183-d810-471b-83ef-40b69b61b27d - {'path': '/', 'tag': 'e7769183-d810-471b-83ef-40b69b61b27d', 'options': 'recursive,force'} 2023-10-08T13:28:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:35 smithi187 ceph-mon[104336]: pgmap v332: 129 pgs: 129 active+clean; 1.4 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 12 op/s 2023-10-08T13:28:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:35 smithi187 ceph-mon[104336]: scrub queued for path: / 2023-10-08T13:28:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:35 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:35 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:28:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:35 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:35 smithi155 ceph-mon[103467]: pgmap v332: 129 pgs: 129 active+clean; 1.4 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 12 op/s 2023-10-08T13:28:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:35 smithi155 ceph-mon[103467]: scrub queued for path: / 2023-10-08T13:28:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:35 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:35 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:28:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:35 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:35 smithi139 ceph-mon[99506]: pgmap v332: 129 pgs: 129 active+clean; 1.4 MiB data, 334 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 KiB/s wr, 12 op/s 2023-10-08T13:28:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:35 smithi139 ceph-mon[99506]: scrub queued for path: / 2023-10-08T13:28:36.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:35 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:36.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:35 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:28:36.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:35 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:28:36.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:36 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 -- 172.21.15.139:0/640302074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 msgr2=0x7fe5201049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 --2- 172.21.15.139:0/640302074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe5201049c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe514009990 tx=0x7fe514009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 -- 172.21.15.139:0/640302074 shutdown_connections 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 --2- 172.21.15.139:0/640302074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200fff90 0x7fe52010c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 --2- 172.21.15.139:0/640302074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe5201049c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.991 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 --2- 172.21.15.139:0/640302074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200ff5d0 0x7fe5200ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 -- 172.21.15.139:0/640302074 >> 172.21.15.139:0/640302074 conn(0x7fe520076790 msgr2=0x7fe520076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 -- 172.21.15.139:0/640302074 shutdown_connections 2023-10-08T13:28:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.989+0000 7fe526572700 1 -- 172.21.15.139:0/640302074 wait complete. 2023-10-08T13:28:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 Processor -- start 2023-10-08T13:28:36.992 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 -- start start 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200ff5d0 0x7fe52019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200fff90 0x7fe52019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520195ee0 con 0x7fe5201045e0 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520196050 con 0x7fe5200fff90 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.990+0000 7fe526572700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe520196210 con 0x7fe5200ff5d0 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:36.994 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41398/0 (socket says 172.21.15.139:41398) 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 -- 172.21.15.139:0/2515374841 learned_addr learned my addr 172.21.15.139:0/2515374841 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200ff5d0 0x7fe52019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200fff90 0x7fe52019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 -- 172.21.15.139:0/2515374841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200ff5d0 msgr2=0x7fe52019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200ff5d0 0x7fe52019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 -- 172.21.15.139:0/2515374841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200fff90 msgr2=0x7fe52019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200fff90 0x7fe52019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 -- 172.21.15.139:0/2515374841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140095f0 con 0x7fe5201045e0 2023-10-08T13:28:36.995 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe524b0f700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe518007d70 tx=0x7fe51800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe51d7fa700 1 -- 172.21.15.139:0/2515374841 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800ad40 con 0x7fe5201045e0 2023-10-08T13:28:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe51d7fa700 1 -- 172.21.15.139:0/2515374841 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5180128e0 con 0x7fe5201045e0 2023-10-08T13:28:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5201964f0 con 0x7fe5201045e0 2023-10-08T13:28:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe51d7fa700 1 -- 172.21.15.139:0/2515374841 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180116b0 con 0x7fe5201045e0 2023-10-08T13:28:36.996 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.991+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5201a25f0 con 0x7fe5201045e0 2023-10-08T13:28:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.993+0000 7fe51d7fa700 1 -- 172.21.15.139:0/2515374841 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe518012420 con 0x7fe5201045e0 2023-10-08T13:28:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.994+0000 7fe51d7fa700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 0x7fe5080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.994+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 0x7fe5080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.994+0000 7fe51d7fa700 1 -- 172.21.15.139:0/2515374841 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe5180cd5b0 con 0x7fe5201045e0 2023-10-08T13:28:37.003 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.994+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 0x7fe5080a3ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe51400b5c0 tx=0x7fe514005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 Processor -- start 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 -- start start 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d12cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d1270b0 0x55997d127510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d08f400 con 0x55997d12d1a0 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d080bc0 con 0x55997d1270b0 2023-10-08T13:28:37.005 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe53275bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d07e4e0 con 0x55997d12c880 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41404/0 (socket says 172.21.15.139:41404) 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.995+0000 7fe51f7fe700 1 -- 172.21.15.139:0/2660548133 learned_addr learned my addr 172.21.15.139:0/2660548133 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe524b0f700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d1270b0 0x55997d127510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d12cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 -- 172.21.15.139:0/2660548133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 msgr2=0x55997d12cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d12cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 -- 172.21.15.139:0/2660548133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d1270b0 msgr2=0x55997d127510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d1270b0 0x55997d127510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 -- 172.21.15.139:0/2660548133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55997cea4d80 con 0x55997d12d1a0 2023-10-08T13:28:37.006 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d12cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe510008c00 tx=0x7fe510008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7186c78ac94b31a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe5067fc700 1 -- 172.21.15.139:0/2660548133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51000ecf0 con 0x55997d12d1a0 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe5067fc700 1 -- 172.21.15.139:0/2660548133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51000ee50 con 0x55997d12d1a0 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.996+0000 7fe5067fc700 1 -- 172.21.15.139:0/2660548133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510010430 con 0x55997d12d1a0 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- 172.21.15.139:0/2660548133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 msgr2=0x55997d126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe510008c00 tx=0x7fe510008f10 comp rx=0 tx=0).stop 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- 172.21.15.139:0/2660548133 shutdown_connections 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d1270b0 0x55997d127510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d12cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2660548133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d12d1a0 0x55997d126b70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- 172.21.15.139:0/2660548133 >> 172.21.15.139:0/2660548133 conn(0x55997d09b200 msgr2=0x55997d121b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:37.007 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- 172.21.15.139:0/2660548133 shutdown_connections 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- 172.21.15.139:0/2660548133 wait complete. 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 -- start start 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.997+0000 7fe53275bb80 1 Processor -- start 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d130450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d130b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d079dd0 con 0x55997d1270b0 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d0166b0 con 0x55997d12c880 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d016350 con 0x55997d12d1a0 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 10 client.0 _ll_register_callbacks cb 0x55997ce737a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:37.008 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41408/0 (socket says 172.21.15.139:41408) 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 -- 172.21.15.139:0/4164401516 learned_addr learned my addr 172.21.15.139:0/4164401516 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe524b0f700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d130b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 -- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 msgr2=0x55997d130b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d130b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 -- 172.21.15.139:0/4164401516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 msgr2=0x55997d130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 -- 172.21.15.139:0/4164401516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe510008830 con 0x55997d1270b0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe51ffff700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe520069cf0 tx=0x7fe514009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c84311ae358684d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe4ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:37.009 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400f660 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe51400f7c0 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55997d041e50 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe51400f980 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 10 client.16293 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.998+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55997ce8dc00 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55997d041e50 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe51402eb60 con 0x55997d1270b0 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 10 client.16293 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 20 client.16293 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d140cb0 0x55997d1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 4 client.16293 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55997d072db0 con 0x55997d140cb0 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d140cb0 0x55997d1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe4ff7fe700 10 client.16293 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:36.999+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d140cb0 0x55997d1430d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eabaf55b85b1891 server_cookie=deec50c05da54e4c in_seq=0 out_seq=0 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/4164401516 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55997d072db0 con 0x55997d140cb0 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe4ff7fe700 10 client.16293 handle_command_reply: tid=0 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 client.16293 shutdown 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 msgr2=0x55997d133160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe520069cf0 tx=0x7fe514009310 comp rx=0 tx=0).stop 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 shutdown_connections 2023-10-08T13:28:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d130b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d133160 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d140cb0 0x55997d1430d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 --2- 172.21.15.139:0/4164401516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe4ff7fe700 0 client.16293 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 >> 172.21.15.139:0/4164401516 conn(0x55997d09b200 msgr2=0x55997d121010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 shutdown_connections 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 1 -- 172.21.15.139:0/4164401516 wait complete. 2023-10-08T13:28:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.000+0000 7fe53275bb80 20 client.16293 trim_cache size 0 max 16384 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 Processor -- start 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 -- start start 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12d1a0 0x55997d121790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997cefa8c0 con 0x55997d1270b0 2023-10-08T13:28:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d041e50 con 0x55997d12d1a0 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe53275bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d13d760 con 0x55997d12c880 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41416/0 (socket says 172.21.15.139:41416) 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.015+0000 7fe51ffff700 1 -- 172.21.15.139:0/2104209397 learned_addr learned my addr 172.21.15.139:0/2104209397 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 -- 172.21.15.139:0/2104209397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 msgr2=0x55997d127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 -- 172.21.15.139:0/2104209397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12d1a0 msgr2=0x55997d121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12d1a0 0x55997d121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 -- 172.21.15.139:0/2104209397 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55997cecb1f0 con 0x55997d1270b0 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe51ffff700 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe514006010 tx=0x7fe514005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca21c7dbb711572 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe506ffd700 1 -- 172.21.15.139:0/2104209397 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400be00 con 0x55997d1270b0 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe506ffd700 1 -- 172.21.15.139:0/2104209397 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51402a040 con 0x55997d1270b0 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe506ffd700 1 -- 172.21.15.139:0/2104209397 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140059d0 con 0x55997d1270b0 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 -- 172.21.15.139:0/2104209397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 msgr2=0x55997d1430a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe514006010 tx=0x7fe514005d40 comp rx=0 tx=0).stop 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 -- 172.21.15.139:0/2104209397 shutdown_connections 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12d1a0 0x55997d121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d1430a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 --2- 172.21.15.139:0/2104209397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12c880 0x55997d127490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.016+0000 7fe53275bb80 1 -- 172.21.15.139:0/2104209397 >> 172.21.15.139:0/2104209397 conn(0x55997d09b200 msgr2=0x55997d123100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- 172.21.15.139:0/2104209397 shutdown_connections 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- 172.21.15.139:0/2104209397 wait complete. 2023-10-08T13:28:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- start start 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 Processor -- start 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d128390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d1288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d128f80 con 0x55997d1270b0 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d1290f0 con 0x55997d12c880 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55997d1292b0 con 0x55997d12d1a0 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe53275bb80 10 client.0 _ll_register_callbacks cb 0x7fe514005380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41422/0 (socket says 172.21.15.139:41422) 2023-10-08T13:28:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.017+0000 7fe51ffff700 1 -- 172.21.15.139:0/3929784193 learned_addr learned my addr 172.21.15.139:0/3929784193 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe524b0f700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d1288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d128390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 -- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 msgr2=0x55997d1288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d1288d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 -- 172.21.15.139:0/3929784193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 msgr2=0x55997d128390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d128390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 -- 172.21.15.139:0/3929784193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55997ce8dc00 con 0x55997d1270b0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe51ffff700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe514005040 tx=0x7fe514005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3225fa986e373052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe4ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514022b40 con 0x55997d1270b0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe51000ee50 con 0x55997d1270b0 2023-10-08T13:28:37.025 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe514022ca0 con 0x55997d1270b0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe514022e60 con 0x55997d1270b0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe53275bb80 10 client.16299 fetch_fsmap learned FSMap version 26 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55997cea3250 con 0x55997d1270b0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.018+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51000ee50 con 0x55997d1270b0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 26) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe514003790 con 0x55997d1270b0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 10 client.16299 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 20 client.16299 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d194eb0 0x55997d1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 4 client.16299 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55997d072ad0 con 0x55997d194eb0 2023-10-08T13:28:37.026 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d194eb0 0x55997d1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe4ff7fe700 10 client.16299 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:37.027 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.019+0000 7fe51f7fe700 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d194eb0 0x55997d1972a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8c75e60eeefb5c4 server_cookie=b234c8dc860da939 in_seq=0 out_seq=0 2023-10-08T13:28:37.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:36 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:28:37.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:36 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe4ff7fe700 1 -- 172.21.15.139:0/3929784193 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55997d072ad0 con 0x55997d194eb0 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe4ff7fe700 10 client.16299 handle_command_reply: tid=0 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 client.16299 shutdown 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 msgr2=0x55997d137e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe514005040 tx=0x7fe514005a40 comp rx=0 tx=0).stop 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 shutdown_connections 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55997d12d1a0 0x55997d1288d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55997d1270b0 0x55997d137e10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55997d194eb0 0x55997d1972a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 --2- 172.21.15.139:0/3929784193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55997d12c880 0x55997d128390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe4ff7fe700 0 client.16299 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 >> 172.21.15.139:0/3929784193 conn(0x55997d09b200 msgr2=0x55997d127490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 shutdown_connections 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.274+0000 7fe53275bb80 1 -- 172.21.15.139:0/3929784193 wait complete. 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe53275bb80 20 client.16299 trim_cache size 0 max 16384 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:28:37.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:28:37.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:28:37.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 msgr2=0x7fe5080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.278 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 0x7fe5080a3ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe51400b5c0 tx=0x7fe514005960 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 msgr2=0x7fe520195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe518007d70 tx=0x7fe51800a340 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 shutdown_connections 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe5080a15f0 0x7fe5080a3ab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5201045e0 0x7fe520195710 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5200ff5d0 0x7fe52019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 --2- 172.21.15.139:0/2515374841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5200fff90 0x7fe52019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 >> 172.21.15.139:0/2515374841 conn(0x7fe520076790 msgr2=0x7fe5200fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 shutdown_connections 2023-10-08T13:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:37.275+0000 7fe526572700 1 -- 172.21.15.139:0/2515374841 wait complete. 2023-10-08T13:28:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:37 smithi187 ceph-mon[104336]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 958 KiB/s wr, 12 op/s 2023-10-08T13:28:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:37 smithi155 ceph-mon[103467]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 958 KiB/s wr, 12 op/s 2023-10-08T13:28:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:37 smithi139 ceph-mon[99506]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 958 KiB/s wr, 12 op/s 2023-10-08T13:28:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:39 smithi187 ceph-mon[104336]: pgmap v334: 129 pgs: 129 active+clean; 15 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2023-10-08T13:28:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:39 smithi155 ceph-mon[103467]: pgmap v334: 129 pgs: 129 active+clean; 15 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2023-10-08T13:28:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:39 smithi139 ceph-mon[99506]: pgmap v334: 129 pgs: 129 active+clean; 15 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2023-10-08T13:28:41.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:41 smithi139 ceph-mon[99506]: pgmap v335: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2023-10-08T13:28:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:41 smithi187 ceph-mon[104336]: pgmap v335: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2023-10-08T13:28:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:41 smithi155 ceph-mon[103467]: pgmap v335: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 106 op/s 2023-10-08T13:28:43.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:43 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:43.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:43 smithi139 ceph-mon[99506]: pgmap v336: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2023-10-08T13:28:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:43 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:43 smithi187 ceph-mon[104336]: pgmap v336: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2023-10-08T13:28:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:43 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:43 smithi155 ceph-mon[103467]: pgmap v336: 129 pgs: 129 active+clean; 15 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 1.2 MiB/s wr, 166 op/s 2023-10-08T13:28:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:45 smithi187 ceph-mon[104336]: pgmap v337: 129 pgs: 129 active+clean; 17 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T13:28:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:45 smithi155 ceph-mon[103467]: pgmap v337: 129 pgs: 129 active+clean; 17 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T13:28:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:45 smithi139 ceph-mon[99506]: pgmap v337: 129 pgs: 129 active+clean; 17 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 169 op/s 2023-10-08T13:28:46.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:46 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:28:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:46 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:28:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:46 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:28:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:47 smithi187 ceph-mon[104336]: pgmap v338: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.5 MiB/s wr, 173 op/s 2023-10-08T13:28:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:47 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:28:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:28:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:28:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:47 smithi155 ceph-mon[103467]: pgmap v338: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.5 MiB/s wr, 173 op/s 2023-10-08T13:28:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:47 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:28:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:28:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:28:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:47 smithi139 ceph-mon[99506]: pgmap v338: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.5 MiB/s wr, 173 op/s 2023-10-08T13:28:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:47 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:28:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:28:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:28:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:28:49.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:49 smithi187 ceph-mon[104336]: pgmap v339: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 617 KiB/s wr, 175 op/s 2023-10-08T13:28:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:49 smithi155 ceph-mon[103467]: pgmap v339: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 617 KiB/s wr, 175 op/s 2023-10-08T13:28:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:49 smithi139 ceph-mon[99506]: pgmap v339: 129 pgs: 129 active+clean; 19 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 617 KiB/s wr, 175 op/s 2023-10-08T13:28:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 -- 172.21.15.139:0/2068259080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c0ff5d0 msgr2=0x7f348c0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 --2- 172.21.15.139:0/2068259080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c0ff5d0 0x7f348c0ffa50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f347c009990 tx=0x7f347c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 -- 172.21.15.139:0/2068259080 shutdown_connections 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 --2- 172.21.15.139:0/2068259080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0fff90 0x7f348c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 --2- 172.21.15.139:0/2068259080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c1045e0 0x7f348c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 --2- 172.21.15.139:0/2068259080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c0ff5d0 0x7f348c0ffa50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 -- 172.21.15.139:0/2068259080 >> 172.21.15.139:0/2068259080 conn(0x7f348c076790 msgr2=0x7f348c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 -- 172.21.15.139:0/2068259080 shutdown_connections 2023-10-08T13:28:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.393+0000 7f3490b14700 1 -- 172.21.15.139:0/2068259080 wait complete. 2023-10-08T13:28:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 Processor -- start 2023-10-08T13:28:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 -- start start 2023-10-08T13:28:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0ff5d0 0x7f348c197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c0fff90 0x7f348c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c1986e0 con 0x7f348c1045e0 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c1a2f10 con 0x7f348c0ff5d0 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3490b14700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c1a3050 con 0x7f348c0fff90 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41440/0 (socket says 172.21.15.139:41440) 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 -- 172.21.15.139:0/2534631999 learned_addr learned my addr 172.21.15.139:0/2534631999 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348a59c700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0ff5d0 0x7f348c197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f3489d9b700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c0fff90 0x7f348c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 -- 172.21.15.139:0/2534631999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c0fff90 msgr2=0x7f348c197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c0fff90 0x7f348c197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 -- 172.21.15.139:0/2534631999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0ff5d0 msgr2=0x7f348c197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0ff5d0 0x7f348c197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.394+0000 7f348ad9d700 1 -- 172.21.15.139:0/2534631999 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0095f0 con 0x7f348c1045e0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f348ad9d700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3484007f10 tx=0x7f348400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f347b7fe700 1 -- 172.21.15.139:0/2534631999 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484017070 con 0x7f348c1045e0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c1a32b0 con 0x7f348c1045e0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f347b7fe700 1 -- 172.21.15.139:0/2534631999 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f348400f040 con 0x7f348c1045e0 2023-10-08T13:28:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f347b7fe700 1 -- 172.21.15.139:0/2534631999 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484005740 con 0x7f348c1045e0 2023-10-08T13:28:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.395+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1a37c0 con 0x7f348c1045e0 2023-10-08T13:28:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.397+0000 7f347b7fe700 1 -- 172.21.15.139:0/2534631999 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f34840058a0 con 0x7f348c1045e0 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.398+0000 7f347b7fe700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 0x7f34740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.398+0000 7f347b7fe700 1 -- 172.21.15.139:0/2534631999 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f34840ccc30 con 0x7f348c1045e0 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.398+0000 7f348a59c700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 0x7f34740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.398+0000 7f348a59c700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 0x7f34740a3ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f348c069cf0 tx=0x7f348000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.398+0000 7f349ccfdb80 1 Processor -- start 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 -- start start 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc2eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc2f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.407 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb97400 con 0x55cdbcc34880 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb88bc0 con 0x55cdbcc351a0 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb864e0 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41444/0 (socket says 172.21.15.139:41444) 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 -- 172.21.15.139:0/3817128329 learned_addr learned my addr 172.21.15.139:0/3817128329 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f3489d9b700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc2eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348ad9d700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc2f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 -- 172.21.15.139:0/3817128329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 msgr2=0x55cdbcc2f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc2f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.408 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 -- 172.21.15.139:0/3817128329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 msgr2=0x55cdbcc2eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc2eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 -- 172.21.15.139:0/3817128329 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdbc9acd80 con 0x55cdbcc34880 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f3489d9b700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc2eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.399+0000 7f348a59c700 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f348000fd80 tx=0x7f3480012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd478e94d4a8456a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f3478ff9700 1 -- 172.21.15.139:0/3817128329 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480010ac0 con 0x55cdbcc34880 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f3478ff9700 1 -- 172.21.15.139:0/3817128329 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3480020070 con 0x55cdbcc34880 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f3478ff9700 1 -- 172.21.15.139:0/3817128329 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348001be50 con 0x55cdbcc34880 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 -- 172.21.15.139:0/3817128329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 msgr2=0x55cdbcc34c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f348000fd80 tx=0x7f3480012000 comp rx=0 tx=0).stop 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 -- 172.21.15.139:0/3817128329 shutdown_connections 2023-10-08T13:28:50.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc2f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc34c60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/3817128329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc2eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.400+0000 7f349ccfdb80 1 -- 172.21.15.139:0/3817128329 >> 172.21.15.139:0/3817128329 conn(0x55cdbcba3200 msgr2=0x55cdbcc29b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- 172.21.15.139:0/3817128329 shutdown_connections 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- 172.21.15.139:0/3817128329 wait complete. 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- start start 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 Processor -- start 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 0x55cdbcc38a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc38fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb81dd0 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb1e6b0 con 0x55cdbcc351a0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcb1e350 con 0x55cdbcc34880 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f349ccfdb80 10 client.0 _ll_register_callbacks cb 0x55cdbc97b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f348a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f348a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41450/0 (socket says 172.21.15.139:41450) 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.401+0000 7f348a59c700 1 -- 172.21.15.139:0/1775045415 learned_addr learned my addr 172.21.15.139:0/1775045415 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348ad9d700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc38fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 0x55cdbcc38a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 -- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 msgr2=0x55cdbcc38a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 0x55cdbcc38a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 -- 172.21.15.139:0/1775045415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 msgr2=0x55cdbcc38fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc38fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 -- 172.21.15.139:0/1775045415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348000fa60 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348ad9d700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc38fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 0x55cdbcc38a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f348a59c700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3480005dc0 tx=0x7f3480010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5d7b9769459539 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3471ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348001be00 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f348000fe60 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdbcb49e50 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3480005040 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f349ccfdb80 10 client.16311 fetch_fsmap learned FSMap version 28 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cdbc995c00 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.412 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.402+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cdbcb49e50 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f348002d070 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 10 client.16311 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 10 client.16311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 20 client.16311 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc48d90 0x55cdbcc4b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 4 client.16311 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdbcb7adb0 con 0x55cdbcc48d90 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.403+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc48d90 0x55cdbcc4b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f3471ffb700 10 client.16311 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc48d90 0x55cdbcc4b1b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6825cf1273e605ec server_cookie=14d7eb1183b43e97 in_seq=0 out_seq=0 2023-10-08T13:28:50.413 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f3471ffb700 1 -- 172.21.15.139:0/1775045415 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cdbcb7adb0 con 0x55cdbcc48d90 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f3471ffb700 10 client.16311 handle_command_reply: tid=0 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 client.16311 shutdown 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 msgr2=0x55cdbcc38550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3480005dc0 tx=0x7f3480010c20 comp rx=0 tx=0).stop 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 shutdown_connections 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc48d90 0x55cdbcc4b1b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc38fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc38550 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f3471ffb700 0 client.16311 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:50.414 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1775045415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc34880 0x55cdbcc38a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 >> 172.21.15.139:0/1775045415 conn(0x55cdbcba3200 msgr2=0x55cdbcc29010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 shutdown_connections 2023-10-08T13:28:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.404+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1775045415 wait complete. 2023-10-08T13:28:50.415 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.405+0000 7f349ccfdb80 20 client.16311 trim_cache size 0 max 16384 2023-10-08T13:28:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 Processor -- start 2023-10-08T13:28:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 -- start start 2023-10-08T13:28:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc3fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc34880 0x55cdbcc29790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbca028c0 con 0x55cdbcc351a0 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcc242b0 con 0x55cdbcc34880 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.419+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcc3b0c0 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41462/0 (socket says 172.21.15.139:41462) 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 -- 172.21.15.139:0/859493663 learned_addr learned my addr 172.21.15.139:0/859493663 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f3489d9b700 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc34880 0x55cdbcc29790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348a59c700 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc3fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 -- 172.21.15.139:0/859493663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 msgr2=0x55cdbcc3fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc3fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 -- 172.21.15.139:0/859493663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc34880 msgr2=0x55cdbcc29790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc34880 0x55cdbcc29790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 -- 172.21.15.139:0/859493663 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdbc9d31f0 con 0x55cdbcc351a0 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f348ad9d700 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f34840995d0 tx=0x7f34840b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b255bd936e6fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f34797fa700 1 -- 172.21.15.139:0/859493663 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840998d0 con 0x55cdbcc351a0 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f34797fa700 1 -- 172.21.15.139:0/859493663 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f348409da20 con 0x55cdbcc351a0 2023-10-08T13:28:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.420+0000 7f34797fa700 1 -- 172.21.15.139:0/859493663 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484099d90 con 0x55cdbcc351a0 2023-10-08T13:28:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- 172.21.15.139:0/859493663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 msgr2=0x55cdbcc29cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f34840995d0 tx=0x7f34840b9040 comp rx=0 tx=0).stop 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- 172.21.15.139:0/859493663 shutdown_connections 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc351a0 0x55cdbcc29cd0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc3fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/859493663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc34880 0x55cdbcc29790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- 172.21.15.139:0/859493663 >> 172.21.15.139:0/859493663 conn(0x55cdbcba3200 msgr2=0x55cdbcc2f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- 172.21.15.139:0/859493663 shutdown_connections 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- 172.21.15.139:0/859493663 wait complete. 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.421+0000 7f349ccfdb80 1 -- start start 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 Processor -- start 2023-10-08T13:28:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc31800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc30420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcc30b30 con 0x55cdbcc34880 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcc30ca0 con 0x55cdbcc351a0 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdbcc30e60 con 0x55cdbcc2f0b0 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f349ccfdb80 10 client.0 _ll_register_callbacks cb 0x7f348000fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41466/0 (socket says 172.21.15.139:41466) 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 -- 172.21.15.139:0/1320425053 learned_addr learned my addr 172.21.15.139:0/1320425053 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f348a59c700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.428 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f348ad9d700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc30420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 -- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 msgr2=0x55cdbcc31800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc31800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 -- 172.21.15.139:0/1320425053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 msgr2=0x55cdbcc30420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc30420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f3489d9b700 1 -- 172.21.15.139:0/1320425053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1a37c0 con 0x55cdbcc34880 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.422+0000 7f348ad9d700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc30420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.423+0000 7f3489d9b700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f348c0682b0 tx=0x7f347c025430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a068c384fa580387 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.423+0000 7f3471ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.423+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c01d070 con 0x55cdbcc34880 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f347c0259f0 con 0x55cdbcc34880 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3480020070 con 0x55cdbcc34880 2023-10-08T13:28:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f347c025bb0 con 0x55cdbcc34880 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 10 client.16317 fetch_fsmap learned FSMap version 28 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55cdbc9ab250 con 0x55cdbcc34880 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3480020070 con 0x55cdbcc34880 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f347c0038b0 con 0x55cdbcc34880 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 10 client.16317 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 20 client.16317 populate_metadata read hostname 'smithi139' 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc9df70 0x55cdbcca0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 4 client.16317 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cdbcb7aad0 con 0x55cdbcc9df70 2023-10-08T13:28:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.424+0000 7f348a59c700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc9df70 0x55cdbcca0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:28:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.425+0000 7f3471ffb700 10 client.16317 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:50.431 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.425+0000 7f348a59c700 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc9df70 0x55cdbcca0390 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49ad0d78da1fef3 server_cookie=d69433605d24a7fd in_seq=0 out_seq=0 2023-10-08T13:28:50.915 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f3471ffb700 1 -- 172.21.15.139:0/1320425053 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cdbcb7aad0 con 0x55cdbcc9df70 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f3471ffb700 10 client.16317 handle_command_reply: tid=0 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 client.16317 shutdown 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 msgr2=0x55cdbcc31d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f348c0682b0 tx=0x7f347c025430 comp rx=0 tx=0).stop 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 shutdown_connections 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cdbcc9df70 0x55cdbcca0390 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdbcc351a0 0x55cdbcc30420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdbcc2f0b0 0x55cdbcc31800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 --2- 172.21.15.139:0/1320425053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cdbcc34880 0x55cdbcc31d40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f3471ffb700 0 client.16317 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 >> 172.21.15.139:0/1320425053 conn(0x55cdbcba3200 msgr2=0x55cdbcc36d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 shutdown_connections 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 1 -- 172.21.15.139:0/1320425053 wait complete. 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.914+0000 7f349ccfdb80 20 client.16317 trim_cache size 0 max 16384 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:28:50.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:28:50.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 msgr2=0x7f34740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 0x7f34740a3ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f348c069cf0 tx=0x7f348000a380 comp rx=0 tx=0).stop 2023-10-08T13:28:50.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 msgr2=0x7f348c1a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3484007f10 tx=0x7f348400d3b0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 shutdown_connections 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f34740a15f0 0x7f34740a3ab0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f348c1045e0 0x7f348c1a29d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f348c0ff5d0 0x7f348c197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 --2- 172.21.15.139:0/2534631999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f348c0fff90 0x7f348c197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 >> 172.21.15.139:0/2534631999 conn(0x7f348c076790 msgr2=0x7f348c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 shutdown_connections 2023-10-08T13:28:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:28:50.915+0000 7f3490b14700 1 -- 172.21.15.139:0/2534631999 wait complete. 2023-10-08T13:28:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:51 smithi139 ceph-mon[99506]: pgmap v340: 129 pgs: 129 active+clean; 19 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 478 KiB/s wr, 147 op/s 2023-10-08T13:28:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:51 smithi187 ceph-mon[104336]: pgmap v340: 129 pgs: 129 active+clean; 19 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 478 KiB/s wr, 147 op/s 2023-10-08T13:28:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:51 smithi155 ceph-mon[103467]: pgmap v340: 129 pgs: 129 active+clean; 19 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 478 KiB/s wr, 147 op/s 2023-10-08T13:28:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:53 smithi187 ceph-mon[104336]: pgmap v341: 129 pgs: 129 active+clean; 21 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 667 KiB/s wr, 262 op/s 2023-10-08T13:28:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:53 smithi155 ceph-mon[103467]: pgmap v341: 129 pgs: 129 active+clean; 21 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 667 KiB/s wr, 262 op/s 2023-10-08T13:28:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:53 smithi139 ceph-mon[99506]: pgmap v341: 129 pgs: 129 active+clean; 21 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 667 KiB/s wr, 262 op/s 2023-10-08T13:28:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:55 smithi187 ceph-mon[104336]: pgmap v342: 129 pgs: 129 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 871 KiB/s wr, 339 op/s 2023-10-08T13:28:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:55 smithi155 ceph-mon[103467]: pgmap v342: 129 pgs: 129 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 871 KiB/s wr, 339 op/s 2023-10-08T13:28:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:55 smithi139 ceph-mon[99506]: pgmap v342: 129 pgs: 129 active+clean; 19 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 871 KiB/s wr, 339 op/s 2023-10-08T13:28:56.908 INFO:tasks.workunit.client.0.smithi139.stderr:Updating files: 8% (338/4205) Updating files: 9% (379/4205) Updating files: 10% (421/4205) Updating files: 11% (463/4205) Updating files: 12% (505/4205) Updating files: 13% (547/4205) Updating files: 14% (589/4205) Updating files: 15% (631/4205) Updating files: 16% (673/4205) Updating files: 17% (715/4205) Updating files: 18% (757/4205) Updating files: 19% (799/4205) Updating files: 19% (824/4205) Updating files: 20% (841/4205) Updating files: 21% (884/4205) Updating files: 22% (926/4205) Updating files: 23% (968/4205) Updating files: 24% (1010/4205) Updating files: 25% (1052/4205) Updating files: 26% (1094/4205) Updating files: 27% (1136/4205) Updating files: 28% (1178/4205) Updating files: 29% (1220/4205) Updating files: 29% (1248/4205) Updating files: 30% (1262/4205) Updating files: 31% (1304/4205) Updating files: 32% (1346/4205) Updating files: 33% (1388/4205) Updating files: 34% (1430/4205) Updating files: 35% (1472/4205) Updating files: 36% (1514/4205) Updating files: 37% (1556/4205) Updating files: 38% (1598/4205) Updating files: 39% (1640/4205) Updating files: 40% (1682/4205) Updating files: 41% (1725/4205) Updating files: 42% (1767/4205) Updating files: 43% (1809/4205) Updating files: 44% (1851/4205) Updating files: 45% (1893/4205) Updating files: 46% (1935/4205) Updating files: 47% (1977/4205) Updating files: 48% (2019/4205) Updating files: 49% (2061/4205) Updating files: 50% (2103/4205) Updating files: 51% (2145/4205) Updating files: 51% (2164/4205) Updating files: 52% (2187/4205) Updating files: 53% (2229/4205) Updating files: 53% (2254/4205) Updating files: 53% (2261/4205) Updating files: 54% (2271/4205) Updating files: 55% (2313/4205) Updating files: 56% (2355/4205) Updating files: 57% (2397/4205) Updating files: 58% (2439/4205) Updating files: 59% (2481/4205) Updating files: 60% (2523/4205) Updating files: 61% (2566/4205) Updating files: 62% (2608/4205) Updating files: 63% (2650/4205) Updating files: 64% (2692/4205) Updating files: 64% (2723/4205) Updating files: 65% (2734/4205) Updating files: 66% (2776/4205) Updating files: 67% (2818/4205) Updating files: 68% (2860/4205) Updating files: 69% (2902/4205) Updating files: 70% (2944/4205) Updating files: 70% (2953/4205) Updating files: 71% (2986/4205) Updating files: 72% (3028/4205) Updating files: 73% (3070/4205) Updating files: 74% (3112/4205) Updating files: 75% (3154/4205) Updating files: 76% (3196/4205) Updating files: 77% (3238/4205) Updating files: 78% (3280/4205) Updating files: 79% (3322/4205) Updating files: 80% (3364/4205) Updating files: 81% (3407/4205) Updating files: 82% (3449/4205) Updating files: 83% (3491/4205) Updating files: 83% (3517/4205) Updating files: 83% (3522/4205) Updating files: 84% (3533/4205) Updating files: 85% (3575/4205) Updating files: 86% (3617/4205) Updating files: 87% (3659/4205) Updating files: 88% (3701/4205) Updating files: 89% (3743/4205) Updating files: 90% (3785/4205) Updating files: 91% (3827/4205) Updating files: 92% (3869/4205) Updating files: 93% (3911/4205) Updating files: 93% (3924/4205) Updating files: 93% (3934/4205) Updating files: 94% (3953/4205) Updating files: 95% (3995/4205) Updating files: 96% (4037/4205) Updating files: 97% (4079/4205) Updating files: 98% (4121/4205) Updating files: 99% (4163/4205) Updating files: 100% (4205/4205) Updating files: 100% (4205/4205), done. 2023-10-08T13:28:56.915 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd xfstests-dev 2023-10-08T13:28:56.916 INFO:tasks.workunit.client.0.smithi139.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2023-10-08T13:28:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:57 smithi187 ceph-mon[104336]: pgmap v343: 129 pgs: 129 active+clean; 27 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.4 MiB/s wr, 591 op/s 2023-10-08T13:28:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:57 smithi155 ceph-mon[103467]: pgmap v343: 129 pgs: 129 active+clean; 27 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.4 MiB/s wr, 591 op/s 2023-10-08T13:28:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:57 smithi139 ceph-mon[99506]: pgmap v343: 129 pgs: 129 active+clean; 27 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.4 MiB/s wr, 591 op/s 2023-10-08T13:28:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:28:59 smithi187 ceph-mon[104336]: pgmap v344: 129 pgs: 129 active+clean; 33 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 1.9 MiB/s wr, 634 op/s 2023-10-08T13:29:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:28:59 smithi155 ceph-mon[103467]: pgmap v344: 129 pgs: 129 active+clean; 33 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 1.9 MiB/s wr, 634 op/s 2023-10-08T13:29:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:28:59 smithi139 ceph-mon[99506]: pgmap v344: 129 pgs: 129 active+clean; 33 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 1.9 MiB/s wr, 634 op/s 2023-10-08T13:29:01.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:01 smithi139 ceph-mon[99506]: pgmap v345: 129 pgs: 129 active+clean; 34 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.0 MiB/s wr, 650 op/s 2023-10-08T13:29:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:01 smithi187 ceph-mon[104336]: pgmap v345: 129 pgs: 129 active+clean; 34 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.0 MiB/s wr, 650 op/s 2023-10-08T13:29:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:01 smithi155 ceph-mon[103467]: pgmap v345: 129 pgs: 129 active+clean; 34 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.0 MiB/s wr, 650 op/s 2023-10-08T13:29:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:03 smithi187 ceph-mon[104336]: pgmap v346: 129 pgs: 129 active+clean; 36 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 703 op/s 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/2911078983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0105ae0 msgr2=0x7fd7d010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/2911078983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0105ae0 0x7fd7d010d4f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b0d0 tx=0x7fd7c800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/2911078983 shutdown_connections 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/2911078983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0105ae0 0x7fd7d010d4f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/2911078983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0067fd0 0x7fd7d00683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/2911078983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105120 0x7fd7d01055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/2911078983 >> 172.21.15.139:0/2911078983 conn(0x7fd7d0076790 msgr2=0x7fd7d0076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/2911078983 shutdown_connections 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.026+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/2911078983 wait complete. 2023-10-08T13:29:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 Processor -- start 2023-10-08T13:29:04.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 -- start start 2023-10-08T13:29:04.030 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0105120 0x7fd7d019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 0x7fd7d01947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0194e60 con 0x7fd7d0067fd0 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0194fd0 con 0x7fd7d0105120 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7d5e4b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0195190 con 0x7fd7d0105ae0 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41490/0 (socket says 172.21.15.139:41490) 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1852168934 learned_addr learned my addr 172.21.15.139:0/1852168934 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0105120 0x7fd7d019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.027+0000 7fd7cffff700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 0x7fd7d01947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1852168934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 msgr2=0x7fd7d01947f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 0x7fd7d01947f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1852168934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0105120 msgr2=0x7fd7d019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0105120 0x7fd7d019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1852168934 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009d00 con 0x7fd7d0067fd0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cffff700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 0x7fd7d01947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000e9a0 tx=0x7fd7c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7ccff9700 1 -- 172.21.15.139:0/1852168934 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0009790 con 0x7fd7d0067fd0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7ccff9700 1 -- 172.21.15.139:0/1852168934 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7c000cbd0 con 0x7fd7d0067fd0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d0195470 con 0x7fd7d0067fd0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7ccff9700 1 -- 172.21.15.139:0/1852168934 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0018680 con 0x7fd7d0067fd0 2023-10-08T13:29:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.028+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d01a16b0 con 0x7fd7d0067fd0 2023-10-08T13:29:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.030+0000 7fd7ccff9700 1 -- 172.21.15.139:0/1852168934 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd7c000cd40 con 0x7fd7d0067fd0 2023-10-08T13:29:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.031+0000 7fd7ccff9700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 0x7fd7b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.031+0000 7fd7ccff9700 1 -- 172.21.15.139:0/1852168934 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd7c0014070 con 0x7fd7d0067fd0 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.031+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 0x7fd7b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.031+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 0x7fd7b80a3ab0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0195c10 tx=0x7fd7c4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 Processor -- start 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 -- start start 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde431a0 0x5623cde3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde3d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdda5400 con 0x5623cde3d0b0 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd96bc0 con 0x5623cde42880 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd944e0 con 0x5623cde431a0 2023-10-08T13:29:04.041 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde3d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60018/0 (socket says 172.21.15.139:60018) 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/3405580685 learned_addr learned my addr 172.21.15.139:0/3405580685 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde431a0 0x5623cde3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/3405580685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde431a0 msgr2=0x5623cde3cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde431a0 0x5623cde3cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/3405580685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 msgr2=0x5623cde3d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde3d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/3405580685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623cdbbad80 con 0x5623cde42880 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.032+0000 7fd7cffff700 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde3d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00a21f0 tx=0x7fd7c0099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90974af8371af38b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7b5ffb700 1 -- 172.21.15.139:0/3405580685 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c009a390 con 0x5623cde42880 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7b5ffb700 1 -- 172.21.15.139:0/3405580685 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7c009e4e0 con 0x5623cde42880 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7b5ffb700 1 -- 172.21.15.139:0/3405580685 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c009a850 con 0x5623cde42880 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 -- 172.21.15.139:0/3405580685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 msgr2=0x5623cde42c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00a21f0 tx=0x7fd7c0099cf0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 -- 172.21.15.139:0/3405580685 shutdown_connections 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde3d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde42c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/3405580685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde431a0 0x5623cde3cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 -- 172.21.15.139:0/3405580685 >> 172.21.15.139:0/3405580685 conn(0x5623cddb1200 msgr2=0x5623cde37b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.033+0000 7fd7e2034b80 1 -- 172.21.15.139:0/3405580685 shutdown_connections 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 -- 172.21.15.139:0/3405580685 wait complete. 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 -- start start 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 Processor -- start 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde46aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd8fdd0 con 0x5623cde3d0b0 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd2c6b0 con 0x5623cde431a0 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd2c350 con 0x5623cde42880 2023-10-08T13:29:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7e2034b80 10 client.0 _ll_register_callbacks cb 0x5623cdb897a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41504/0 (socket says 172.21.15.139:41504) 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/990783902 learned_addr learned my addr 172.21.15.139:0/990783902 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.034+0000 7fd7cffff700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde46aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 msgr2=0x5623cde46aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde46aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/990783902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 msgr2=0x5623cde46fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/990783902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d010de20 con 0x5623cde3d0b0 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cffff700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:04.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00cd810 tx=0x7fd7c00cd5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9a961cdd80ef83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00a2720 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623cdd57e50 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd7c0099a90 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7c009a5f0 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 10 client.16329 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fd7d01a16b0 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623cdd57e50 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd7c007b070 con 0x5623cde3d0b0 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 10 client.16329 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:04.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 20 client.16329 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.035+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cde56bb0 0x5623cde58fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.036+0000 7fd7e2034b80 4 client.16329 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.036+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623cdd88db0 con 0x5623cde56bb0 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.036+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cde56bb0 0x5623cde58fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.036+0000 7fd7aeffd700 10 client.16329 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.036+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cde56bb0 0x5623cde58fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dc5e6804029775f server_cookie=25d9533a266966e3 in_seq=0 out_seq=0 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7aeffd700 1 -- 172.21.15.139:0/990783902 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623cdd88db0 con 0x5623cde56bb0 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7aeffd700 10 client.16329 handle_command_reply: tid=0 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 client.16329 shutdown 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 msgr2=0x5623cde46560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00cd810 tx=0x7fd7c00cd5e0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 shutdown_connections 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cde56bb0 0x5623cde58fd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde46560 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7aeffd700 0 client.16329 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/990783902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde46aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 >> 172.21.15.139:0/990783902 conn(0x5623cddb1200 msgr2=0x5623cde37010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 shutdown_connections 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 1 -- 172.21.15.139:0/990783902 wait complete. 2023-10-08T13:29:04.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.037+0000 7fd7e2034b80 20 client.16329 trim_cache size 0 max 16384 2023-10-08T13:29:04.054 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 Processor -- start 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 -- start start 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde37cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdc108c0 con 0x5623cde3d0b0 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cdd57e50 con 0x5623cde431a0 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cde322b0 con 0x5623cde42880 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41512/0 (socket says 172.21.15.139:41512) 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1594909672 learned_addr learned my addr 172.21.15.139:0/1594909672 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cffff700 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.055 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde37cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1594909672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 msgr2=0x5623cde37cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde37cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1594909672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 msgr2=0x5623cde46ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 -- 172.21.15.139:0/1594909672 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623cdba3c00 con 0x5623cde3d0b0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.052+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000e970 tx=0x7fd7c00cabd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cf0ae4f46e07ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7b67fc700 1 -- 172.21.15.139:0/1594909672 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00966d0 con 0x5623cde3d0b0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7b67fc700 1 -- 172.21.15.139:0/1594909672 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7c0099cf0 con 0x5623cde3d0b0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7b67fc700 1 -- 172.21.15.139:0/1594909672 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00a2290 con 0x5623cde3d0b0 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 -- 172.21.15.139:0/1594909672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 msgr2=0x5623cde37790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000e970 tx=0x7fd7c00cabd0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.056 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 -- 172.21.15.139:0/1594909672 shutdown_connections 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde431a0 0x5623cde46ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde3d0b0 0x5623cde37790 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/1594909672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde42880 0x5623cde37cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 -- 172.21.15.139:0/1594909672 >> 172.21.15.139:0/1594909672 conn(0x5623cddb1200 msgr2=0x5623cde44e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 -- 172.21.15.139:0/1594909672 shutdown_connections 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.053+0000 7fd7e2034b80 1 -- 172.21.15.139:0/1594909672 wait complete. 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 -- start start 2023-10-08T13:29:04.057 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 Processor -- start 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde3d0b0 0x5623cde4dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde4bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cde4c680 con 0x5623cde431a0 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cde4c7f0 con 0x5623cde42880 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623cde4c9b0 con 0x5623cde3d0b0 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7e2034b80 10 client.0 _ll_register_callbacks cb 0x7fd7c4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41522/0 (socket says 172.21.15.139:41522) 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cffff700 1 -- 172.21.15.139:0/2302798527 learned_addr learned my addr 172.21.15.139:0/2302798527 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7ceffd700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde4bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde3d0b0 0x5623cde4dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cffff700 1 -- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde3d0b0 msgr2=0x5623cde4dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.054+0000 7fd7cffff700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde3d0b0 0x5623cde4dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7cffff700 1 -- 172.21.15.139:0/2302798527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 msgr2=0x5623cde4bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7cffff700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde4bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7cffff700 1 -- 172.21.15.139:0/2302798527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d01a16b0 con 0x5623cde431a0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7cffff700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b0d0 tx=0x7fd7c8004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c790d194df9bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8010e00 con 0x5623cde431a0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fd7c800baa0 con 0x5623cde431a0 2023-10-08T13:29:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd7c009e4e0 con 0x5623cde431a0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7c800bc60 con 0x5623cde431a0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 10 client.16335 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5623cdbe11f0 con 0x5623cde431a0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7c009e4e0 con 0x5623cde431a0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd7c800b100 con 0x5623cde431a0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 10 client.16335 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 20 client.16335 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cdeab0b0 0x5623cdead4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 4 client.16335 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.055+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623cdd88ad0 con 0x5623cdeab0b0 2023-10-08T13:29:04.062 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.056+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cdeab0b0 0x5623cdead4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.056+0000 7fd7aeffd700 10 client.16335 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:04.056+0000 7fd7cf7fe700 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cdeab0b0 0x5623cdead4d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133181616184a006 server_cookie=d4e97f3a079cdfa6 in_seq=0 out_seq=0 2023-10-08T13:29:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:03 smithi155 ceph-mon[103467]: pgmap v346: 129 pgs: 129 active+clean; 36 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 703 op/s 2023-10-08T13:29:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:03 smithi139 ceph-mon[99506]: pgmap v346: 129 pgs: 129 active+clean; 36 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 703 op/s 2023-10-08T13:29:05.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.597+0000 7f0992410700 1 -- 172.21.15.139:0/2694201882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c107a60 msgr2=0x7f098c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.597+0000 7f0992410700 1 --2- 172.21.15.139:0/2694201882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c107a60 0x7f098c107e40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f098401c110 tx=0x7f0984009f90 comp rx=0 tx=0).stop 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.597+0000 7f0992410700 1 -- 172.21.15.139:0/2694201882 shutdown_connections 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.598+0000 7f0992410700 1 --2- 172.21.15.139:0/2694201882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c10f3a0 0x7f098c11c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.598+0000 7f0992410700 1 --2- 172.21.15.139:0/2694201882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c107a60 0x7f098c107e40 secure :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f098401c110 tx=0x7f0984009f90 comp rx=0 tx=0).stop 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.598+0000 7f0992410700 1 --2- 172.21.15.139:0/2694201882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f098c108410 0x7f098c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.598+0000 7f0992410700 1 -- 172.21.15.139:0/2694201882 >> 172.21.15.139:0/2694201882 conn(0x7f098c06bc80 msgr2=0x7f098c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.607+0000 7f0992410700 1 -- 172.21.15.139:0/2694201882 shutdown_connections 2023-10-08T13:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.613+0000 7f0992410700 1 -- 172.21.15.139:0/2694201882 wait complete. 2023-10-08T13:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.613+0000 7f0992410700 1 Processor -- start 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.613+0000 7f0992410700 1 -- start start 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f098c10f3a0 0x7f098c1195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c119b10 0x7f098c115690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c078bf0 con 0x7f098c115bd0 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c078d60 con 0x7f098c10f3a0 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f0992410700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c078f20 con 0x7f098c119b10 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f09909ad700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f09909ad700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41530/0 (socket says 172.21.15.139:41530) 2023-10-08T13:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.614+0000 7f09909ad700 1 -- 172.21.15.139:0/1279608729 learned_addr learned my addr 172.21.15.139:0/1279608729 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f098b7fe700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c119b10 0x7f098c115690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 -- 172.21.15.139:0/1279608729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c119b10 msgr2=0x7f098c115690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c119b10 0x7f098c115690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 -- 172.21.15.139:0/1279608729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f098c10f3a0 msgr2=0x7f098c1195d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f098c10f3a0 0x7f098c1195d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 -- 172.21.15.139:0/1279608729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009d00 con 0x7f098c115bd0 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09909ad700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f098000c8d0 tx=0x7f098000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09897fa700 1 -- 172.21.15.139:0/1279608729 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980004460 con 0x7f098c115bd0 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09897fa700 1 -- 172.21.15.139:0/1279608729 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0980007bb0 con 0x7f098c115bd0 2023-10-08T13:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c079200 con 0x7f098c115bd0 2023-10-08T13:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.615+0000 7f09897fa700 1 -- 172.21.15.139:0/1279608729 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980003d00 con 0x7f098c115bd0 2023-10-08T13:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.616+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c079710 con 0x7f098c115bd0 2023-10-08T13:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.618+0000 7f09897fa700 1 -- 172.21.15.139:0/1279608729 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f0980007d20 con 0x7f098c115bd0 2023-10-08T13:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.619+0000 7f09897fa700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 0x7f09740a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.619+0000 7f09897fa700 1 -- 172.21.15.139:0/1279608729 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f09800cd440 con 0x7f098c115bd0 2023-10-08T13:29:05.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.624+0000 7f099e5f9b80 1 Processor -- start 2023-10-08T13:29:05.631 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.629+0000 7f098bfff700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 0x7f09740a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.633+0000 7f098bfff700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 0x7f09740a3c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0984009f60 tx=0x7f0984000f40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:05.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 -- start start 2023-10-08T13:29:05.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dd7a0 0x55f7261e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f726146460 con 0x55f7261dce80 2023-10-08T13:29:05.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f726137c20 con 0x55f7261e8650 2023-10-08T13:29:05.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.641+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f726135540 con 0x55f7261dd7a0 2023-10-08T13:29:05.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.647+0000 7f09909ad700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60056/0 (socket says 172.21.15.139:60056) 2023-10-08T13:29:05.648 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 -- 172.21.15.139:0/3706568582 learned_addr learned my addr 172.21.15.139:0/3706568582 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:05.649 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 -- 172.21.15.139:0/3706568582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dd7a0 msgr2=0x55f7261e8110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:29:05.649 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dd7a0 0x55f7261e8110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.649 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 -- 172.21.15.139:0/3706568582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 msgr2=0x55f7261dd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:05.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.650 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.648+0000 7f09909ad700 1 -- 172.21.15.139:0/3706568582 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f725f5bde0 con 0x55f7261e8650 2023-10-08T13:29:05.659 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.658+0000 7f09909ad700 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0980099de0 tx=0x7f0980099ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5030b74c1d62e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:05.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.661+0000 7f09727fc700 1 -- 172.21.15.139:0/3706568582 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098009a0e0 con 0x55f7261e8650 2023-10-08T13:29:05.662 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.661+0000 7f09727fc700 1 -- 172.21.15.139:0/3706568582 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f098009e230 con 0x55f7261e8650 2023-10-08T13:29:05.663 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.661+0000 7f09727fc700 1 -- 172.21.15.139:0/3706568582 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098009a5a0 con 0x55f7261e8650 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 -- 172.21.15.139:0/3706568582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 msgr2=0x55f7261eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0980099de0 tx=0x7f0980099ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 -- 172.21.15.139:0/3706568582 shutdown_connections 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261eaa40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261dd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/3706568582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dd7a0 0x55f7261e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 -- 172.21.15.139:0/3706568582 >> 172.21.15.139:0/3706568582 conn(0x55f726152260 msgr2=0x55f7261d92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:05.664 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 -- 172.21.15.139:0/3706568582 shutdown_connections 2023-10-08T13:29:05.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.662+0000 7f099e5f9b80 1 -- 172.21.15.139:0/3706568582 wait complete. 2023-10-08T13:29:05.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 -- start start 2023-10-08T13:29:05.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 Processor -- start 2023-10-08T13:29:05.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dd7a0 0x55f7261e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f726130e30 con 0x55f7261dce80 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7260cd710 con 0x55f7261dd7a0 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7260cd3b0 con 0x55f7261e8650 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.663+0000 7f099e5f9b80 10 client.0 _ll_register_callbacks cb 0x55f725f2a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41542/0 (socket says 172.21.15.139:41542) 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 -- 172.21.15.139:0/180483586 learned_addr learned my addr 172.21.15.139:0/180483586 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:05.666 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098b7fe700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dd7a0 0x55f7261e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 -- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 msgr2=0x55f7261e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:05.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 -- 172.21.15.139:0/180483586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dd7a0 msgr2=0x55f7261e59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dd7a0 0x55f7261e59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 -- 172.21.15.139:0/180483586 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c079710 con 0x55f7261dce80 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.664+0000 7f098bfff700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0984026000 tx=0x7f09840093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fe9483cd9732ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.665+0000 7f096b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.665+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840076a0 con 0x55f7261dce80 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.665+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0984007800 con 0x55f7261dce80 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.666+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7260f8eb0 con 0x55f7261dce80 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.666+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09840079c0 con 0x55f7261dce80 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.666+0000 7f099e5f9b80 10 client.16344 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:05.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.666+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f725f44c60 con 0x55f7261dce80 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.666+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7260f8eb0 con 0x55f7261dce80 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f098402d410 con 0x55f7261dce80 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 10 client.16344 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 20 client.16344 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:05.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f7261f80e0 0x55f7261fa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:05.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 4 client.16344 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:05.670 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.667+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f726129e10 con 0x55f7261f80e0 2023-10-08T13:29:05.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.685+0000 7f098b7fe700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f7261f80e0 0x55f7261fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.700+0000 7f098b7fe700 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f7261f80e0 0x55f7261fa500 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77099d385466a94 server_cookie=5e466207c483d59d in_seq=0 out_seq=0 2023-10-08T13:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:05.706+0000 7f096b7fe700 10 client.16344 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:05.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:05 smithi187 ceph-mon[104336]: pgmap v347: 129 pgs: 129 active+clean; 39 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 566 op/s 2023-10-08T13:29:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:05 smithi155 ceph-mon[103467]: pgmap v347: 129 pgs: 129 active+clean; 39 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 566 op/s 2023-10-08T13:29:06.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f096b7fe700 1 -- 172.21.15.139:0/180483586 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f726129e10 con 0x55f7261f80e0 2023-10-08T13:29:06.155 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f096b7fe700 10 client.16344 handle_command_reply: tid=0 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 client.16344 shutdown 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 msgr2=0x55f7261e5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0984026000 tx=0x7f09840093b0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 shutdown_connections 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dce80 0x55f7261e5460 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f7261f80e0 0x55f7261fa500 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/180483586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dd7a0 0x55f7261e59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f096b7fe700 0 client.16344 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 >> 172.21.15.139:0/180483586 conn(0x55f726152260 msgr2=0x55f7261d8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.156 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 shutdown_connections 2023-10-08T13:29:06.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.154+0000 7f099e5f9b80 1 -- 172.21.15.139:0/180483586 wait complete. 2023-10-08T13:29:06.157 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.155+0000 7f099e5f9b80 20 client.16344 trim_cache size 0 max 16384 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.155+0000 7fd7aeffd700 1 -- 172.21.15.139:0/2302798527 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623cdd88ad0 con 0x5623cdeab0b0 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.155+0000 7fd7aeffd700 10 client.16335 handle_command_reply: tid=0 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.155+0000 7fd7e2034b80 1 client.16335 shutdown 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 msgr2=0x5623cde4c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800b0d0 tx=0x7fd7c8004e90 comp rx=0 tx=0).stop 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 shutdown_connections 2023-10-08T13:29:06.158 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623cde431a0 0x5623cde4c140 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623cde3d0b0 0x5623cde4dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5623cdeab0b0 0x5623cdead4d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 --2- 172.21.15.139:0/2302798527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623cde42880 0x5623cde4bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7aeffd700 0 client.16335 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 >> 172.21.15.139:0/2302798527 conn(0x5623cddb1200 msgr2=0x5623cde47e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 shutdown_connections 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 1 -- 172.21.15.139:0/2302798527 wait complete. 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.156+0000 7fd7e2034b80 20 client.16335 trim_cache size 0 max 16384 2023-10-08T13:29:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:29:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:29:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:29:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:29:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 msgr2=0x7fd7b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 0x7fd7b80a3ab0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0195c10 tx=0x7fd7c4009260 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 msgr2=0x7fd7d019a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000e9a0 tx=0x7fd7c000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 shutdown_connections 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd7b80a15f0 0x7fd7b80a3ab0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d0105ae0 0x7fd7d01947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7d0067fd0 0x7fd7d019a6c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 --2- 172.21.15.139:0/1852168934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7d0105120 0x7fd7d019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 >> 172.21.15.139:0/1852168934 conn(0x7fd7d0076790 msgr2=0x7fd7d00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 shutdown_connections 2023-10-08T13:29:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:06.157+0000 7fd7d5e4b700 1 -- 172.21.15.139:0/1852168934 wait complete. 2023-10-08T13:29:06.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.172+0000 7f099e5f9b80 1 Processor -- start 2023-10-08T13:29:06.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 -- start start 2023-10-08T13:29:06.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dce80 0x55f7261dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f725fb1920 con 0x55f7261dd7a0 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7261de970 con 0x55f7261e8650 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7261fab60 con 0x55f7261dce80 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41552/0 (socket says 172.21.15.139:41552) 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 -- 172.21.15.139:0/1276446613 learned_addr learned my addr 172.21.15.139:0/1276446613 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098bfff700 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dce80 0x55f7261dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 -- 172.21.15.139:0/1276446613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dce80 msgr2=0x55f7261dfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dce80 0x55f7261dfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 -- 172.21.15.139:0/1276446613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 msgr2=0x55f7261e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f09909ad700 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 -- 172.21.15.139:0/1276446613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f725f82250 con 0x55f7261dd7a0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f098b7fe700 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c260 tx=0x7f097c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b04c79921994ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.173+0000 7f0972ffd700 1 -- 172.21.15.139:0/1276446613 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00ce90 con 0x55f7261dd7a0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f0972ffd700 1 -- 172.21.15.139:0/1276446613 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f097c00c040 con 0x55f7261dd7a0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f0972ffd700 1 -- 172.21.15.139:0/1276446613 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c016b00 con 0x55f7261dd7a0 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 -- 172.21.15.139:0/1276446613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 msgr2=0x55f7261e5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c260 tx=0x7f097c00ccb0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 -- 172.21.15.139:0/1276446613 shutdown_connections 2023-10-08T13:29:06.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261e8650 0x55f7261e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261dce80 0x55f7261dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/1276446613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261e5d00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 -- 172.21.15.139:0/1276446613 >> 172.21.15.139:0/1276446613 conn(0x55f726152260 msgr2=0x55f7261e3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 -- 172.21.15.139:0/1276446613 shutdown_connections 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.174+0000 7f099e5f9b80 1 -- 172.21.15.139:0/1276446613 wait complete. 2023-10-08T13:29:06.178 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 -- start start 2023-10-08T13:29:06.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 Processor -- start 2023-10-08T13:29:06.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dce80 0x55f7261ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7261ee530 con 0x55f7261dd7a0 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72624bee0 con 0x55f7261dce80 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72624c020 con 0x55f7261e8650 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f099e5f9b80 10 client.0 _ll_register_callbacks cb 0x7f098401cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41558/0 (socket says 172.21.15.139:41558) 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 -- 172.21.15.139:0/4180171542 learned_addr learned my addr 172.21.15.139:0/4180171542 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098bfff700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dce80 0x55f7261ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f09909ad700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 -- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 msgr2=0x55f7261ede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261ede20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 -- 172.21.15.139:0/4180171542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dce80 msgr2=0x55f7261ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.175+0000 7f098b7fe700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dce80 0x55f7261ef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f098b7fe700 1 -- 172.21.15.139:0/4180171542 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c00c9e0 con 0x55f7261dd7a0 2023-10-08T13:29:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f098b7fe700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c018d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb7162c7b47efcb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c018450 con 0x55f7261dd7a0 2023-10-08T13:29:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f097c0167a0 con 0x55f7261dd7a0 2023-10-08T13:29:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f098009e230 con 0x55f7261dd7a0 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f097c016960 con 0x55f7261dd7a0 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 10 client.16350 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55f725f5a2b0 con 0x55f7261dd7a0 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f098009e230 con 0x55f7261dd7a0 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f097c029070 con 0x55f7261dd7a0 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 10 client.16350 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 20 client.16350 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f72624d780 0x55f72624fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 4 client.16350 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.176+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f726129b30 con 0x55f72624d780 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.177+0000 7f098bfff700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f72624d780 0x55f72624fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.177+0000 7f096b7fe700 10 client.16350 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.177+0000 7f098bfff700 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f72624d780 0x55f72624fba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bddc33148fd8184 server_cookie=1254d52db59c3c1b in_seq=0 out_seq=0 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f096b7fe700 1 -- 172.21.15.139:0/4180171542 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f726129b30 con 0x55f72624d780 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f096b7fe700 10 client.16350 handle_command_reply: tid=0 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 client.16350 shutdown 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 msgr2=0x55f7261ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c018d40 comp rx=0 tx=0).stop 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 shutdown_connections 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7261e8650 0x55f7261ede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f72624d780 0x55f72624fba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f7261dce80 0x55f7261ef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 --2- 172.21.15.139:0/4180171542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f7261dd7a0 0x55f7261ed6e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f096b7fe700 0 client.16350 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 >> 172.21.15.139:0/4180171542 conn(0x55f726152260 msgr2=0x55f7261e5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 shutdown_connections 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 1 -- 172.21.15.139:0/4180171542 wait complete. 2023-10-08T13:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.178+0000 7f099e5f9b80 20 client.16350 trim_cache size 0 max 16384 2023-10-08T13:29:06.192 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:29:06.192 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "no active scrubs running", 2023-10-08T13:29:06.192 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": {} 2023-10-08T13:29:06.192 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 msgr2=0x7f09740a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 0x7f09740a3c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0984009f60 tx=0x7f0984000f40 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 msgr2=0x7f098c116060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f098000c8d0 tx=0x7f098000cc90 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 shutdown_connections 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f09740a1780 0x7f09740a3c40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f098c115bd0 0x7f098c116060 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f098c10f3a0 0x7f098c1195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 --2- 172.21.15.139:0/1279608729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f098c119b10 0x7f098c115690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 >> 172.21.15.139:0/1279608729 conn(0x7f098c06bc80 msgr2=0x7f098c108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 shutdown_connections 2023-10-08T13:29:06.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.179+0000 7f0992410700 1 -- 172.21.15.139:0/1279608729 wait complete. 2023-10-08T13:29:06.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:05 smithi139 ceph-mon[99506]: pgmap v347: 129 pgs: 129 active+clean; 39 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 566 op/s 2023-10-08T13:29:06.195 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:29:06.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.319+0000 7f62bcd24700 1 -- 172.21.15.139:0/3589859773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b8105620 msgr2=0x7f62b8105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.319+0000 7f62bcd24700 1 --2- 172.21.15.139:0/3589859773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b8105620 0x7f62b8105a00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f62a80099c0 tx=0x7f62a8009cd0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 -- 172.21.15.139:0/3589859773 shutdown_connections 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 --2- 172.21.15.139:0/3589859773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80fff20 0x7f62b810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 --2- 172.21.15.139:0/3589859773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b8105620 0x7f62b8105a00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 --2- 172.21.15.139:0/3589859773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b80ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 -- 172.21.15.139:0/3589859773 >> 172.21.15.139:0/3589859773 conn(0x7f62b80fb050 msgr2=0x7f62b80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 -- 172.21.15.139:0/3589859773 shutdown_connections 2023-10-08T13:29:06.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.320+0000 7f62bcd24700 1 -- 172.21.15.139:0/3589859773 wait complete. 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 Processor -- start 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 -- start start 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b8197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b8105620 0x7f62b81a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8198610 con 0x7f62b80fff20 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81a2e20 con 0x7f62b80ff560 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62bcd24700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81a2f60 con 0x7f62b8105620 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41572/0 (socket says 172.21.15.139:41572) 2023-10-08T13:29:06.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 -- 172.21.15.139:0/2937352339 learned_addr learned my addr 172.21.15.139:0/2937352339 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b659c700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b8197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b6d9d700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b8105620 0x7f62b81a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 -- 172.21.15.139:0/2937352339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b8105620 msgr2=0x7f62b81a28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b8105620 0x7f62b81a28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 -- 172.21.15.139:0/2937352339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 msgr2=0x7f62b8197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b8197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b5d9b700 1 -- 172.21.15.139:0/2937352339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac009520 con 0x7f62b80fff20 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.321+0000 7f62b659c700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62b5d9b700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00eb30 tx=0x7f62ac00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac009880 con 0x7f62b80fff20 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62ac0044e0 con 0x7f62b80fff20 2023-10-08T13:29:06.325 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80095f0 con 0x7f62b80fff20 2023-10-08T13:29:06.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac003d80 con 0x7f62b80fff20 2023-10-08T13:29:06.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.322+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b81a3570 con 0x7f62b80fff20 2023-10-08T13:29:06.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.323+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8107aa0 con 0x7f62b80fff20 2023-10-08T13:29:06.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.324+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f62ac003f20 con 0x7f62b80fff20 2023-10-08T13:29:06.326 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.324+0000 7f62a77fe700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 0x7f62a00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.324+0000 7f62b659c700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 0x7f62a00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.324+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f62ac014070 con 0x7f62b80fff20 2023-10-08T13:29:06.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.325+0000 7f62b659c700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 0x7f62a00a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009fd0 tx=0x7f62a8005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.329+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f62ac096950 con 0x7f62b80fff20 2023-10-08T13:29:06.652 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.651+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62b8069210 con 0x7f62b80fff20 2023-10-08T13:29:06.652 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.651+0000 7f62a77fe700 1 -- 172.21.15.139:0/2937352339 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+11400 (secure 0 0 0) 0x7f62ac0041d0 con 0x7f62b80fff20 2023-10-08T13:29:06.652 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:29:06.653 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:28:46.496778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24542":{"gid":24542,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/4262434274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4262434274},{"type":"v1","addr":"172.21.15.155:6835","nonce":4262434274}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:29:06.655 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 msgr2=0x7f62a00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.655 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 0x7f62a00a3ab0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009fd0 tx=0x7f62a8005fb0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 msgr2=0x7f62b8197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00eb30 tx=0x7f62ac00ee40 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 shutdown_connections 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f62a00a15f0 0x7f62a00a3ab0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b8105620 0x7f62b81a28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62b80ff560 0x7f62b8197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 --2- 172.21.15.139:0/2937352339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62b80fff20 0x7f62b8197da0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 >> 172.21.15.139:0/2937352339 conn(0x7f62b80fb050 msgr2=0x7f62b80fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 shutdown_connections 2023-10-08T13:29:06.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.654+0000 7f62bcd24700 1 -- 172.21.15.139:0/2937352339 wait complete. 2023-10-08T13:29:06.657 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 28 2023-10-08T13:29:06.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- 172.21.15.139:0/2661224191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 msgr2=0x7fe19c105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/2661224191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c105a20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009990 tx=0x7fe18c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- 172.21.15.139:0/2661224191 shutdown_connections 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/2661224191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 0x7fe19c10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/2661224191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c105a20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.848 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/2661224191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- 172.21.15.139:0/2661224191 >> 172.21.15.139:0/2661224191 conn(0x7fe19c0fb100 msgr2=0x7fe19c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- 172.21.15.139:0/2661224191 shutdown_connections 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- 172.21.15.139:0/2661224191 wait complete. 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 Processor -- start 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.845+0000 7fe1a1e40700 1 -- start start 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 0x7fe19c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c197050 con 0x7fe19c105640 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c1971c0 con 0x7fe19c0ff630 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe1a1e40700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19c197380 con 0x7fe19c0ffff0 2023-10-08T13:29:06.849 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 0x7fe19c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41588/0 (socket says 172.21.15.139:41588) 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19bfff700 1 -- 172.21.15.139:0/4213605800 learned_addr learned my addr 172.21.15.139:0/4213605800 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 -- 172.21.15.139:0/4213605800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 msgr2=0x7fe19c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 0x7fe19c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 -- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 msgr2=0x7fe19c1969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 -- 172.21.15.139:0/4213605800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0095f0 con 0x7fe19c0ff630 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19bfff700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:06.850 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c19c870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0059d0 tx=0x7fe18c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.846+0000 7fe198ff9700 1 -- 172.21.15.139:0/4213605800 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c01d070 con 0x7fe19c0ff630 2023-10-08T13:29:06.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.847+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19c069c90 con 0x7fe19c0ff630 2023-10-08T13:29:06.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.847+0000 7fe198ff9700 1 -- 172.21.15.139:0/4213605800 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18c022470 con 0x7fe19c0ff630 2023-10-08T13:29:06.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.847+0000 7fe198ff9700 1 -- 172.21.15.139:0/4213605800 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c017650 con 0x7fe19c0ff630 2023-10-08T13:29:06.851 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.847+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c1a3680 con 0x7fe19c0ff630 2023-10-08T13:29:06.857 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.849+0000 7fe198ff9700 1 -- 172.21.15.139:0/4213605800 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe18c0225e0 con 0x7fe19c0ff630 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.849+0000 7fe198ff9700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 0x7fe1840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe19affd700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 0x7fe1840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe198ff9700 1 -- 172.21.15.139:0/4213605800 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe18c0ce4c0 con 0x7fe19c0ff630 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe19affd700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 0x7fe1840a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe19c197b60 tx=0x7fe190009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 Processor -- start 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 -- start start 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eed3c0 0x564f55eed840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f030e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55e56460 con 0x564f55eeea40 2023-10-08T13:29:06.858 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.850+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55e47c20 con 0x564f55eed3c0 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55e45540 con 0x564f55f00cf0 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41592/0 (socket says 172.21.15.139:41592) 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 -- 172.21.15.139:0/3577428812 learned_addr learned my addr 172.21.15.139:0/3577428812 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19bfff700 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19affd700 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eed3c0 0x564f55eed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 -- 172.21.15.139:0/3577428812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 msgr2=0x564f55f030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 -- 172.21.15.139:0/3577428812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eed3c0 msgr2=0x564f55eed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eed3c0 0x564f55eed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 -- 172.21.15.139:0/3577428812 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f55c6bde0 con 0x564f55eeea40 2023-10-08T13:29:06.859 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe18c09b180 tx=0x7fe18c09b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa20fc892ec72ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe181ffb700 1 -- 172.21.15.139:0/3577428812 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c09f170 con 0x564f55eeea40 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe181ffb700 1 -- 172.21.15.139:0/3577428812 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18c09b8f0 con 0x564f55eeea40 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.851+0000 7fe181ffb700 1 -- 172.21.15.139:0/3577428812 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0ce110 con 0x564f55eeea40 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- 172.21.15.139:0/3577428812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 msgr2=0x564f55eece80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe18c09b180 tx=0x7fe18c09b060 comp rx=0 tx=0).stop 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- 172.21.15.139:0/3577428812 shutdown_connections 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eeea40 0x564f55eece80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/3577428812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eed3c0 0x564f55eed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- 172.21.15.139:0/3577428812 >> 172.21.15.139:0/3577428812 conn(0x564f55e62260 msgr2=0x564f55ee92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- 172.21.15.139:0/3577428812 shutdown_connections 2023-10-08T13:29:06.860 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- 172.21.15.139:0/3577428812 wait complete. 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.852+0000 7fe1ae029b80 1 -- start start 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 Processor -- start 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55e40e30 con 0x564f55eed3c0 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55ddd710 con 0x564f55eeea40 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55ddd3b0 con 0x564f55f00cf0 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe1ae029b80 10 client.0 _ll_register_callbacks cb 0x564f55c3a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41598/0 (socket says 172.21.15.139:41598) 2023-10-08T13:29:06.861 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 -- 172.21.15.139:0/67366123 learned_addr learned my addr 172.21.15.139:0/67366123 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19bfff700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19affd700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 -- 172.21.15.139:0/67366123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 msgr2=0x564f55ef1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 -- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 msgr2=0x564f55ef0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 -- 172.21.15.139:0/67366123 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19c1a3680 con 0x564f55eed3c0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19bfff700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe18c024000 tx=0x7fe18c0cb870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f5b2043d20ddba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe17affd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0ce320 con 0x564f55eed3c0 2023-10-08T13:29:06.862 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.853+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe18c09b1f0 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f55e08eb0 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe18c0a34f0 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 10 client.16368 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564f55c54c60 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f55e08eb0 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe18c0a3060 con 0x564f55eed3c0 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 10 client.16368 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 10 client.16368 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 20 client.16368 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f101c0 0x564f55f125e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.863 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 4 client.16368 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f55e39e10 con 0x564f55f101c0 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.854+0000 7fe19affd700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f101c0 0x564f55f125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe17affd700 10 client.16368 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe19affd700 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f101c0 0x564f55f125e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e51a77f6c5306e2 server_cookie=4bcc69d90341f813 in_seq=0 out_seq=0 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe17affd700 1 -- 172.21.15.139:0/67366123 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f55e39e10 con 0x564f55f101c0 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe17affd700 10 client.16368 handle_command_reply: tid=0 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 client.16368 shutdown 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 msgr2=0x564f55ef3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe18c024000 tx=0x7fe18c0cb870 comp rx=0 tx=0).stop 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 shutdown_connections 2023-10-08T13:29:06.864 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.855+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55ef3b40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f101c0 0x564f55f125e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/67366123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 >> 172.21.15.139:0/67366123 conn(0x564f55e62260 msgr2=0x564f55ee8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe17affd700 0 client.16368 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 shutdown_connections 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 1 -- 172.21.15.139:0/67366123 wait complete. 2023-10-08T13:29:06.865 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.856+0000 7fe1ae029b80 20 client.16368 trim_cache size 0 max 16384 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 Processor -- start 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 -- start start 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55cc1920 con 0x564f55eed3c0 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55ef2460 con 0x564f55eeea40 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.869+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55eea910 con 0x564f55f00cf0 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41606/0 (socket says 172.21.15.139:41606) 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 -- 172.21.15.139:0/684703508 learned_addr learned my addr 172.21.15.139:0/684703508 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19affd700 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 -- 172.21.15.139:0/684703508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 msgr2=0x564f55ef0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 -- 172.21.15.139:0/684703508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 msgr2=0x564f55ef3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 -- 172.21.15.139:0/684703508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f55c92250 con 0x564f55eed3c0 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19bfff700 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe18c09b180 tx=0x7fe18c00b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a270ca10ac27334 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe1827fc700 1 -- 172.21.15.139:0/684703508 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c09f170 con 0x564f55eed3c0 2023-10-08T13:29:06.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe1827fc700 1 -- 172.21.15.139:0/684703508 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18c0ce320 con 0x564f55eed3c0 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.870+0000 7fe1827fc700 1 -- 172.21.15.139:0/684703508 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0a3060 con 0x564f55eed3c0 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- 172.21.15.139:0/684703508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 msgr2=0x564f55f121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fe18c09b180 tx=0x7fe18c00b490 comp rx=0 tx=0).stop 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- 172.21.15.139:0/684703508 shutdown_connections 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55ef0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f121d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/684703508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55ef3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- 172.21.15.139:0/684703508 >> 172.21.15.139:0/684703508 conn(0x564f55e62260 msgr2=0x564f55f00380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- 172.21.15.139:0/684703508 shutdown_connections 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- 172.21.15.139:0/684703508 wait complete. 2023-10-08T13:29:06.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 -- start start 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.871+0000 7fe1ae029b80 1 Processor -- start 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55f02c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55f05660 con 0x564f55eed3c0 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55f62ff0 con 0x564f55eeea40 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f55f63130 con 0x564f55f00cf0 2023-10-08T13:29:06.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 10 client.0 _ll_register_callbacks cb 0x7fe194009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41612/0 (socket says 172.21.15.139:41612) 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19b7fe700 1 -- 172.21.15.139:0/556625332 learned_addr learned my addr 172.21.15.139:0/556625332 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55f02c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19bfff700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 -- 172.21.15.139:0/556625332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 msgr2=0x564f55f031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 -- 172.21.15.139:0/556625332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 msgr2=0x564f55f02730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 -- 172.21.15.139:0/556625332 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe194007770 con 0x564f55eeea40 2023-10-08T13:29:06.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe19affd700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55f02c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x564f55f12e90 tx=0x7fe190013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18abe81199726484 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe17affd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190023040 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe18c09b8f0 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe190028900 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.872+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe190028ac0 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 10 client.25826 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x564f55c54c60 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe18c09b8f0 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe19001d410 con 0x564f55eeea40 2023-10-08T13:29:06.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 10 client.25826 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 10 client.25826 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 20 client.25826 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f64960 0x564f55f66d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 4 client.25826 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f55e39b30 con 0x564f55f64960 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f64960 0x564f55f66d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe17affd700 10 client.25826 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.873+0000 7fe19b7fe700 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f64960 0x564f55f66d80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9ae1c1934b52d98d server_cookie=9c37f29d495525d0 in_seq=0 out_seq=0 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe17affd700 1 -- 172.21.15.139:0/556625332 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f55e39b30 con 0x564f55f64960 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe17affd700 10 client.25826 handle_command_reply: tid=0 2023-10-08T13:29:06.883 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 client.25826 shutdown 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 msgr2=0x564f55f02c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55f02c70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x564f55f12e90 tx=0x7fe190013040 comp rx=0 tx=0).stop 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 shutdown_connections 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f55f00cf0 0x564f55f031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564f55eed3c0 0x564f55f02730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x564f55f64960 0x564f55f66d80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 --2- 172.21.15.139:0/556625332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564f55eeea40 0x564f55f02c70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe17affd700 0 client.25826 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 >> 172.21.15.139:0/556625332 conn(0x564f55e62260 msgr2=0x564f55f121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 shutdown_connections 2023-10-08T13:29:06.884 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 1 -- 172.21.15.139:0/556625332 wait complete. 2023-10-08T13:29:06.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1ae029b80 20 client.25826 trim_cache size 0 max 16384 2023-10-08T13:29:06.885 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 msgr2=0x7fe1840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 0x7fe1840a3ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe19c197b60 tx=0x7fe190009260 comp rx=0 tx=0).stop 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 msgr2=0x7fe19c19c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.874+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c19c870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0059d0 tx=0x7fe18c004730 comp rx=0 tx=0).stop 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 shutdown_connections 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1840a15f0 0x7fe1840a3ab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe19c105640 0x7fe19c1969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0ff630 0x7fe19c19c870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 --2- 172.21.15.139:0/4213605800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe19c0ffff0 0x7fe19c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:06.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 >> 172.21.15.139:0/4213605800 conn(0x7fe19c0fb100 msgr2=0x7fe19c0fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:06.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 shutdown_connections 2023-10-08T13:29:06.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:06.875+0000 7fe1a1e40700 1 -- 172.21.15.139:0/4213605800 wait complete. 2023-10-08T13:29:06.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T13:29:06.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2937352339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:29:06.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2937352339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:29:07.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 -- 172.21.15.139:0/4003930798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 msgr2=0x7f7714106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 --2- 172.21.15.139:0/4003930798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714106a20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f77040099c0 tx=0x7f7704009cd0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 -- 172.21.15.139:0/4003930798 shutdown_connections 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 --2- 172.21.15.139:0/4003930798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f771410d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 --2- 172.21.15.139:0/4003930798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714106a20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 --2- 172.21.15.139:0/4003930798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 0x7f7714100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 -- 172.21.15.139:0/4003930798 >> 172.21.15.139:0/4003930798 conn(0x7f77140fc090 msgr2=0x7f77140fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 -- 172.21.15.139:0/4003930798 shutdown_connections 2023-10-08T13:29:07.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.014+0000 7f7713fff700 1 -- 172.21.15.139:0/4003930798 wait complete. 2023-10-08T13:29:07.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 Processor -- start 2023-10-08T13:29:07.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 -- start start 2023-10-08T13:29:07.018 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 0x7f7714072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f7714073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141a4df0 con 0x7f7714106640 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141a4f60 con 0x7f7714100580 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.015+0000 7f7713fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77141a5120 con 0x7f7714100f40 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41628/0 (socket says 172.21.15.139:41628) 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 -- 172.21.15.139:0/3488724474 learned_addr learned my addr 172.21.15.139:0/3488724474 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77127fc700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f7714073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 0x7f7714072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.019 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 -- 172.21.15.139:0/3488724474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 msgr2=0x7f7714073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f7714073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 -- 172.21.15.139:0/3488724474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 msgr2=0x7f7714072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 0x7f7714072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 -- 172.21.15.139:0/3488724474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040095f0 con 0x7f7714106640 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77127fc700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f7714073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f77137fe700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f770c00ef30 tx=0x7f770c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f76fbfff700 1 -- 172.21.15.139:0/3488724474 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c018070 con 0x7f7714106640 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77141a53a0 con 0x7f7714106640 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f76fbfff700 1 -- 172.21.15.139:0/3488724474 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f770c00f040 con 0x7f7714106640 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f76fbfff700 1 -- 172.21.15.139:0/3488724474 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c00cd00 con 0x7f7714106640 2023-10-08T13:29:07.020 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.016+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77141a58b0 con 0x7f7714106640 2023-10-08T13:29:07.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.019+0000 7f76fbfff700 1 -- 172.21.15.139:0/3488724474 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f770c003a00 con 0x7f7714106640 2023-10-08T13:29:07.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f76fbfff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 0x7f76fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f76fbfff700 1 -- 172.21.15.139:0/3488724474 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f770c0ccfc0 con 0x7f7714106640 2023-10-08T13:29:07.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 0x7f76fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.023 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 Processor -- start 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 -- start start 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 0x7f76fc0a3ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7704009990 tx=0x7f7704019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea8261430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea826c800 0x560ea826ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea81ca460 con 0x560ea826c800 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea81bbc20 con 0x560ea8261970 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.020+0000 7f77255edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea81b9540 con 0x560ea8261050 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77137fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea826c800 0x560ea826ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea8261430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.024 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60154/0 (socket says 172.21.15.139:60154) 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea8261430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41348/0 (socket says 172.21.15.139:41348) 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 -- 172.21.15.139:0/2147231088 learned_addr learned my addr 172.21.15.139:0/2147231088 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 -- 172.21.15.139:0/2147231088 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 msgr2=0x560ea8261430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea8261430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 -- 172.21.15.139:0/2147231088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea826c800 msgr2=0x560ea826ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea826c800 0x560ea826ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 -- 172.21.15.139:0/2147231088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea7fdfde0 con 0x560ea8261970 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f77127fc700 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77080115f0 tx=0x7f7708011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e64a8610b445a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f76f97fa700 1 -- 172.21.15.139:0/2147231088 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004230 con 0x560ea8261970 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f76f97fa700 1 -- 172.21.15.139:0/2147231088 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7708004390 con 0x560ea8261970 2023-10-08T13:29:07.025 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.021+0000 7f76f97fa700 1 -- 172.21.15.139:0/2147231088 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708019830 con 0x560ea8261970 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- 172.21.15.139:0/2147231088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 msgr2=0x560ea826c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77080115f0 tx=0x7f7708011900 comp rx=0 tx=0).stop 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- 172.21.15.139:0/2147231088 shutdown_connections 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea826c800 0x560ea826ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea8261430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 --2- 172.21.15.139:0/2147231088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea826c2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- 172.21.15.139:0/2147231088 >> 172.21.15.139:0/2147231088 conn(0x560ea81d6260 msgr2=0x560ea825d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- 172.21.15.139:0/2147231088 shutdown_connections 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- 172.21.15.139:0/2147231088 wait complete. 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 -- start start 2023-10-08T13:29:07.026 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.022+0000 7f77255edb80 1 Processor -- start 2023-10-08T13:29:07.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea8269530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea8269c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea81b4e30 con 0x560ea8261050 2023-10-08T13:29:07.030 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea8151710 con 0x560ea8261970 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea81513b0 con 0x560ea826c800 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77255edb80 10 client.0 _ll_register_callbacks cb 0x560ea7fae800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41638/0 (socket says 172.21.15.139:41638) 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 -- 172.21.15.139:0/1211655596 learned_addr learned my addr 172.21.15.139:0/1211655596 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77127fc700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea8269530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77137fe700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea8269c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 -- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 msgr2=0x560ea8269c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea8269c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 -- 172.21.15.139:0/1211655596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 msgr2=0x560ea8269530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea8269530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.031 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 -- 172.21.15.139:0/1211655596 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7708009d50 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f77127fc700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea8269530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f7712ffd700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7704000c00 tx=0x7f7704009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05c3ac00cbe3c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f76f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.023+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770402f440 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f770402f5a0 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560ea817ceb0 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770402f7a0 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 10 client.16386 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560ea7fc8c60 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560ea817ceb0 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7704023920 con 0x560ea8261050 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 10 client.16386 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.032 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 10 client.16386 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 20 client.16386 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea827e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 4 client.16386 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560ea81ade10 con 0x560ea827c1b0 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.024+0000 7f77127fc700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea827e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f76f6ff5700 10 client.16386 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77127fc700 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea827e5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f40d7faf744183b4 server_cookie=9ba365319a0641a5 in_seq=0 out_seq=0 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f76f6ff5700 1 -- 172.21.15.139:0/1211655596 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560ea81ade10 con 0x560ea827c1b0 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f76f6ff5700 10 client.16386 handle_command_reply: tid=0 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 client.16386 shutdown 2023-10-08T13:29:07.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 msgr2=0x560ea826c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7704000c00 tx=0x7f7704009310 comp rx=0 tx=0).stop 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 shutdown_connections 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea827e5a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea8269c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f76f6ff5700 0 client.16386 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261050 0x560ea826c240 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.025+0000 7f77255edb80 1 --2- 172.21.15.139:0/1211655596 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261970 0x560ea8269530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.026+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 >> 172.21.15.139:0/1211655596 conn(0x560ea81d6260 msgr2=0x560ea8262f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.026+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 shutdown_connections 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.026+0000 7f77255edb80 1 -- 172.21.15.139:0/1211655596 wait complete. 2023-10-08T13:29:07.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.026+0000 7f77255edb80 20 client.16386 trim_cache size 0 max 16384 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 Processor -- start 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 -- start start 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea826ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea826c800 0x560ea825cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea8035920 con 0x560ea8261970 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea825e7f0 con 0x560ea826c800 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77255edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea826a4b0 con 0x560ea8261050 2023-10-08T13:29:07.042 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77127fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea826ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77127fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41648/0 (socket says 172.21.15.139:41648) 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77127fc700 1 -- 172.21.15.139:0/533097833 learned_addr learned my addr 172.21.15.139:0/533097833 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f7712ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea826ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41362/0 (socket says 172.21.15.139:41362) 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.039+0000 7f77137fe700 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea826c800 0x560ea825cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 -- 172.21.15.139:0/533097833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 msgr2=0x560ea826ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea826ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 -- 172.21.15.139:0/533097833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea826c800 msgr2=0x560ea825cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea826c800 0x560ea825cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 -- 172.21.15.139:0/533097833 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560ea8006250 con 0x560ea8261970 2023-10-08T13:29:07.043 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f77127fc700 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f770801b040 tx=0x7f77080058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f9ed193c950ebe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f76f9ffb700 1 -- 172.21.15.139:0/533097833 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708029070 con 0x560ea8261970 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f76f9ffb700 1 -- 172.21.15.139:0/533097833 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7708005c80 con 0x560ea8261970 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.040+0000 7f76f9ffb700 1 -- 172.21.15.139:0/533097833 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770802aca0 con 0x560ea8261970 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- 172.21.15.139:0/533097833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 msgr2=0x560ea82732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f770801b040 tx=0x7f77080058e0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- 172.21.15.139:0/533097833 shutdown_connections 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea826c800 0x560ea825cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea8261050 0x560ea826ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- 172.21.15.139:0/533097833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea82732f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- 172.21.15.139:0/533097833 >> 172.21.15.139:0/533097833 conn(0x560ea81d6260 msgr2=0x560ea8264800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- 172.21.15.139:0/533097833 shutdown_connections 2023-10-08T13:29:07.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- 172.21.15.139:0/533097833 wait complete. 2023-10-08T13:29:07.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- start start 2023-10-08T13:29:07.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 Processor -- start 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261050 0x560ea8272d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea82713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea8271aa0 con 0x560ea8261970 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea8271c10 con 0x560ea8261050 2023-10-08T13:29:07.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560ea8271dd0 con 0x560ea826c800 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77255edb80 10 client.0 _ll_register_callbacks cb 0x7f770400bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77127fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77127fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41654/0 (socket says 172.21.15.139:41654) 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.041+0000 7f77127fc700 1 -- 172.21.15.139:0/3599164392 learned_addr learned my addr 172.21.15.139:0/3599164392 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77137fe700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea82713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261050 0x560ea8272d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 -- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 msgr2=0x560ea82713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea82713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 -- 172.21.15.139:0/3599164392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261050 msgr2=0x560ea8272d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261050 0x560ea8272d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 -- 172.21.15.139:0/3599164392 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560ea7fdfde0 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77137fe700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea82713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77127fc700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7708009340 tx=0x7f77080053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d9a907bc6dc3a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f76f6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708029040 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f770802a920 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7708004390 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f770802ab20 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77255edb80 10 client.16392 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x560ea7fde2b0 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.042+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7708004390 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f7708011620 con 0x560ea8261970 2023-10-08T13:29:07.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 10 client.16392 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 10 client.16392 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 20 client.16392 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea82d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 4 client.16392 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560ea81adb30 con 0x560ea827c1b0 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea82d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f76f6ff5700 10 client.16392 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f7712ffd700 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea82d2f60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b3b2e536fd042c6a server_cookie=54591e05fc211cda in_seq=0 out_seq=0 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f76f6ff5700 1 -- 172.21.15.139:0/3599164392 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560ea81adb30 con 0x560ea827c1b0 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f76f6ff5700 10 client.16392 handle_command_reply: tid=0 2023-10-08T13:29:07.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 client.16392 shutdown 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 msgr2=0x560ea8273260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7708009340 tx=0x7f77080053a0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 shutdown_connections 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x560ea827c1b0 0x560ea82d2f60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560ea826c800 0x560ea82713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f76f6ff5700 0 client.16392 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.043+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560ea8261050 0x560ea8272d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f77255edb80 1 --2- 172.21.15.139:0/3599164392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560ea8261970 0x560ea8273260 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 >> 172.21.15.139:0/3599164392 conn(0x560ea81d6260 msgr2=0x560ea82563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 shutdown_connections 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f77255edb80 1 -- 172.21.15.139:0/3599164392 wait complete. 2023-10-08T13:29:07.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f77255edb80 20 client.16392 trim_cache size 0 max 16384 2023-10-08T13:29:07.053 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:29:07.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 msgr2=0x7f76fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 0x7f76fc0a3ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7704009990 tx=0x7f7704019040 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 msgr2=0x7f7714073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f770c00ef30 tx=0x7f770c00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 shutdown_connections 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f76fc0a15f0 0x7f76fc0a3ab0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7714106640 0x7f7714073570 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7714100580 0x7f7714072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 --2- 172.21.15.139:0/3488724474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7714100f40 0x7f7714073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 >> 172.21.15.139:0/3488724474 conn(0x7f77140fc090 msgr2=0x7f77140fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 shutdown_connections 2023-10-08T13:29:07.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.044+0000 7f7713fff700 1 -- 172.21.15.139:0/3488724474 wait complete. 2023-10-08T13:29:07.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T13:29:07.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2937352339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- 172.21.15.139:0/2059990097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc1056b0 msgr2=0x7f66dc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 --2- 172.21.15.139:0/2059990097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc1056b0 0x7f66dc105a90 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009990 tx=0x7f66d8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- 172.21.15.139:0/2059990097 shutdown_connections 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 --2- 172.21.15.139:0/2059990097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 0x7f66dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 --2- 172.21.15.139:0/2059990097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc1056b0 0x7f66dc105a90 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 --2- 172.21.15.139:0/2059990097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc0ff620 0x7f66dc0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- 172.21.15.139:0/2059990097 >> 172.21.15.139:0/2059990097 conn(0x7f66dc076780 msgr2=0x7f66dc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- 172.21.15.139:0/2059990097 shutdown_connections 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- 172.21.15.139:0/2059990097 wait complete. 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 Processor -- start 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.183+0000 7f66e432c700 1 -- start start 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 0x7f66dc1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 0x7f66dc101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1a4e90 con 0x7f66dc0ff620 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1a5000 con 0x7f66dc0fffe0 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc1a51c0 con 0x7f66dc1056b0 2023-10-08T13:29:07.187 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e28c9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 0x7f66dc101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41666/0 (socket says 172.21.15.139:41666) 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 -- 172.21.15.139:0/2971662618 learned_addr learned my addr 172.21.15.139:0/2971662618 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e18c7700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 0x7f66dc1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 -- 172.21.15.139:0/2971662618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 msgr2=0x7f66dc101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 0x7f66dc101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 -- 172.21.15.139:0/2971662618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 msgr2=0x7f66dc1017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 0x7f66dc1017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 -- 172.21.15.139:0/2971662618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d80095f0 con 0x7f66dc0ff620 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e28c9700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 0x7f66dc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e20c8700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000c00 tx=0x7f66d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66d37fe700 1 -- 172.21.15.139:0/2971662618 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d801d070 con 0x7f66dc0ff620 2023-10-08T13:29:07.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc1a5440 con 0x7f66dc0ff620 2023-10-08T13:29:07.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66d37fe700 1 -- 172.21.15.139:0/2971662618 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66d8022470 con 0x7f66dc0ff620 2023-10-08T13:29:07.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66d37fe700 1 -- 172.21.15.139:0/2971662618 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8017650 con 0x7f66dc0ff620 2023-10-08T13:29:07.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.184+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc1a5920 con 0x7f66dc0ff620 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.186+0000 7f66d37fe700 1 -- 172.21.15.139:0/2971662618 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f66d80225e0 con 0x7f66dc0ff620 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.187+0000 7f66d37fe700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 0x7f66c80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.187+0000 7f66d37fe700 1 -- 172.21.15.139:0/2971662618 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f66d80ce520 con 0x7f66dc0ff620 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.187+0000 7f66e18c7700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 0x7f66c80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.187+0000 7f66e18c7700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 0x7f66c80a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66dc1029e0 tx=0x7f66cc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 Processor -- start 2023-10-08T13:29:07.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 -- start start 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 0x55b6bf427260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf432650 0x55b6bf434a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf390460 con 0x55b6bf4277a0 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf381c20 con 0x55b6bf432650 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66f0515b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf37f540 con 0x55b6bf426e80 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41676/0 (socket says 172.21.15.139:41676) 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66e18c7700 1 -- 172.21.15.139:0/4262686133 learned_addr learned my addr 172.21.15.139:0/4262686133 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.188+0000 7f66e20c8700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 0x55b6bf427260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e28c9700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf432650 0x55b6bf434a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 -- 172.21.15.139:0/4262686133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 msgr2=0x55b6bf427260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 0x55b6bf427260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 -- 172.21.15.139:0/4262686133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf432650 msgr2=0x55b6bf434a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf432650 0x55b6bf434a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 -- 172.21.15.139:0/4262686133 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6bf1a5de0 con 0x55b6bf4277a0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e20c8700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 0x55b6bf427260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66e18c7700 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f66cc011d50 tx=0x7f66cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7203b9e4dd35a864 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66d0d82700 1 -- 172.21.15.139:0/4262686133 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00eb20 con 0x55b6bf4277a0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66d0d82700 1 -- 172.21.15.139:0/4262686133 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66cc021070 con 0x55b6bf4277a0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.189+0000 7f66d0d82700 1 -- 172.21.15.139:0/4262686133 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc01cea0 con 0x55b6bf4277a0 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- 172.21.15.139:0/4262686133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 msgr2=0x55b6bf432110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f66cc011d50 tx=0x7f66cc014000 comp rx=0 tx=0).stop 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- 172.21.15.139:0/4262686133 shutdown_connections 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf432650 0x55b6bf434a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf426e80 0x55b6bf427260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 --2- 172.21.15.139:0/4262686133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf432110 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- 172.21.15.139:0/4262686133 >> 172.21.15.139:0/4262686133 conn(0x55b6bf39c260 msgr2=0x55b6bf4232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- 172.21.15.139:0/4262686133 shutdown_connections 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- 172.21.15.139:0/4262686133 wait complete. 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 -- start start 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.190+0000 7f66f0515b80 1 Processor -- start 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf431fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf37ae30 con 0x55b6bf432650 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf317710 con 0x55b6bf426e80 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf3173b0 con 0x55b6bf4277a0 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 10 client.0 _ll_register_callbacks cb 0x55b6bf174800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e28c9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e28c9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41684/0 (socket says 172.21.15.139:41684) 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e28c9700 1 -- 172.21.15.139:0/934737002 learned_addr learned my addr 172.21.15.139:0/934737002 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e20c8700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf431fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 -- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 msgr2=0x55b6bf431fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf431fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 -- 172.21.15.139:0/934737002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 msgr2=0x55b6bf42f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 -- 172.21.15.139:0/934737002 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc1a5920 con 0x55b6bf4277a0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e28c9700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66e18c7700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0117d0 tx=0x7f66cc011d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859c4b8f99da9a93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00eb20 con 0x55b6bf4277a0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f66cc00ec80 con 0x55b6bf4277a0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.191+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6bf342eb0 con 0x55b6bf4277a0 2023-10-08T13:29:07.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66cc00ee60 con 0x55b6bf4277a0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 10 client.25852 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f66cc017070 con 0x55b6bf4277a0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b6bf342eb0 con 0x55b6bf4277a0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f66cc003680 con 0x55b6bf4277a0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 10 client.25852 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 10 client.25852 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 20 client.25852 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf4420d0 0x55b6bf4444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 4 client.25852 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6bf373e10 con 0x55b6bf4420d0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66e20c8700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf4420d0 0x55b6bf4444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66c5ffb700 10 client.25852 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.192+0000 7f66e20c8700 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf4420d0 0x55b6bf4444f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea2a5abf5cb3862 server_cookie=25ad9e09bc0f3531 in_seq=0 out_seq=0 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66c5ffb700 1 -- 172.21.15.139:0/934737002 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b6bf373e10 con 0x55b6bf4420d0 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66c5ffb700 10 client.25852 handle_command_reply: tid=0 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 client.25852 shutdown 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 msgr2=0x55b6bf42f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0117d0 tx=0x7f66cc011d80 comp rx=0 tx=0).stop 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 shutdown_connections 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf4420d0 0x55b6bf4444f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf432650 0x55b6bf42f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf431fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66c5ffb700 0 client.25852 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:29:07.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 --2- 172.21.15.139:0/934737002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f2c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 >> 172.21.15.139:0/934737002 conn(0x55b6bf39c260 msgr2=0x55b6bf422ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 shutdown_connections 2023-10-08T13:29:07.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 1 -- 172.21.15.139:0/934737002 wait complete. 2023-10-08T13:29:07.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.193+0000 7f66f0515b80 20 client.25852 trim_cache size 0 max 16384 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.206+0000 7f66f0515b80 1 Processor -- start 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.206+0000 7f66f0515b80 1 -- start start 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.206+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf42eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf422c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66f0515b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf1fb920 con 0x55b6bf4277a0 2023-10-08T13:29:07.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66f0515b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf424060 con 0x55b6bf426e80 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66f0515b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf4248b0 con 0x55b6bf432650 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41690/0 (socket says 172.21.15.139:41690) 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 -- 172.21.15.139:0/3738683630 learned_addr learned my addr 172.21.15.139:0/3738683630 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e28c9700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf422c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e20c8700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf42eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 -- 172.21.15.139:0/3738683630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 msgr2=0x55b6bf422c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf422c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 -- 172.21.15.139:0/3738683630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 msgr2=0x55b6bf42eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf42eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 -- 172.21.15.139:0/3738683630 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6bf18ec60 con 0x55b6bf4277a0 2023-10-08T13:29:07.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e28c9700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf422c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66e18c7700 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f66cc004fd0 tx=0x7f66cc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b129910d7b409951 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66d1583700 1 -- 172.21.15.139:0/3738683630 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc003840 con 0x55b6bf4277a0 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66d1583700 1 -- 172.21.15.139:0/3738683630 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66cc003bb0 con 0x55b6bf4277a0 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.207+0000 7f66d1583700 1 -- 172.21.15.139:0/3738683630 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00ee60 con 0x55b6bf4277a0 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- 172.21.15.139:0/3738683630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 msgr2=0x55b6bf42f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f66cc004fd0 tx=0x7f66cc01cb90 comp rx=0 tx=0).stop 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- 172.21.15.139:0/3738683630 shutdown_connections 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf422c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf42eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 --2- 172.21.15.139:0/3738683630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf42f0e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.215 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- 172.21.15.139:0/3738683630 >> 172.21.15.139:0/3738683630 conn(0x55b6bf39c260 msgr2=0x55b6bf42a570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- 172.21.15.139:0/3738683630 shutdown_connections 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- 172.21.15.139:0/3738683630 wait complete. 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 -- start start 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.208+0000 7f66f0515b80 1 Processor -- start 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf435360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf48f3c0 con 0x55b6bf4277a0 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf48f530 con 0x55b6bf426e80 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6bf48f6f0 con 0x55b6bf432650 2023-10-08T13:29:07.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 10 client.0 _ll_register_callbacks cb 0x7f66d8005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e20c8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf435360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41414/0 (socket says 172.21.15.139:41414) 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e18c7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41696/0 (socket says 172.21.15.139:41696) 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 -- 172.21.15.139:0/1164385268 learned_addr learned my addr 172.21.15.139:0/1164385268 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 -- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 msgr2=0x55b6bf435360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf435360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 -- 172.21.15.139:0/1164385268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 msgr2=0x55b6bf4358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 -- 172.21.15.139:0/1164385268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d4009350 con 0x55b6bf432650 2023-10-08T13:29:07.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e18c7700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66e28c9700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007fb0 tx=0x7f66d400e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d85b82ff613012 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4021440 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f66d40215a0 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.209+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66cc021070 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66d4021760 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 10 client.25858 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f66cc017070 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66cc021070 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f66d4017910 con 0x55b6bf432650 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 10 client.25858 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 10 client.25858 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 20 client.25858 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf496f60 0x55b6bf499380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 4 client.25858 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b6bf373b30 con 0x55b6bf496f60 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66e20c8700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf496f60 0x55b6bf499380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66e20c8700 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf496f60 0x55b6bf499380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0aa9d1bdfba8718 server_cookie=5c53cc8491e292c0 in_seq=0 out_seq=0 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.210+0000 7f66c5ffb700 10 client.25858 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66c5ffb700 1 -- 172.21.15.139:0/1164385268 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b6bf373b30 con 0x55b6bf496f60 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66c5ffb700 10 client.25858 handle_command_reply: tid=0 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 client.25858 shutdown 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 msgr2=0x55b6bf48ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66d4007fb0 tx=0x7f66d400e4f0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 shutdown_connections 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x55b6bf496f60 0x55b6bf499380 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b6bf432650 0x55b6bf48ee80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66c5ffb700 0 client.25858 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6bf426e80 0x55b6bf435360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 --2- 172.21.15.139:0/1164385268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b6bf4277a0 0x55b6bf4358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 >> 172.21.15.139:0/1164385268 conn(0x55b6bf39c260 msgr2=0x55b6bf422b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 shutdown_connections 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 1 -- 172.21.15.139:0/1164385268 wait complete. 2023-10-08T13:29:07.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66f0515b80 20 client.25858 trim_cache size 0 max 16384 2023-10-08T13:29:07.221 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:29:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 msgr2=0x7f66c80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.221 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 0x7f66c80a3ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f66dc1029e0 tx=0x7f66cc009260 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 msgr2=0x7f66dc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000c00 tx=0x7f66d8004730 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 shutdown_connections 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f66c80a15f0 0x7f66c80a3ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66dc1056b0 0x7f66dc101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66dc0ff620 0x7f66dc1012b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 --2- 172.21.15.139:0/2971662618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66dc0fffe0 0x7f66dc1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 >> 172.21.15.139:0/2971662618 conn(0x7f66dc076780 msgr2=0x7f66dc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 shutdown_connections 2023-10-08T13:29:07.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.211+0000 7f66e432c700 1 -- 172.21.15.139:0/2971662618 wait complete. 2023-10-08T13:29:07.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T13:29:07.353 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 -- 172.21.15.139:0/2104996015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa81056b0 msgr2=0x7f8fa8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 --2- 172.21.15.139:0/2104996015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa81056b0 0x7f8fa8105a90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009990 tx=0x7f8f9c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 -- 172.21.15.139:0/2104996015 shutdown_connections 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 --2- 172.21.15.139:0/2104996015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa80fffe0 0x7f8fa810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 --2- 172.21.15.139:0/2104996015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa81056b0 0x7f8fa8105a90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 --2- 172.21.15.139:0/2104996015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80ff620 0x7f8fa80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 -- 172.21.15.139:0/2104996015 >> 172.21.15.139:0/2104996015 conn(0x7f8fa8076780 msgr2=0x7f8fa8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 -- 172.21.15.139:0/2104996015 shutdown_connections 2023-10-08T13:29:07.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.352+0000 7f8faca4c700 1 -- 172.21.15.139:0/2104996015 wait complete. 2023-10-08T13:29:07.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 Processor -- start 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 -- start start 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fffe0 0x7f8fa819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa81056b0 0x7f8fa8196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8196fc0 con 0x7f8fa80ff620 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8197130 con 0x7f8fa80fffe0 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8faca4c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81972f0 con 0x7f8fa81056b0 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41708/0 (socket says 172.21.15.139:41708) 2023-10-08T13:29:07.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.353+0000 7f8fa659c700 1 -- 172.21.15.139:0/1749631196 learned_addr learned my addr 172.21.15.139:0/1749631196 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa81056b0 0x7f8fa8196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fffe0 0x7f8fa819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 -- 172.21.15.139:0/1749631196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa81056b0 msgr2=0x7f8fa8196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa81056b0 0x7f8fa8196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 -- 172.21.15.139:0/1749631196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fffe0 msgr2=0x7f8fa819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fffe0 0x7f8fa819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 -- 172.21.15.139:0/1749631196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0095f0 con 0x7f8fa80ff620 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8fa659c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000c00 tx=0x7f8f9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8f977fe700 1 -- 172.21.15.139:0/1749631196 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c01d070 con 0x7f8fa80ff620 2023-10-08T13:29:07.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8f977fe700 1 -- 172.21.15.139:0/1749631196 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9c021410 con 0x7f8fa80ff620 2023-10-08T13:29:07.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8f977fe700 1 -- 172.21.15.139:0/1749631196 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c017650 con 0x7f8fa80ff620 2023-10-08T13:29:07.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8197570 con 0x7f8fa80ff620 2023-10-08T13:29:07.359 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.354+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa81a3820 con 0x7f8fa80ff620 2023-10-08T13:29:07.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.356+0000 7f8f977fe700 1 -- 172.21.15.139:0/1749631196 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8f9c021580 con 0x7f8fa80ff620 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.357+0000 7f8f977fe700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.357+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.357+0000 7f8f977fe700 1 -- 172.21.15.139:0/1749631196 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8f9c0ce590 con 0x7f8fa80ff620 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.357+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 0x7f8f900a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8197b20 tx=0x7f8f98009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 Processor -- start 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 -- start start 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79c62110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c64a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79bc0460 con 0x55ea79c62650 2023-10-08T13:29:07.365 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79bb1c20 con 0x55ea79c577a0 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79baf540 con 0x55ea79c56e80 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa6d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c64a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41432/0 (socket says 172.21.15.139:41432) 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 -- 172.21.15.139:0/3676663622 learned_addr learned my addr 172.21.15.139:0/3676663622 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 -- 172.21.15.139:0/3676663622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 msgr2=0x55ea79c62110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79c62110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79c62110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 -- 172.21.15.139:0/3676663622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 msgr2=0x55ea79c64a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c64a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.366 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.358+0000 7f8fa659c700 1 -- 172.21.15.139:0/3676663622 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea799d5de0 con 0x55ea79c56e80 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0cbfa0 tx=0x7f8f9c097720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa897d7846f6c175 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8f94ff9700 1 -- 172.21.15.139:0/3676663622 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c09ac20 con 0x55ea79c56e80 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8f94ff9700 1 -- 172.21.15.139:0/3676663622 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9c09b9c0 con 0x55ea79c56e80 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8f94ff9700 1 -- 172.21.15.139:0/3676663622 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0ce210 con 0x55ea79c56e80 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3676663622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 msgr2=0x55ea79c57260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.359+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0cbfa0 tx=0x7f8f9c097720 comp rx=0 tx=0).stop 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3676663622 shutdown_connections 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c64a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c56e80 0x55ea79c57260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3676663622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79c62110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3676663622 >> 172.21.15.139:0/3676663622 conn(0x55ea79bcc260 msgr2=0x55ea79c532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3676663622 shutdown_connections 2023-10-08T13:29:07.367 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3676663622 wait complete. 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- start start 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 Processor -- start 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c56e80 0x55ea79c62a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c62f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79baae30 con 0x55ea79c62650 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79b47710 con 0x55ea79c56e80 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79b473b0 con 0x55ea79c577a0 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fb8c35b80 10 client.0 _ll_register_callbacks cb 0x55ea799a4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fa6d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.368 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fa5d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c62f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fa6d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41726/0 (socket says 172.21.15.139:41726) 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.360+0000 7f8fa6d9d700 1 -- 172.21.15.139:0/3515009803 learned_addr learned my addr 172.21.15.139:0/3515009803 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c56e80 0x55ea79c62a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 -- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 msgr2=0x55ea79c62f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c62f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 -- 172.21.15.139:0/3515009803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c56e80 msgr2=0x55ea79c62a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c56e80 0x55ea79c62a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 -- 172.21.15.139:0/3515009803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa81a3820 con 0x55ea79c62650 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c62f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011f60 tx=0x7f8fa0014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eed56ee64189469 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.369 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8f8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000e040 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea79b72eb0 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8fa00090d0 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa00092b0 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fb8c35b80 10 client.16422 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ea799bec60 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.361+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ea79b72eb0 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8fa001c020 con 0x55ea79c62650 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 10 client.16422 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 10 client.16422 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:29:07.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 20 client.16422 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79c71f80 0x55ea79c743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 4 client.16422 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea79ba3e10 con 0x55ea79c71f80 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79c71f80 0x55ea79c743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8f8dffb700 10 client.16422 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.362+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79c71f80 0x55ea79c743a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f13ca8c945ebb055 server_cookie=75f69e094c2a4c7e in_seq=0 out_seq=0 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3515009803 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ea79ba3e10 con 0x55ea79c71f80 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8f8dffb700 10 client.16422 handle_command_reply: tid=0 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 client.16422 shutdown 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 msgr2=0x55ea79c6dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0011f60 tx=0x7f8fa0014600 comp rx=0 tx=0).stop 2023-10-08T13:29:07.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 shutdown_connections 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c62650 0x55ea79c6dab0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c56e80 0x55ea79c62a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79c71f80 0x55ea79c743a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3515009803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c62f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8f8dffb700 0 client.16422 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 >> 172.21.15.139:0/3515009803 conn(0x55ea79bcc260 msgr2=0x55ea79c52ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 shutdown_connections 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3515009803 wait complete. 2023-10-08T13:29:07.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.363+0000 7f8fb8c35b80 20 client.16422 trim_cache size 0 max 16384 2023-10-08T13:29:07.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 Processor -- start 2023-10-08T13:29:07.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 -- start start 2023-10-08T13:29:07.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c5cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 0x55ea79c5d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79a2b920 con 0x55ea79c56e80 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79c6e9e0 con 0x55ea79c62650 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79c6e300 con 0x55ea79c577a0 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41730/0 (socket says 172.21.15.139:41730) 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fa659c700 1 -- 172.21.15.139:0/961426938 learned_addr learned my addr 172.21.15.139:0/961426938 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.376+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c5cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.379 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 -- 172.21.15.139:0/961426938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 msgr2=0x55ea79c5cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c5cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 -- 172.21.15.139:0/961426938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 msgr2=0x55ea79c5d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 0x55ea79c5d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 0x55ea79c5d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 -- 172.21.15.139:0/961426938 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea799fc250 con 0x55ea79c56e80 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa6d9d700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 0x55ea79c5d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8fa659c700 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0cbf20 tx=0x7f8f9c021c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd057ca9129c515 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8f957fa700 1 -- 172.21.15.139:0/961426938 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c09b340 con 0x55ea79c56e80 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8f957fa700 1 -- 172.21.15.139:0/961426938 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9c009290 con 0x55ea79c56e80 2023-10-08T13:29:07.380 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.377+0000 7f8f957fa700 1 -- 172.21.15.139:0/961426938 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c021860 con 0x55ea79c56e80 2023-10-08T13:29:07.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/961426938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 msgr2=0x55ea79c67950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0cbf20 tx=0x7f8f9c021c60 comp rx=0 tx=0).stop 2023-10-08T13:29:07.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/961426938 shutdown_connections 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c62650 0x55ea79c5d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79c67950 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/961426938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c577a0 0x55ea79c5cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/961426938 >> 172.21.15.139:0/961426938 conn(0x55ea79bcc260 msgr2=0x55ea79c61160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/961426938 shutdown_connections 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/961426938 wait complete. 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 -- start start 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 Processor -- start 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79cba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.378+0000 7f8fb8c35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c62650 0x55ea79cc4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79cbab60 con 0x55ea79c56e80 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79cc5300 con 0x55ea79c577a0 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea79cc5440 con 0x55ea79c62650 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 10 client.0 _ll_register_callbacks cb 0x7f8fa00118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa5d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79cba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41736/0 (socket says 172.21.15.139:41736) 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa6d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c62650 0x55ea79cc4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 -- 172.21.15.139:0/3743630066 learned_addr learned my addr 172.21.15.139:0/3743630066 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 -- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c62650 msgr2=0x55ea79cc4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c62650 0x55ea79cc4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 -- 172.21.15.139:0/3743630066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 msgr2=0x55ea79cba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79cba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 -- 172.21.15.139:0/3743630066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea799d5de0 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fa659c700 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c097d30 tx=0x7f8f9c005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a12a99cd637868 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8f8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0a35c0 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8f9c0b3070 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f9c09b9c0 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9c09f410 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 10 client.16428 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55ea799d42b0 con 0x55ea79c56e80 2023-10-08T13:29:07.387 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.379+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f9c09b9c0 con 0x55ea79c56e80 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8f9c0b92c0 con 0x55ea79c56e80 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 10 client.16428 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 20 client.16428 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79cc6650 0x55ea79cc8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 4 client.16428 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ea79ba3b30 con 0x55ea79cc6650 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79cc6650 0x55ea79cc8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8f8dffb700 10 client.16428 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fa5d9b700 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79cc6650 0x55ea79cc8a70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3dcd4df3ec750ea server_cookie=83f244929d211cbc in_seq=0 out_seq=0 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8f8dffb700 1 -- 172.21.15.139:0/3743630066 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ea79ba3b30 con 0x55ea79cc6650 2023-10-08T13:29:07.388 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8f8dffb700 10 client.16428 handle_command_reply: tid=0 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 1 client.16428 shutdown 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 msgr2=0x55ea79cb9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.380+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c097d30 tx=0x7f8f9c005f00 comp rx=0 tx=0).stop 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 shutdown_connections 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x55ea79cc6650 0x55ea79cc8a70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea79c62650 0x55ea79cc4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8f8dffb700 0 client.16428 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea79c56e80 0x55ea79cb9d40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 --2- 172.21.15.139:0/3743630066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea79c577a0 0x55ea79cba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.389 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 >> 172.21.15.139:0/3743630066 conn(0x55ea79bcc260 msgr2=0x55ea79c5cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 shutdown_connections 2023-10-08T13:29:07.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 1 -- 172.21.15.139:0/3743630066 wait complete. 2023-10-08T13:29:07.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8fb8c35b80 20 client.16428 trim_cache size 0 max 16384 2023-10-08T13:29:07.390 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 msgr2=0x7f8f900a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 0x7f8f900a3b30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8197b20 tx=0x7f8f98009260 comp rx=0 tx=0).stop 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 msgr2=0x7f8fa819c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c000c00 tx=0x7f8f9c004730 comp rx=0 tx=0).stop 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 shutdown_connections 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8f900a1670 0x7f8f900a3b30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8fa81056b0 0x7f8fa8196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fa80ff620 0x7f8fa819c830 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 --2- 172.21.15.139:0/1749631196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fa80fffe0 0x7f8fa819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 >> 172.21.15.139:0/1749631196 conn(0x7f8fa8076780 msgr2=0x7f8fa80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 shutdown_connections 2023-10-08T13:29:07.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.381+0000 7f8faca4c700 1 -- 172.21.15.139:0/1749631196 wait complete. 2023-10-08T13:29:07.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:29:07.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 -- 172.21.15.139:0/474791089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 msgr2=0x7f2ba010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/474791089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba010c4e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2b9000b0a0 tx=0x7f2b9000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 -- 172.21.15.139:0/474791089 shutdown_connections 2023-10-08T13:29:07.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/474791089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba010c4e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/474791089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 0x7f2ba0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/474791089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 0x7f2ba00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 -- 172.21.15.139:0/474791089 >> 172.21.15.139:0/474791089 conn(0x7f2ba0076780 msgr2=0x7f2ba0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 -- 172.21.15.139:0/474791089 shutdown_connections 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 -- 172.21.15.139:0/474791089 wait complete. 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.522+0000 7f2ba53f8700 1 Processor -- start 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 -- start start 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 0x7f2ba0197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 0x7f2ba01a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0198720 con 0x7f2ba00fffe0 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01a2ee0 con 0x7f2ba01056b0 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2ba53f8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01a3020 con 0x7f2ba00ff620 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 0x7f2ba0197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41752/0 (socket says 172.21.15.139:41752) 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/2149951303 learned_addr learned my addr 172.21.15.139:0/2149951303 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 0x7f2ba01a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/2149951303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 msgr2=0x7f2ba0197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 0x7f2ba0197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/2149951303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 msgr2=0x7f2ba01a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 0x7f2ba01a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.527 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/2149951303 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009d00 con 0x7f2ba00fffe0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400e9a0 tx=0x7f2b9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.523+0000 7f2b87fff700 1 -- 172.21.15.139:0/2149951303 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94009790 con 0x7f2ba00fffe0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.524+0000 7f2b87fff700 1 -- 172.21.15.139:0/2149951303 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b94010430 con 0x7f2ba00fffe0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.524+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba01a32a0 con 0x7f2ba00fffe0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.524+0000 7f2b87fff700 1 -- 172.21.15.139:0/2149951303 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94018680 con 0x7f2ba00fffe0 2023-10-08T13:29:07.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.524+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01a3800 con 0x7f2ba00fffe0 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.526+0000 7f2b87fff700 1 -- 172.21.15.139:0/2149951303 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f2b940105a0 con 0x7f2ba00fffe0 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.526+0000 7f2b87fff700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 0x7f2b880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.526+0000 7f2b87fff700 1 -- 172.21.15.139:0/2149951303 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2b94014070 con 0x7f2ba00fffe0 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.526+0000 7f2b9effd700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 0x7f2b880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2b9effd700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 0x7f2b880a3b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0077ab0 tx=0x7f2b98007400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 Processor -- start 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 -- start start 2023-10-08T13:29:07.534 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b981260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b98c650 0x56065b98ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.527+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b8ea460 con 0x56065b9817a0 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b8dbc20 con 0x56065b980e80 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b8d9540 con 0x56065b98c650 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41760/0 (socket says 172.21.15.139:41760) 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/3279591014 learned_addr learned my addr 172.21.15.139:0/3279591014 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b98c650 0x56065b98ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9effd700 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b981260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/3279591014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b98c650 msgr2=0x56065b98ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.535 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b98c650 0x56065b98ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/3279591014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 msgr2=0x56065b981260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b981260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 -- 172.21.15.139:0/3279591014 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56065b6ffde0 con 0x56065b9817a0 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2b940a20a0 tx=0x7f2b9409a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b5144f1dbdf747 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b857fa700 1 -- 172.21.15.139:0/3279591014 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940a25d0 con 0x56065b9817a0 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b857fa700 1 -- 172.21.15.139:0/3279591014 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b940985e0 con 0x56065b9817a0 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.528+0000 7f2b857fa700 1 -- 172.21.15.139:0/3279591014 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9409a6a0 con 0x56065b9817a0 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3279591014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 msgr2=0x56065b98c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2b940a20a0 tx=0x7f2b9409a940 comp rx=0 tx=0).stop 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3279591014 shutdown_connections 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b98c650 0x56065b98ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b981260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.536 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3279591014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b98c110 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3279591014 >> 172.21.15.139:0/3279591014 conn(0x56065b8f6260 msgr2=0x56065b97d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3279591014 shutdown_connections 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3279591014 wait complete. 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 -- start start 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.529+0000 7f2bb15e1b80 1 Processor -- start 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b989320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b989980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b8d4e30 con 0x56065b9817a0 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b871710 con 0x56065b98c650 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b8713b0 con 0x56065b980e80 2023-10-08T13:29:07.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2bb15e1b80 10 client.0 _ll_register_callbacks cb 0x56065b6ce800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b989320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41480/0 (socket says 172.21.15.139:41480) 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9effd700 1 -- 172.21.15.139:0/1003574723 learned_addr learned my addr 172.21.15.139:0/1003574723 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b989320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41766/0 (socket says 172.21.15.139:41766) 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b989980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 msgr2=0x56065b98c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/1003574723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 msgr2=0x56065b989320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b989320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/1003574723 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01a3800 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9effd700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b989980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009fd0 tx=0x7f2b9000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62b5816d69f0a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.530+0000 7f2b82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000e040 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56065b89ceb0 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2b90003e10 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b900074e0 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 10 client.25886 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56065b6e8c60 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56065b89ceb0 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2b90023020 con 0x56065b98c650 2023-10-08T13:29:07.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 10 client.25886 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 10 client.25886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 20 client.25886 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b99c220 0x56065b99e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 4 client.25886 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56065b8cde10 con 0x56065b99c220 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.531+0000 7f2b9effd700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b99c220 0x56065b99e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.532+0000 7f2b82ff5700 10 client.25886 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:07.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.532+0000 7f2b9effd700 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b99c220 0x56065b99e640 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1b5ce6ea757c78 server_cookie=7adf89e6e830d80e in_seq=0 out_seq=0 2023-10-08T13:29:07.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.533+0000 7f2b82ff5700 1 -- 172.21.15.139:0/1003574723 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56065b8cde10 con 0x56065b99c220 2023-10-08T13:29:07.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.533+0000 7f2b82ff5700 10 client.25886 handle_command_reply: tid=0 2023-10-08T13:29:07.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.533+0000 7f2bb15e1b80 1 client.25886 shutdown 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 msgr2=0x56065b989980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b989980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009fd0 tx=0x7f2b9000be20 comp rx=0 tx=0).stop 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 shutdown_connections 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b99c220 0x56065b99e640 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b989980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2b82ff5700 0 client.25886 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b980e80 0x56065b98c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/1003574723 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b9817a0 0x56065b989320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 >> 172.21.15.139:0/1003574723 conn(0x56065b8f6260 msgr2=0x56065b97cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.542 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 shutdown_connections 2023-10-08T13:29:07.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/1003574723 wait complete. 2023-10-08T13:29:07.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.534+0000 7f2bb15e1b80 20 client.25886 trim_cache size 0 max 16384 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.546+0000 7f2bb15e1b80 1 Processor -- start 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.546+0000 7f2bb15e1b80 1 -- start start 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.546+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b989870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b987bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b755920 con 0x56065b98c650 2023-10-08T13:29:07.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b9820d0 con 0x56065b980e80 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b979ae0 con 0x56065b9817a0 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41776/0 (socket says 172.21.15.139:41776) 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/3500331714 learned_addr learned my addr 172.21.15.139:0/3500331714 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b987bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9effd700 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b989870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/3500331714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 msgr2=0x56065b987bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b987bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/3500331714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 msgr2=0x56065b989870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b989870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 -- 172.21.15.139:0/3500331714 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56065b726250 con 0x56065b98c650 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2b90002230 tx=0x7f2b90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df76c54e5f4fa9e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b85ffb700 1 -- 172.21.15.139:0/3500331714 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000e040 con 0x56065b98c650 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b85ffb700 1 -- 172.21.15.139:0/3500331714 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b90007960 con 0x56065b98c650 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.547+0000 7f2b85ffb700 1 -- 172.21.15.139:0/3500331714 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9001d6b0 con 0x56065b98c650 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3500331714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 msgr2=0x56065b988130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2b90002230 tx=0x7f2b90009780 comp rx=0 tx=0).stop 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3500331714 shutdown_connections 2023-10-08T13:29:07.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b98c650 0x56065b988130 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b980e80 0x56065b989870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/3500331714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b987bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3500331714 >> 172.21.15.139:0/3500331714 conn(0x56065b8f6260 msgr2=0x56065b984650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3500331714 shutdown_connections 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/3500331714 wait complete. 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 -- start start 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.548+0000 7f2bb15e1b80 1 Processor -- start 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b9eda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b9e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b9e7fe0 con 0x56065b980e80 2023-10-08T13:29:07.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b9e8150 con 0x56065b98c650 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56065b9e8310 con 0x56065b9817a0 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 10 client.0 _ll_register_callbacks cb 0x56065b6ce800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41778/0 (socket says 172.21.15.139:41778) 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 -- 172.21.15.139:0/2651722165 learned_addr learned my addr 172.21.15.139:0/2651722165 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b9eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9f7fe700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b9e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 -- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 msgr2=0x56065b9eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b9eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 -- 172.21.15.139:0/2651722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 msgr2=0x56065b9e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b9e7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 -- 172.21.15.139:0/2651722165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56065b6e8c60 con 0x56065b980e80 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b9effd700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x56065b99eee0 tx=0x7f2b980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d670cdf5b7b747 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980285c0 con 0x56065b980e80 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2b98017040 con 0x56065b980e80 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b940985e0 con 0x56065b980e80 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b98004550 con 0x56065b980e80 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 10 client.16446 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:07.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.549+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x56065b6fe2b0 con 0x56065b980e80 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b940985e0 con 0x56065b980e80 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2b98003be0 con 0x56065b980e80 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 10 client.16446 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 20 client.16446 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b9f55e0 0x56065b9f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 4 client.16446 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56065b8cdb30 con 0x56065b9f55e0 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b9f55e0 0x56065b9f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2b82ff5700 10 client.16446 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:07.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.550+0000 7f2b9e7fc700 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b9f55e0 0x56065b9f7a00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9981483b878e9d8 server_cookie=1ae741e01d8f49a5 in_seq=0 out_seq=0 2023-10-08T13:29:07.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2b82ff5700 1 -- 172.21.15.139:0/2651722165 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56065b8cdb30 con 0x56065b9f55e0 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2b82ff5700 10 client.16446 handle_command_reply: tid=0 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 client.16446 shutdown 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 msgr2=0x56065b9ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x56065b99eee0 tx=0x7f2b980047c0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 shutdown_connections 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56065b9f55e0 0x56065b9f7a00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56065b98c650 0x56065b9e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56065b980e80 0x56065b9ed550 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 --2- 172.21.15.139:0/2651722165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56065b9817a0 0x56065b9eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2b82ff5700 0 client.16446 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:07.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 >> 172.21.15.139:0/2651722165 conn(0x56065b8f6260 msgr2=0x56065b987bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 shutdown_connections 2023-10-08T13:29:07.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 1 -- 172.21.15.139:0/2651722165 wait complete. 2023-10-08T13:29:07.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2bb15e1b80 20 client.16446 trim_cache size 0 max 16384 2023-10-08T13:29:07.561 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 msgr2=0x7f2b880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 0x7f2b880a3b30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0077ab0 tx=0x7f2b98007400 comp rx=0 tx=0).stop 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.552+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 msgr2=0x7f2ba0197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400e9a0 tx=0x7f2b9400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 shutdown_connections 2023-10-08T13:29:07.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2b880a1670 0x7f2b880a3b30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ba01056b0 0x7f2ba01a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ba00ff620 0x7f2ba0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 --2- 172.21.15.139:0/2149951303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ba00fffe0 0x7f2ba0197e60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 >> 172.21.15.139:0/2149951303 conn(0x7f2ba0076780 msgr2=0x7f2ba00fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 shutdown_connections 2023-10-08T13:29:07.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:07.553+0000 7f2ba53f8700 1 -- 172.21.15.139:0/2149951303 wait complete. 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr:state without impacting any branches by switching back to a branch. 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.746 INFO:tasks.workunit.client.0.smithi139.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: git switch -c 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr:Or undo this operation with: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: git switch - 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-08T13:29:07.747 INFO:tasks.workunit.client.0.smithi139.stderr: 2023-10-08T13:29:07.748 INFO:tasks.workunit.client.0.smithi139.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2023-10-08T13:29:07.753 INFO:tasks.workunit.client.0.smithi139.stderr:+ make -j4 2023-10-08T13:29:07.761 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize -cfi 2023-10-08T13:29:07.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:07 smithi187 ceph-mon[104336]: pgmap v348: 129 pgs: 129 active+clean; 40 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 621 op/s 2023-10-08T13:29:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:07 smithi155 ceph-mon[103467]: pgmap v348: 129 pgs: 129 active+clean; 40 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 621 op/s 2023-10-08T13:29:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:07 smithi139 ceph-mon[99506]: pgmap v348: 129 pgs: 129 active+clean; 40 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 621 op/s 2023-10-08T13:29:08.269 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-08T13:29:08.269 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file './config.guess' 2023-10-08T13:29:08.273 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file './config.sub' 2023-10-08T13:29:08.278 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file './install-sh' 2023-10-08T13:29:08.283 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file './ltmain.sh' 2023-10-08T13:29:08.313 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-08T13:29:08.313 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-08T13:29:08.328 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-08T13:29:08.338 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-08T13:29:08.349 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-08T13:29:08.359 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-08T13:29:08.365 INFO:tasks.workunit.client.0.smithi139.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-08T13:29:08.366 INFO:tasks.workunit.client.0.smithi139.stdout:cp include/install-sh . 2023-10-08T13:29:08.372 INFO:tasks.workunit.client.0.smithi139.stdout:aclocal -I m4 2023-10-08T13:29:08.567 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T13:29:08.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- 172.21.15.139:0/193377965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 msgr2=0x7f728410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- 172.21.15.139:0/193377965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f728410d5f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f727c00b0a0 tx=0x7f727c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- 172.21.15.139:0/193377965 shutdown_connections 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- 172.21.15.139:0/193377965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f728410d5f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- 172.21.15.139:0/193377965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284106730 0x7f7284106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- 172.21.15.139:0/193377965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284100720 0x7f7284100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.699 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- 172.21.15.139:0/193377965 >> 172.21.15.139:0/193377965 conn(0x7f72840fc230 msgr2=0x7f72840fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- 172.21.15.139:0/193377965 shutdown_connections 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- 172.21.15.139:0/193377965 wait complete. 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 Processor -- start 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- start start 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 0x7f7284072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 0x7f7284073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.696+0000 7f728b688700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841a4f60 con 0x7f72841010e0 2023-10-08T13:29:08.700 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f728b688700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841a50d0 con 0x7f7284106730 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f728b688700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72841a5290 con 0x7f7284100720 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41794/0 (socket says 172.21.15.139:41794) 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 -- 172.21.15.139:0/2084713454 learned_addr learned my addr 172.21.15.139:0/2084713454 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7289c25700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 0x7f7284073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7289424700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 0x7f7284072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 -- 172.21.15.139:0/2084713454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 msgr2=0x7f7284072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 0x7f7284072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.701 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 -- 172.21.15.139:0/2084713454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 msgr2=0x7f7284073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 0x7f7284073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 -- 172.21.15.139:0/2084713454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c009d00 con 0x7f72841010e0 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7289c25700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 0x7f7284073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7289424700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 0x7f7284072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f7288c23700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f727400e9a0 tx=0x7f727400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f727a7fc700 1 -- 172.21.15.139:0/2084713454 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274009790 con 0x7f72841010e0 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f727a7fc700 1 -- 172.21.15.139:0/2084713454 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f727400cbd0 con 0x7f72841010e0 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f727a7fc700 1 -- 172.21.15.139:0/2084713454 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274018680 con 0x7f72841010e0 2023-10-08T13:29:08.702 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72841a5570 con 0x7f72841010e0 2023-10-08T13:29:08.703 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.697+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72841a5a80 con 0x7f72841010e0 2023-10-08T13:29:08.709 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.699+0000 7f727a7fc700 1 -- 172.21.15.139:0/2084713454 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f727400cd40 con 0x7f72841010e0 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.700+0000 7f727a7fc700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 0x7f72700a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.700+0000 7f727a7fc700 1 -- 172.21.15.139:0/2084713454 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7274014070 con 0x7f72841010e0 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.700+0000 7f7289424700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 0x7f72700a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7289424700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 0x7f72700a3b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7280009c90 tx=0x7f7280009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 Processor -- start 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 -- start start 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f7c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f87190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10ee54e0 con 0x558b10f876d0 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10ed6ca0 con 0x558b10f7c820 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7297871b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10ed45c0 con 0x558b10f7bf00 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7289c25700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7289c25700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41804/0 (socket says 172.21.15.139:41804) 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.701+0000 7f7289c25700 1 -- 172.21.15.139:0/3559607728 learned_addr learned my addr 172.21.15.139:0/3559607728 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7288c23700 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f87190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289424700 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f7c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 -- 172.21.15.139:0/3559607728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 msgr2=0x558b10f7c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f7c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 -- 172.21.15.139:0/3559607728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 msgr2=0x558b10f87190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f87190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 -- 172.21.15.139:0/3559607728 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b10cfae60 con 0x558b10f876d0 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f7289c25700 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f727c015000 tx=0x7f727c0094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a5ba64e64c04a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f726f7fe700 1 -- 172.21.15.139:0/3559607728 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c00e050 con 0x558b10f876d0 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f726f7fe700 1 -- 172.21.15.139:0/3559607728 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f727c007e80 con 0x558b10f876d0 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.702+0000 7f726f7fe700 1 -- 172.21.15.139:0/3559607728 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c007900 con 0x558b10f876d0 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- 172.21.15.139:0/3559607728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 msgr2=0x558b10f89ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f727c015000 tx=0x7f727c0094d0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- 172.21.15.139:0/3559607728 shutdown_connections 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f89ac0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f7c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 --2- 172.21.15.139:0/3559607728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f87190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- 172.21.15.139:0/3559607728 >> 172.21.15.139:0/3559607728 conn(0x558b10ef12e0 msgr2=0x558b10f78350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- 172.21.15.139:0/3559607728 shutdown_connections 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- 172.21.15.139:0/3559607728 wait complete. 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 -- start start 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.703+0000 7f7297871b80 1 Processor -- start 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f87040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.713 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f84330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10ecfeb0 con 0x558b10f876d0 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10e6c790 con 0x558b10f7c820 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10e6c430 con 0x558b10f7bf00 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 10 client.0 _ll_register_callbacks cb 0x558b10cc9880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41810/0 (socket says 172.21.15.139:41810) 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 -- 172.21.15.139:0/340435480 learned_addr learned my addr 172.21.15.139:0/340435480 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.714 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7288c23700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f84330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289424700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f87040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 -- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 msgr2=0x558b10f87040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f87040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 -- 172.21.15.139:0/340435480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 msgr2=0x558b10f84330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f84330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 -- 172.21.15.139:0/340435480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728410def0 con 0x558b10f876d0 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7289c25700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f727c009bb0 tx=0x7f727c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3519c09a870175ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f726cff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:08.715 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c007580 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b10ec8e90 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.704+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f727c0076e0 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f727c0078a0 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 10 client.16458 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x558b10ce3ce0 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b10ec8e90 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f727c00b0d0 con 0x558b10f876d0 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 10 client.16458 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:08.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 20 client.16458 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10f96d40 0x558b10f99160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 4 client.16458 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b10ec8bb0 con 0x558b10f96d40 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.705+0000 7f7289424700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10f96d40 0x558b10f99160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.706+0000 7f726cff9700 10 client.16458 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.706+0000 7f7289424700 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10f96d40 0x558b10f99160 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=102ba74c033a9235 server_cookie=ba751010cd12245d in_seq=0 out_seq=0 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.706+0000 7f726cff9700 1 -- 172.21.15.139:0/340435480 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b10ec8bb0 con 0x558b10f96d40 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.706+0000 7f726cff9700 10 client.16458 handle_command_reply: tid=0 2023-10-08T13:29:08.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.706+0000 7f7297871b80 1 client.16458 shutdown 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 msgr2=0x558b10f84960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f727c009bb0 tx=0x7f727c004d00 comp rx=0 tx=0).stop 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 shutdown_connections 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f876d0 0x558b10f84960 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7bf00 0x558b10f87040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10f96d40 0x558b10f99160 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 --2- 172.21.15.139:0/340435480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f7c820 0x558b10f84330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f726cff9700 0 client.16458 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 >> 172.21.15.139:0/340435480 conn(0x558b10ef12e0 msgr2=0x558b10f77f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 shutdown_connections 2023-10-08T13:29:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 1 -- 172.21.15.139:0/340435480 wait complete. 2023-10-08T13:29:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.707+0000 7f7297871b80 20 client.16458 trim_cache size 0 max 16384 2023-10-08T13:29:08.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.724+0000 7f7297871b80 1 Processor -- start 2023-10-08T13:29:08.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.724+0000 7f7297871b80 1 -- start start 2023-10-08T13:29:08.726 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.724+0000 7f7297871b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.724+0000 7f7297871b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f84880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.724+0000 7f7297871b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10f93020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7297871b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10d509a0 con 0x558b10f7bf00 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7297871b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10f7d150 con 0x558b10f876d0 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7297871b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10f72620 con 0x558b10f7c820 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41814/0 (socket says 172.21.15.139:41814) 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 -- 172.21.15.139:0/39489771 learned_addr learned my addr 172.21.15.139:0/39489771 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7288c23700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f84880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289c25700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10f93020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 -- 172.21.15.139:0/39489771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 msgr2=0x558b10f84880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.727 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f84880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 -- 172.21.15.139:0/39489771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 msgr2=0x558b10f93020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10f93020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 -- 172.21.15.139:0/39489771 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b10d212d0 con 0x558b10f7bf00 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7288c23700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f84880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289c25700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10f93020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.725+0000 7f7289424700 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7280009b50 tx=0x7f7280013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be7430b6828a219 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.727+0000 7f726ffff700 1 -- 172.21.15.139:0/39489771 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280024070 con 0x558b10f7bf00 2023-10-08T13:29:08.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.727+0000 7f726ffff700 1 -- 172.21.15.139:0/39489771 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7280015070 con 0x558b10f7bf00 2023-10-08T13:29:08.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.727+0000 7f726ffff700 1 -- 172.21.15.139:0/39489771 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728001e420 con 0x558b10f7bf00 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.727+0000 7f7297871b80 1 -- 172.21.15.139:0/39489771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 msgr2=0x558b10f7edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.727+0000 7f7297871b80 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7280009b50 tx=0x7f7280013000 comp rx=0 tx=0).stop 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- 172.21.15.139:0/39489771 shutdown_connections 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10f93020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f7edf0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- 172.21.15.139:0/39489771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f84880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- 172.21.15.139:0/39489771 >> 172.21.15.139:0/39489771 conn(0x558b10ef12e0 msgr2=0x558b10f92910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- 172.21.15.139:0/39489771 shutdown_connections 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- 172.21.15.139:0/39489771 wait complete. 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- start start 2023-10-08T13:29:08.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 Processor -- start 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f8d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10feab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10f8d9e0 con 0x558b10f7bf00 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10f8db20 con 0x558b10f876d0 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b10feb0c0 con 0x558b10f7c820 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.728+0000 7f7297871b80 10 client.0 _ll_register_callbacks cb 0x7f7274005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41820/0 (socket says 172.21.15.139:41820) 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289c25700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10feab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7288c23700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f8d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 -- 172.21.15.139:0/2972670904 learned_addr learned my addr 172.21.15.139:0/2972670904 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 -- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 msgr2=0x558b10f8d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f8d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 -- 172.21.15.139:0/2972670904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 msgr2=0x558b10feab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10feab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 -- 172.21.15.139:0/2972670904 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72841a5a80 con 0x558b10f7bf00 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7288c23700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289c25700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10feab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7289424700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7280012e70 tx=0x7f7280012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57d40d86e67459e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f726cff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280024050 con 0x558b10f7bf00 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7280017070 con 0x558b10f7bf00 2023-10-08T13:29:08.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b10e97f30 con 0x558b10f7bf00 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7280005690 con 0x558b10f7bf00 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.729+0000 7f7297871b80 10 client.16464 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f7280011440 con 0x558b10f7bf00 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f728003d020 con 0x558b10f7bf00 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f728002f890 con 0x558b10f7bf00 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 10 client.16464 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 20 client.16464 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10feca30 0x558b10feee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 4 client.16464 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T13:29:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558b10d1bff0 con 0x558b10feca30 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.730+0000 7f7288c23700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10feca30 0x558b10feee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f726cff9700 10 client.16464 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7288c23700 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10feca30 0x558b10feee50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f894262f2a612959 server_cookie=dfef18fd14ea67f8 in_seq=0 out_seq=0 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f726cff9700 1 -- 172.21.15.139:0/2972670904 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558b10d1bff0 con 0x558b10feca30 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f726cff9700 10 client.16464 handle_command_reply: tid=0 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 client.16464 shutdown 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 msgr2=0x558b10f8ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7280012e70 tx=0x7f7280012ea0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 shutdown_connections 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558b10feca30 0x558b10feee50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558b10f876d0 0x558b10feab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.731+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558b10f7bf00 0x558b10f8ccf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f7297871b80 1 --2- 172.21.15.139:0/2972670904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558b10f7c820 0x558b10f8d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 >> 172.21.15.139:0/2972670904 conn(0x558b10ef12e0 msgr2=0x558b10f85bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f726cff9700 0 client.16464 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 shutdown_connections 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f7297871b80 1 -- 172.21.15.139:0/2972670904 wait complete. 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f7297871b80 20 client.16464 trim_cache size 0 max 16384 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: "return_code": 0, 2023-10-08T13:29:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:29:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": "asynchronous" 2023-10-08T13:29:08.741 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:29:08.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 msgr2=0x7f72700a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 0x7f72700a3b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7280009c90 tx=0x7f7280009260 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 msgr2=0x7f7284073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.732+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f727400e9a0 tx=0x7f727400ed60 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 shutdown_connections 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f72700a1670 0x7f72700a3b30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7284106730 0x7f7284073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7284100720 0x7f7284072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 --2- 172.21.15.139:0/2084713454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72841010e0 0x7f7284073030 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 >> 172.21.15.139:0/2084713454 conn(0x7f72840fc230 msgr2=0x7f72840fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 shutdown_connections 2023-10-08T13:29:08.742 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.733+0000 7f728b688700 1 -- 172.21.15.139:0/2084713454 wait complete. 2023-10-08T13:29:08.750 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:29:08.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 -- 172.21.15.139:0/2729031223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27500fffe0 msgr2=0x7f275010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 --2- 172.21.15.139:0/2729031223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27500fffe0 0x7f275010c4e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2748009f90 tx=0x7f274800b330 comp rx=0 tx=0).stop 2023-10-08T13:29:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 -- 172.21.15.139:0/2729031223 shutdown_connections 2023-10-08T13:29:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 --2- 172.21.15.139:0/2729031223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27500fffe0 0x7f275010c4e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 --2- 172.21.15.139:0/2729031223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27501056b0 0x7f2750105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 --2- 172.21.15.139:0/2729031223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500ff620 0x7f27500ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 -- 172.21.15.139:0/2729031223 >> 172.21.15.139:0/2729031223 conn(0x7f2750076780 msgr2=0x7f2750076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 -- 172.21.15.139:0/2729031223 shutdown_connections 2023-10-08T13:29:08.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.887+0000 7f275497e700 1 -- 172.21.15.139:0/2729031223 wait complete. 2023-10-08T13:29:08.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.888+0000 7f275497e700 1 Processor -- start 2023-10-08T13:29:08.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.888+0000 7f275497e700 1 -- start start 2023-10-08T13:29:08.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.888+0000 7f275497e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 0x7f2750197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.888+0000 7f275497e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500fffe0 0x7f2750197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.892 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501986f0 con 0x7f27501056b0 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501a2f00 con 0x7f27500fffe0 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501a3040 con 0x7f27500ff620 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 0x7f2750197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41838/0 (socket says 172.21.15.139:41838) 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500fffe0 0x7f2750197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274ed9d700 1 -- 172.21.15.139:0/2675728800 learned_addr learned my addr 172.21.15.139:0/2675728800 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 -- 172.21.15.139:0/2675728800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500fffe0 msgr2=0x7f2750197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500fffe0 0x7f2750197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 -- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 msgr2=0x7f27501a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 -- 172.21.15.139:0/2675728800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009c40 con 0x7f27500ff620 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274ed9d700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f274e59c700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 0x7f2750197940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f274000e9c0 tx=0x7f274000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f273f7fe700 1 -- 172.21.15.139:0/2675728800 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740004220 con 0x7f27500ff620 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27501a32d0 con 0x7f27500ff620 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f273f7fe700 1 -- 172.21.15.139:0/2675728800 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2740004380 con 0x7f27500ff620 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f273f7fe700 1 -- 172.21.15.139:0/2675728800 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740003bb0 con 0x7f27500ff620 2023-10-08T13:29:08.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.889+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27501a3830 con 0x7f27500ff620 2023-10-08T13:29:08.902 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.892+0000 7f273f7fe700 1 -- 172.21.15.139:0/2675728800 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f274000c7c0 con 0x7f27500ff620 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.892+0000 7f273f7fe700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 0x7f27380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.892+0000 7f273f7fe700 1 -- 172.21.15.139:0/2675728800 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2740014070 con 0x7f27500ff620 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.892+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 0x7f27380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 0x7f27380a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2750068040 tx=0x7f2744009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 Processor -- start 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 -- start start 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afcf6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afd01650 0x55b5afd03a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afc5f460 con 0x55b5afcf5e80 2023-10-08T13:29:08.903 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afc50c20 con 0x55b5afcf67a0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.893+0000 7f2760b67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afc4e540 con 0x55b5afd01650 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afcf6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60364/0 (socket says 172.21.15.139:60364) 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 -- 172.21.15.139:0/4136628108 learned_addr learned my addr 172.21.15.139:0/4136628108 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afd01650 0x55b5afd03a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 -- 172.21.15.139:0/4136628108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afd01650 msgr2=0x55b5afd03a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afd01650 0x55b5afd03a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 -- 172.21.15.139:0/4136628108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 msgr2=0x55b5afcf6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afcf6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 -- 172.21.15.139:0/4136628108 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5afa74de0 con 0x55b5afcf67a0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f274dd9b700 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2744004200 tx=0x7f2744014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d3273e4a1f5b03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f273cff9700 1 -- 172.21.15.139:0/4136628108 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744009e60 con 0x55b5afcf67a0 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f273cff9700 1 -- 172.21.15.139:0/4136628108 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2744004830 con 0x55b5afcf67a0 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.894+0000 7f273cff9700 1 -- 172.21.15.139:0/4136628108 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440055a0 con 0x55b5afcf67a0 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- 172.21.15.139:0/4136628108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 msgr2=0x55b5afd01110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2744004200 tx=0x7f2744014000 comp rx=0 tx=0).stop 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- 172.21.15.139:0/4136628108 shutdown_connections 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afd01650 0x55b5afd03a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afcf6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 --2- 172.21.15.139:0/4136628108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afd01110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- 172.21.15.139:0/4136628108 >> 172.21.15.139:0/4136628108 conn(0x55b5afc6b260 msgr2=0x55b5afcf22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- 172.21.15.139:0/4136628108 shutdown_connections 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- 172.21.15.139:0/4136628108 wait complete. 2023-10-08T13:29:08.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.895+0000 7f2760b67b80 1 -- start start 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 Processor -- start 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afd00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afcfe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 0x55b5afcfe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afc49e30 con 0x55b5afd01650 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afbe6710 con 0x55b5afcf67a0 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afbe63b0 con 0x55b5afcf5e80 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2760b67b80 10 client.0 _ll_register_callbacks cb 0x55b5afa43800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:08.906 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afd00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 0x55b5afcfe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afcfe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afd00fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41564/0 (socket says 172.21.15.139:41564) 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274e59c700 1 -- 172.21.15.139:0/170842503 learned_addr learned my addr 172.21.15.139:0/170842503 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 -- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 msgr2=0x55b5afd00fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afd00fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 -- 172.21.15.139:0/170842503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 msgr2=0x55b5afcfe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afcfe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 -- 172.21.15.139:0/170842503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2744017070 con 0x55b5afd01650 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f274ed9d700 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 0x55b5afcfe880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2748009c10 tx=0x7f2748003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468f2f41aa937c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.896+0000 7f2735ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:08.907 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800e040 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f2748003e10 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5afc11eb0 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274800bbf0 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 10 client.16476 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b5afa5dc60 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b5afc11eb0 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2748019070 con 0x55b5afd01650 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 10 client.16476 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 20 client.16476 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:08.908 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd11170 0x55b5afd13590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 4 client.16476 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5afc42e10 con 0x55b5afd11170 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.897+0000 7f274e59c700 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd11170 0x55b5afd13590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.898+0000 7f274e59c700 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd11170 0x55b5afd13590 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33b6293329effe server_cookie=f0780a14efdf71de in_seq=0 out_seq=0 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.898+0000 7f2735ffb700 10 client.16476 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2735ffb700 1 -- 172.21.15.139:0/170842503 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b5afc42e10 con 0x55b5afd11170 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2735ffb700 10 client.16476 handle_command_reply: tid=0 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 client.16476 shutdown 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 msgr2=0x55b5afcfe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.909 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 0x55b5afcfe880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2748009c10 tx=0x7f2748003ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 shutdown_connections 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afd01650 0x55b5afcfe880 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afd00fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd11170 0x55b5afd13590 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 --2- 172.21.15.139:0/170842503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afcf67a0 0x55b5afcfe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2735ffb700 0 client.16476 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 >> 172.21.15.139:0/170842503 conn(0x55b5afc6b260 msgr2=0x55b5afcf1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 shutdown_connections 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 1 -- 172.21.15.139:0/170842503 wait complete. 2023-10-08T13:29:08.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.899+0000 7f2760b67b80 20 client.16476 trim_cache size 0 max 16384 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 Processor -- start 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 -- start start 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afcfe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afcfd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afaca920 con 0x55b5afcf67a0 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afcfd5f0 con 0x55b5afd01650 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f2760b67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afcf3060 con 0x55b5afcf5e80 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41858/0 (socket says 172.21.15.139:41858) 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 -- 172.21.15.139:0/2174778785 learned_addr learned my addr 172.21.15.139:0/2174778785 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274e59c700 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afcfe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274ed9d700 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afcfd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 -- 172.21.15.139:0/2174778785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 msgr2=0x55b5afcfe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afcfe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 -- 172.21.15.139:0/2174778785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 msgr2=0x55b5afcfd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afcfd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 -- 172.21.15.139:0/2174778785 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5afd03c10 con 0x55b5afcf67a0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f27440041d0 tx=0x7f27440058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50994927bcf54dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.916+0000 7f273d7fa700 1 -- 172.21.15.139:0/2174778785 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274402c040 con 0x55b5afcf67a0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f273d7fa700 1 -- 172.21.15.139:0/2174778785 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2744009e60 con 0x55b5afcf67a0 2023-10-08T13:29:08.919 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f273d7fa700 1 -- 172.21.15.139:0/2174778785 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744005450 con 0x55b5afcf67a0 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 -- 172.21.15.139:0/2174778785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 msgr2=0x55b5afcfcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f27440041d0 tx=0x7f27440058e0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 -- 172.21.15.139:0/2174778785 shutdown_connections 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afcfd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf5e80 0x55b5afcfe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2174778785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf67a0 0x55b5afcfcb70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 -- 172.21.15.139:0/2174778785 >> 172.21.15.139:0/2174778785 conn(0x55b5afc6b260 msgr2=0x55b5afcf9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 -- 172.21.15.139:0/2174778785 shutdown_connections 2023-10-08T13:29:08.924 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.917+0000 7f2760b67b80 1 -- 172.21.15.139:0/2174778785 wait complete. 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 -- start start 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 Processor -- start 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf67a0 0x55b5afd04770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afd04cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afd053c0 con 0x55b5afcf5e80 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afd05530 con 0x55b5afd01650 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5afd64fa0 con 0x55b5afcf67a0 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f2760b67b80 10 client.0 _ll_register_callbacks cb 0x7f2748007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f274e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f274e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41862/0 (socket says 172.21.15.139:41862) 2023-10-08T13:29:08.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f274e59c700 1 -- 172.21.15.139:0/2167274781 learned_addr learned my addr 172.21.15.139:0/2167274781 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f274dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf67a0 0x55b5afd04770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.918+0000 7f274ed9d700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afd04cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 -- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf67a0 msgr2=0x55b5afd04770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf67a0 0x55b5afd04770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 -- 172.21.15.139:0/2167274781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 msgr2=0x55b5afd04cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afd04cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.926 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 -- 172.21.15.139:0/2167274781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5afa74de0 con 0x55b5afcf5e80 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f274e59c700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2740096890 tx=0x7f27400966d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efad20aadfe74bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274009e4e0 con 0x55b5afcf5e80 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f27400a2720 con 0x55b5afcf5e80 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2744004830 con 0x55b5afcf5e80 2023-10-08T13:29:08.927 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2740098730 con 0x55b5afcf5e80 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 10 client.16482 fetch_fsmap learned FSMap version 28 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55b5afa9b250 con 0x55b5afcf5e80 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2744004830 con 0x55b5afcf5e80 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f27400cd3c0 con 0x55b5afcf5e80 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 10 client.16482 fetch_fsmap finished waiting for FSMap version 28 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 20 client.16482 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd667a0 0x55b5afd68b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 4 client.16482 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.919+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b5afc42b30 con 0x55b5afd667a0 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd667a0 0x55b5afd68b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:08.928 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f274dd9b700 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd667a0 0x55b5afd68b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4379a6acc1ace1a server_cookie=5b2ef66063a7fd86 in_seq=0 out_seq=0 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2735ffb700 10 client.16482 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2735ffb700 1 -- 172.21.15.139:0/2167274781 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55b5afc42b30 con 0x55b5afd667a0 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2735ffb700 10 client.16482 handle_command_reply: tid=0 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2760b67b80 1 client.16482 shutdown 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 msgr2=0x55b5afd08200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.920+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2740096890 tx=0x7f27400966d0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 shutdown_connections 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b5afd667a0 0x55b5afd68b90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5afd01650 0x55b5afd04cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b5afcf5e80 0x55b5afd08200 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 --2- 172.21.15.139:0/2167274781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5afcf67a0 0x55b5afd04770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.929 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2735ffb700 0 client.16482 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 >> 172.21.15.139:0/2167274781 conn(0x55b5afc6b260 msgr2=0x55b5afcfcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 shutdown_connections 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 1 -- 172.21.15.139:0/2167274781 wait complete. 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f2760b67b80 20 client.16482 trim_cache size 0 max 16384 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "scrub active (1226 inodes in the stack)", 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:29:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:29:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:29:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:29:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:29:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:29:08.931 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 msgr2=0x7f27380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 0x7f27380a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2750068040 tx=0x7f2744009310 comp rx=0 tx=0).stop 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 msgr2=0x7f2750197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 0x7f2750197940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f274000e9c0 tx=0x7f274000ecd0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 shutdown_connections 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f27380a15f0 0x7f27380a3ab0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f27501056b0 0x7f27501a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27500ff620 0x7f2750197940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.932 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 --2- 172.21.15.139:0/2675728800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27500fffe0 0x7f2750197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:08.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 >> 172.21.15.139:0/2675728800 conn(0x7f2750076780 msgr2=0x7f27500fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:08.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 shutdown_connections 2023-10-08T13:29:08.933 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:08.921+0000 7f275497e700 1 -- 172.21.15.139:0/2675728800 wait complete. 2023-10-08T13:29:08.935 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:29:09.096 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.767+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out auth v596 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3f97b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000082c:[<0x100000004a7/448.out v484>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000082c:[<0x100000004a7/448.out v596>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.097 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.767+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000598 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out auth v584 ap=1 s=450 n(v0 rc2023-10-08T13:28:41.789552+0000 b450 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3f98680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000598:[<0x100000004a7/118.out v316>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000598:[<0x100000004a7/118.out v584>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.097 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.758+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003c [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/ auth v22 ap=1 f(v0 m2023-10-08T13:28:33.496765+0000 2=0+2) n(v2 rc2023-10-08T13:28:33.500765+0000 b364 6=2+4) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000003c:[<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000003c:[<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.496765+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b364 6=2+4)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.496765+0000 2=0+2)","memory_value.rstat":"n(v2 rc2023-10-08T13:28:33.500765+0000 b364 6=2+4)","error_str":""},"return_code":0} 2023-10-08T13:29:09.098 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000044 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/ auth v13 ap=1 f(v0 m2023-10-08T13:28:33.497765+0000 1=1+0) n(v0 rc2023-10-08T13:28:33.500765+0000 b182 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000044:[<0x1000000003c/heads v8>,<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000044:[<0x1000000003c/heads v13>,<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.497765+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b182 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.497765+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b182 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.098 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.767+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out auth v606 ap=1 s=44 n(v0 rc2023-10-08T13:28:42.490534+0000 b44 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3f99700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008b0:[<0x100000004a7/514.out v528>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008b0:[<0x100000004a7/514.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.098 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.767+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out auth v598 ap=1 s=51 n(v0 rc2023-10-08T13:28:41.968548+0000 b51 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fa2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066c:[<0x100000004a7/224.out v368>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000066c:[<0x100000004a7/224.out v598>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.098 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.768+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out auth v594 ap=1 s=112 n(v0 rc2023-10-08T13:28:41.955548+0000 b112 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fa3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065c:[<0x100000004a7/216.out v360>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000065c:[<0x100000004a7/216.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.099 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000043 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD auth v25 ap=1 s=182 n(v0 rc2023-10-08T13:28:33.496765+0000 b182 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25304=0-4194304@2} caps={25304=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=25304 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14f95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000043:[<0x1000000003b/HEAD v6>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000043:[<0x1000000003b/HEAD v25>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.099 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000045 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master auth v4 ap=1 s=182 n(v0 rc2023-10-08T13:28:33.500765+0000 b182 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000045:[<0x10000000044/master v2>,<0x1000000003c/heads v8>,<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000045:[<0x10000000044/master v4>,<0x1000000003c/heads v13>,<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.099 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.768+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out auth v590 ap=1 s=912 n(v0 rc2023-10-08T13:28:41.857551+0000 b912 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fa3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e8:[<0x100000004a7/158.out v336>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005e8:[<0x100000004a7/158.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.099 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.768+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ef [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs auth v612 ap=1 s=146 n(v0 rc2023-10-08T13:28:37.785655+0000 b146 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fa4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ef:[<0x100000004a7/035.out.nfs v144>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004ef:[<0x100000004a7/035.out.nfs v612>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.100 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003d [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/ auth v15 ap=1 f(v0 m2023-10-08T13:28:33.473766+0000 1=0+1) n(v1 rc2023-10-08T13:28:33.475766+0000 b182 3=1+2) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000003d:[<0x1000000003c/remotes v4>,<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000003d:[<0x1000000003c/remotes v15>,<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.473766+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.475766+0000 b182 3=1+2)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.473766+0000 1=0+1)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:33.475766+0000 b182 3=1+2)","error_str":""},"return_code":0} 2023-10-08T13:29:09.100 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003e [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/ auth v7 ap=1 f(v0 m2023-10-08T13:28:33.473766+0000 1=1+0) n(v0 rc2023-10-08T13:28:33.475766+0000 b182 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000003e:[<0x1000000003d/origin v4>,<0x1000000003c/remotes v4>,<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000003e:[<0x1000000003d/origin v7>,<0x1000000003c/remotes v15>,<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.473766+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.475766+0000 b182 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.473766+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-08T13:28:33.475766+0000 b182 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.100 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000011 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude auth v4 ap=1 s=240 n(v0 rc2023-10-08T13:28:31.475817+0000 b240 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000011:[<0x10000000010/exclude v2>,<0x1000000000d/info v8>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000011:[<0x10000000010/exclude v4>,<0x1000000000d/info v205>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.100 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.759+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD auth v4 ap=1 s=182 n(v0 rc2023-10-08T13:28:33.475766+0000 b182 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d14fc3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000003f:[<0x1000000003e/HEAD v2>,<0x1000000003d/origin v4>,<0x1000000003c/remotes v4>,<0x1000000003b/refs v8>,<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000003f:[<0x1000000003e/HEAD v4>,<0x1000000003d/origin v7>,<0x1000000003c/remotes v15>,<0x1000000003b/refs v22>,<0x1000000000d/logs v207>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.101 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.769+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out auth v656 ap=1 s=503 n(v0 rc2023-10-08T13:28:37.823654+0000 b503 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000051e:[<0x100000004a7/057.out v238>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000051e:[<0x100000004a7/057.out v656>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.101 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.774+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ea [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out auth v572 ap=1 s=496 n(v0 b496 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3ab9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ea:[<0x100000004a7/287.out v426>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006ea:[<0x100000004a7/287.out v572>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.101 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.775+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000878 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out auth v584 ap=1 s=87 n(v0 rc2023-10-08T13:28:42.425536+0000 b87 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3ab8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000878:[<0x100000004a7/486.out v530>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000878:[<0x100000004a7/486.out v584>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.101 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.775+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out auth v576 ap=1 s=287 n(v0 b287 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3aca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000079e:[<0x100000004a7/377.out v480>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000079e:[<0x100000004a7/377.out v576>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.101 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.769+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out auth v655 ap=1 s=447 n(v0 rc2023-10-08T13:28:42.231541+0000 b447 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a8:[<0x100000004a7/382.out v438>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007a8:[<0x100000004a7/382.out v655>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.102 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.770+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000828 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out auth v659 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.351538+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15544000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000828:[<0x100000004a7/446.out v482>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000828:[<0x100000004a7/446.out v659>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.102 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.775+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000792 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out auth v624 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3aca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000792:[<0x100000004a7/371.out v474>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000792:[<0x100000004a7/371.out v624>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.102 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.776+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000906 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out auth v630 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.572532+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3acb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000906:[<0x100000004a7/557.out v558>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000906:[<0x100000004a7/557.out v630>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.771+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000814 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out auth v658 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15544b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000814:[<0x100000004a7/436.out v474>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000814:[<0x100000004a7/436.out v658>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.771+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ae [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out auth v657 ap=1 s=68034 n(v0 rc2023-10-08T13:28:42.237541+0000 b68034 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15545600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ae:[<0x100000004a7/385.out v442>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007ae:[<0x100000004a7/385.out v657>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.771+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out auth v664 ap=1 s=269 n(v0 rc2023-10-08T13:28:42.207542+0000 b269 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15545b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000078c:[<0x100000004a7/368.out v428>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000078c:[<0x100000004a7/368.out v664>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.772+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out auth v604 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.367538+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15546680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000083a:[<0x100000004a7/455.out v488>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000083a:[<0x100000004a7/455.out v604>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.772+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out auth v662 ap=1 s=120 n(v0 b120 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15547180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008a6:[<0x100000004a7/509.out v524>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008a6:[<0x100000004a7/509.out v662>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.772+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000708 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out auth v598 ap=1 s=315 n(v0 rc2023-10-08T13:28:42.094545+0000 b315 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1575b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000708:[<0x100000004a7/302.out v398>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000708:[<0x100000004a7/302.out v598>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.103 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.776+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000570 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out auth v625 ap=1 s=723 n(v0 rc2023-10-08T13:28:41.755553+0000 b723 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3acb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000570:[<0x100000004a7/098.out v318>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000570:[<0x100000004a7/098.out v625>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.104 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.776+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000065a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out auth v586 ap=1 s=109 n(v0 rc2023-10-08T13:28:41.953548+0000 b109 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3acbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000065a:[<0x100000004a7/215.out v380>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000065a:[<0x100000004a7/215.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.104 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.776+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out auth v592 ap=1 s=942 n(v0 rc2023-10-08T13:28:41.836551+0000 b942 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3acd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d0:[<0x100000004a7/146.out v354>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005d0:[<0x100000004a7/146.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.104 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.772+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ce [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out auth v600 ap=1 s=58 n(v0 rc2023-10-08T13:28:42.267540+0000 b58 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1575bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ce:[<0x100000004a7/401.out v454>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007ce:[<0x100000004a7/401.out v600>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.104 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.773+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000890 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out auth v590 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.459535+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15546c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000890:[<0x100000004a7/498.out v514>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000890:[<0x100000004a7/498.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.104 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.777+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000712 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out auth v629 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.102544+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3acd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000712:[<0x100000004a7/307.out v444>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000712:[<0x100000004a7/307.out v629>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.105 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.777+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000063c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out auth v574 ap=1 s=505 n(v0 rc2023-10-08T13:28:41.928549+0000 b505 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3f96b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000063c:[<0x100000004a7/200.out v376>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000063c:[<0x100000004a7/200.out v574>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.105 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.777+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ba [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out auth v628 ap=1 s=149 n(v0 rc2023-10-08T13:28:42.032546+0000 b149 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3f97600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ba:[<0x100000004a7/263.out v412>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006ba:[<0x100000004a7/263.out v628>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.105 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.773+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out auth v618 ap=1 s=941 n(v0 rc2023-10-08T13:28:41.841551+0000 b941 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1575c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d6:[<0x100000004a7/149.out v330>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005d6:[<0x100000004a7/149.out v618>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.105 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.774+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000868 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out auth v672 ap=1 s=1695 n(v0 rc2023-10-08T13:28:42.410537+0000 b1695 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000868:[<0x100000004a7/478.out v504>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000868:[<0x100000004a7/478.out v672>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.105 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.774+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out auth v592 ap=1 s=5457 n(v0 b5457 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000051a:[<0x100000004a7/055.out v230>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000051a:[<0x100000004a7/055.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.106 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.813+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000443 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out auth v288 ap=1 s=6043 n(v0 rc2023-10-08T13:28:37.657659+0000 b6043 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fb5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000443:[<0x10000000414/022.out v94>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000443:[<0x10000000414/022.out v288>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.106 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.814+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000429 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out auth v320 ap=1 s=200 n(v0 rc2023-10-08T13:28:37.639659+0000 b200 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fb6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000429:[<0x10000000414/009.out v42>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000429:[<0x10000000414/009.out v320>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.107 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.775+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ec [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out auth v667 ap=1 s=141 n(v0 rc2023-10-08T13:28:41.860551+0000 b141 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ec:[<0x100000004a7/160.out v338>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005ec:[<0x100000004a7/160.out v667>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.107 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.775+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out auth v666 ap=1 s=318 n(v0 rc2023-10-08T13:28:42.725528+0000 b318 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d156f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000092c:[<0x100000004a7/576.out v552>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000092c:[<0x100000004a7/576.out v666>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.107 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.776+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006c4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out auth v641 ap=1 s=320 n(v0 b320 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1544db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006c4:[<0x100000004a7/268.out v412>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006c4:[<0x100000004a7/268.out v641>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.107 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.776+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out auth v643 ap=1 s=1198 n(v0 rc2023-10-08T13:28:42.227541+0000 b1198 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1544e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a4:[<0x100000004a7/380.out v470>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007a4:[<0x100000004a7/380.out v643>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.107 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.777+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000054c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out auth v578 ap=1 s=44 n(v0 rc2023-10-08T13:28:41.726554+0000 b44 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15200c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000054c:[<0x100000004a7/080.out v308>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000054c:[<0x100000004a7/080.out v578>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.108 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.814+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000423 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out auth v298 ap=1 s=89 n(v0 b89 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fb6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000423:[<0x10000000414/006.out v30>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000423:[<0x10000000414/006.out v298>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.108 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.814+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out auth v284 ap=1 s=33582 n(v0 rc2023-10-08T13:28:37.723657+0000 b33582 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3fb7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049f:[<0x10000000414/308.out v278>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000049f:[<0x10000000414/308.out v284>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.108 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.814+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out auth v308 ap=1 s=693 n(v0 b693 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b6cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000048f:[<0x10000000414/271.out v246>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000048f:[<0x10000000414/271.out v308>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.109 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.778+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ba [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out auth v600 ap=1 s=80 n(v0 rc2023-10-08T13:28:42.501534+0000 b80 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1555d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008ba:[<0x100000004a7/519.out v522>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008ba:[<0x100000004a7/519.out v600>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.109 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.779+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000930 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out auth v598 ap=1 s=1572 n(v0 rc2023-10-08T13:28:46.521431+0000 b1572 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1555e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000930:[<0x100000004a7/578.out v558>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000930:[<0x100000004a7/578.out v598>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.109 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.815+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000451 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out auth v314 ap=1 s=106 n(v0 rc2023-10-08T13:28:37.667658+0000 b106 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4204000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000451:[<0x10000000414/029.out v122>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000451:[<0x10000000414/029.out v314>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.109 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.815+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000439 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out auth v310 ap=1 s=198 n(v0 b198 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4204580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000439:[<0x10000000414/017.out v74>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000439:[<0x10000000414/017.out v310>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.110 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.779+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out auth v645 ap=1 s=34 n(v0 rc2023-10-08T13:28:41.811552+0000 b34 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1555ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b2:[<0x100000004a7/131.out v346>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005b2:[<0x100000004a7/131.out v645>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.110 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.779+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000782 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out auth v596 ap=1 s=3806 n(v0 rc2023-10-08T13:28:42.198542+0000 b3806 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1555f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000782:[<0x100000004a7/363.out v460>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000782:[<0x100000004a7/363.out v596>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.110 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.779+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out auth v608 ap=1 s=25 n(v0 rc2023-10-08T13:28:37.807655+0000 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15582580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000050b:[<0x100000004a7/049.out v200>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000050b:[<0x100000004a7/049.out v608>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.110 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.780+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out auth v586 ap=1 s=4362 n(v0 rc2023-10-08T13:28:42.400537+0000 b4362 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15583b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000085e:[<0x100000004a7/473.out v506>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000085e:[<0x100000004a7/473.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.110 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.780+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000870 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out auth v588 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15584680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000870:[<0x100000004a7/482.out v508>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000870:[<0x100000004a7/482.out v588>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.780+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out auth v647 ap=1 s=99 n(v0 rc2023-10-08T13:28:42.678530+0000 b99 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15584c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000090c:[<0x100000004a7/560.out v556>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000090c:[<0x100000004a7/560.out v647>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.816+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000416 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg auth v292 ap=1 s=87 n(v0 rc2023-10-08T13:28:37.625659+0000 b87 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4206100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000416:[<0x10000000414/001.cfg v4>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000416:[<0x10000000414/001.cfg v292>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.816+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000441 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out auth v300 ap=1 s=62 n(v0 b62 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4206c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000441:[<0x10000000414/021.out v90>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000441:[<0x10000000414/021.out v300>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.816+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000455 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out auth v306 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4206680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000455:[<0x10000000414/031.out v130>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000455:[<0x10000000414/031.out v306>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.781+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out auth v576 ap=1 s=312 n(v0 rc2023-10-08T13:28:42.052546+0000 b312 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006d4:[<0x100000004a7/276.out v416>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006d4:[<0x100000004a7/276.out v576>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.111 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.781+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000556 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out auth v606 ap=1 s=43 n(v0 rc2023-10-08T13:28:41.734554+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000556:[<0x100000004a7/085.out v314>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000556:[<0x100000004a7/085.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.112 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.816+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000435 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out auth v304 ap=1 s=200 n(v0 rc2023-10-08T13:28:37.647659+0000 b200 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb4207180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000435:[<0x10000000414/015.out v66>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000435:[<0x10000000414/015.out v304>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.112 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.819+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out auth v436 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.666684+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3ae7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e2:[<0x100000001ac/027.out v108>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001e2:[<0x100000001ac/027.out v436>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.112 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.819+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out auth v444 ap=1 s=2419 n(v0 rc2023-10-08T13:28:36.701683+0000 b2419 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021c:[<0x100000001ac/056.out v224>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000021c:[<0x100000001ac/056.out v444>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.112 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.782+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out auth v596 ap=1 s=18057 n(v0 rc2023-10-08T13:28:37.818654+0000 b18057 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000518:[<0x100000004a7/054.out v226>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000518:[<0x100000004a7/054.out v596>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.113 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.782+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out auth v644 ap=1 s=149 n(v0 rc2023-10-08T13:28:41.814552+0000 b149 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b6:[<0x100000004a7/133.out v348>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005b6:[<0x100000004a7/133.out v644>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.113 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.782+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ee [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default auth v646 ap=1 s=74 n(v0 b74 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ee:[<0x100000004a7/035.out.default v142>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004ee:[<0x100000004a7/035.out.default v646>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.113 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.782+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000762 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out auth v643 ap=1 s=39 n(v0 rc2023-10-08T13:28:42.170543+0000 b39 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000762:[<0x100000004a7/347.out v454>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000762:[<0x100000004a7/347.out v643>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.113 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.783+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005de [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out auth v594 ap=1 s=294 n(v0 rc2023-10-08T13:28:41.848551+0000 b294 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1533e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005de:[<0x100000004a7/153.out v358>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005de:[<0x100000004a7/153.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.114 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.820+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out auth v462 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b3cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022a:[<0x100000001ac/063.out v252>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000022a:[<0x100000001ac/063.out v462>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.114 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.823+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001c6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out auth v416 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.649684+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b54580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001c6:[<0x100000001ac/013.out v52>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001c6:[<0x100000001ac/013.out v416>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.114 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.824+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out auth v498 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.726682+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b56100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023c:[<0x100000001ac/072.out v288>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000023c:[<0x100000001ac/072.out v498>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.114 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.826+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out auth v406 ap=1 s=9130 n(v0 rc2023-10-08T13:28:36.700683+0000 b9130 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b5f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021a:[<0x100000001ac/055.out v220>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000021a:[<0x100000001ac/055.out v406>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.114 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:29:08.827+0000 7f5fc49f6700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out auth v454 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.703683+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ceb3b72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021e:[<0x100000001ac/057.out v228>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000021e:[<0x100000001ac/057.out v454>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.783+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008dc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out auth v653 ap=1 s=39 n(v0 rc2023-10-08T13:28:42.532533+0000 b39 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1533eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008dc:[<0x100000004a7/536.out v548>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008dc:[<0x100000004a7/536.out v653>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.783+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out auth v600 ap=1 s=274 n(v0 rc2023-10-08T13:28:37.844654+0000 b274 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15340100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000053a:[<0x100000004a7/071.out v294>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000053a:[<0x100000004a7/071.out v600>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.783+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out auth v582 ap=1 s=1054 n(v0 b1054 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15340680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007c8:[<0x100000004a7/398.out v484>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007c8:[<0x100000004a7/398.out v582>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.783+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006bc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out auth v651 ap=1 s=486 n(v0 rc2023-10-08T13:28:42.034546+0000 b486 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15340c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006bc:[<0x100000004a7/264.out v414>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006bc:[<0x100000004a7/264.out v651>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.784+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out auth v602 ap=1 s=175 n(v0 rc2023-10-08T13:28:46.541431+0000 b175 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15341180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000094c:[<0x100000004a7/592.out v560>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000094c:[<0x100000004a7/592.out v602>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.784+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000509 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out auth v650 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000509:[<0x100000004a7/048.out v196>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000509:[<0x100000004a7/048.out v650>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.116 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.784+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005c8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out auth v588 ap=1 s=298 n(v0 rc2023-10-08T13:28:41.830551+0000 b298 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005c8:[<0x100000004a7/142.out v350>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005c8:[<0x100000004a7/142.out v588>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.784+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000503 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out auth v648 ap=1 s=25 n(v0 rc2023-10-08T13:28:37.801655+0000 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15341700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000503:[<0x100000004a7/045.out v184>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000503:[<0x100000004a7/045.out v648>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.784+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000670 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out auth v578 ap=1 s=202 n(v0 rc2023-10-08T13:28:41.971548+0000 b202 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000670:[<0x100000004a7/226.out v390>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000670:[<0x100000004a7/226.out v578>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.785+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bb [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out auth v604 ap=1 s=795 n(v0 rc2023-10-08T13:28:37.745656+0000 b795 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bb:[<0x100000004a7/010.out v40>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004bb:[<0x100000004a7/010.out v604>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.785+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000552 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out auth v586 ap=1 s=105 n(v0 rc2023-10-08T13:28:41.731554+0000 b105 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000552:[<0x100000004a7/083.out v308>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000552:[<0x100000004a7/083.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.785+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000740 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out auth v592 ap=1 s=373 n(v0 rc2023-10-08T13:28:42.140543+0000 b373 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000740:[<0x100000004a7/330.out v458>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000740:[<0x100000004a7/330.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.786+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000858 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out auth v668 ap=1 s=47 n(v0 rc2023-10-08T13:28:42.395537+0000 b47 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000858:[<0x100000004a7/470.out v496>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000858:[<0x100000004a7/470.out v668>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.786+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c7 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out auth v594 ap=1 s=1216 n(v0 b1216 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c7:[<0x100000004a7/016.out v64>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004c7:[<0x100000004a7/016.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.787+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000652 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out auth v602 ap=1 s=69 n(v0 rc2023-10-08T13:28:41.947548+0000 b69 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15756b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000652:[<0x100000004a7/211.out v356>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000652:[<0x100000004a7/211.out v602>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.787+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005dc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out auth v664 ap=1 s=275 n(v0 rc2023-10-08T13:28:41.846551+0000 b275 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15757600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005dc:[<0x100000004a7/152.out v330>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005dc:[<0x100000004a7/152.out v664>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.117 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.787+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000680 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out auth v608 ap=1 s=81 n(v0 b81 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15757b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000680:[<0x100000004a7/234.out v370>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000680:[<0x100000004a7/234.out v608>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.787+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ac [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out auth v586 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15758100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005ac:[<0x100000004a7/128.out v326>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005ac:[<0x100000004a7/128.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.788+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000800 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out auth v662 ap=1 s=174 n(v0 rc2023-10-08T13:28:42.315539+0000 b174 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15759700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000800:[<0x100000004a7/426.out v472>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000800:[<0x100000004a7/426.out v662>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.788+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out auth v606 ap=1 s=214 n(v0 rc2023-10-08T13:28:42.244541+0000 b214 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15759180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b6:[<0x100000004a7/389.out v452>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007b6:[<0x100000004a7/389.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.788+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out auth v588 ap=1 s=291 n(v0 b291 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1575a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006a4:[<0x100000004a7/252.out v380>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006a4:[<0x100000004a7/252.out v588>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.814+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000425 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out auth v306 ap=1 s=210 n(v0 rc2023-10-08T13:28:37.636659+0000 b210 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15576000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000425:[<0x10000000414/007.out v34>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000425:[<0x10000000414/007.out v306>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.814+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out auth v300 ap=1 s=54 n(v0 rc2023-10-08T13:28:37.712657+0000 b54 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15578100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000491:[<0x10000000414/301.out v250>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000491:[<0x10000000414/301.out v300>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.815+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000045f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out auth v302 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d153eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000045f:[<0x10000000414/036.out v150>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000045f:[<0x10000000414/036.out v302>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.820+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out auth v516 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.660684+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d8:[<0x100000001ac/022.out v88>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001d8:[<0x100000001ac/022.out v516>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.822+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001be [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out auth v436 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d151fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001be:[<0x100000001ac/009.out v36>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001be:[<0x100000001ac/009.out v436>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.118 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.826+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ce [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out auth v508 ap=1 s=74 n(v0 rc2023-10-08T13:28:36.654684+0000 b74 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15220c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ce:[<0x100000001ac/017.out v68>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ce:[<0x100000001ac/017.out v508>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.826+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out auth v500 ap=1 s=87 n(v0 rc2023-10-08T13:28:36.690683+0000 b87 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15228100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000020a:[<0x100000001ac/047.out v188>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000020a:[<0x100000001ac/047.out v500>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.826+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000220 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out auth v566 ap=1 s=25 n(v0 rc2023-10-08T13:28:36.705683+0000 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15228680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000220:[<0x100000001ac/058.out v232>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000220:[<0x100000001ac/058.out v566>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.827+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ea [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out auth v494 ap=1 s=1304 n(v0 b1304 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d15231080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ea:[<0x100000001ac/031.out v124>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ea:[<0x100000001ac/031.out v494>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.828+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out auth v524 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1523e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d6:[<0x100000001ac/021.out v84>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001d6:[<0x100000001ac/021.out v524>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.828+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ca [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out auth v514 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1523ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ca:[<0x100000001ac/015.out v60>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ca:[<0x100000001ac/015.out v514>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.119 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:29:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:29:08.828+0000 7f1b5c17f700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out auth v576 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557d1523f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022e:[<0x100000001ac/065.out v260>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000022e:[<0x100000001ac/065.out v576>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.226 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.767+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000760 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out auth v588 ap=1 s=1102 n(v0 rc2023-10-08T13:28:42.168543+0000 b1102 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a2f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000760:[<0x100000004a7/346.out v432>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000760:[<0x100000004a7/346.out v588>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.226 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.768+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ae [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out auth v644 ap=1 s=44 n(v0 rc2023-10-08T13:28:42.488535+0000 b44 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a2f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008ae:[<0x100000004a7/513.out v526>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008ae:[<0x100000004a7/513.out v644>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.227 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.739+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000009a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt auth v14 ap=1 s=3098 n(v0 rc2023-10-08T13:28:33.600763+0000 b3098 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41074b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000009a:[<0x10000000098/auxiliary-programs.txt v4>,<0x1000000000c/doc v302>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000009a:[<0x10000000098/auxiliary-programs.txt v14>,<0x1000000000c/doc v1769>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.227 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.739+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000bd [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c auth v52 ap=1 s=2449 n(v0 rc2023-10-08T13:28:33.644762+0000 b2449 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4108c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000bd:[<0x100000000b1/string_to_tokens.c v24>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000bd:[<0x100000000b1/string_to_tokens.c v52>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.768+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out auth v647 ap=1 s=939 n(v0 rc2023-10-08T13:28:42.306539+0000 b939 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a1b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007f8:[<0x100000004a7/422.out v472>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007f8:[<0x100000004a7/422.out v647>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.768+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000061e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out auth v642 ap=1 s=618 n(v0 rc2023-10-08T13:28:41.903550+0000 b618 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a1b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000061e:[<0x100000004a7/185.out v358>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000061e:[<0x100000004a7/185.out v642>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.227 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.769+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000634 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out auth v586 ap=1 s=505 n(v0 rc2023-10-08T13:28:41.922549+0000 b505 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000634:[<0x100000004a7/196.out v366>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000634:[<0x100000004a7/196.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.770+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000826 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out auth v598 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.349538+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000826:[<0x100000004a7/445.out v496>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000826:[<0x100000004a7/445.out v598>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.771+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000804 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out auth v606 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000804:[<0x100000004a7/428.out v478>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000804:[<0x100000004a7/428.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.740+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000099 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES auth v24 ap=1 s=293 n(v0 rc2023-10-08T13:28:33.599763+0000 b293 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41075600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000099:[<0x10000000098/CHANGES v2>,<0x1000000000c/doc v302>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000099:[<0x10000000098/CHANGES v24>,<0x1000000000c/doc v1769>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.740+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c auth v46 ap=1 s=7024 n(v0 b7024 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4108cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b4:[<0x100000000b1/databin.c v6>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b4:[<0x100000000b1/databin.c v46>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.740+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b7 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c auth v48 ap=1 s=7659 n(v0 b7659 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4108d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b7:[<0x100000000b1/forker.c v12>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b7:[<0x100000000b1/forker.c v48>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.228 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.771+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000586 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out auth v584 ap=1 s=43 n(v0 rc2023-10-08T13:28:41.774553+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a1fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000586:[<0x100000004a7/109.out v322>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000586:[<0x100000004a7/109.out v584>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.229 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.771+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000774 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out auth v592 ap=1 s=185 n(v0 rc2023-10-08T13:28:42.186542+0000 b185 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000774:[<0x100000004a7/356.out v438>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000774:[<0x100000004a7/356.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.229 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.771+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out auth v640 ap=1 s=400 n(v0 rc2023-10-08T13:28:41.740554+0000 b400 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a129600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055e:[<0x100000004a7/089.out v310>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000055e:[<0x100000004a7/089.out v640>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.229 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.741+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b3 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c auth v34 ap=1 s=4719 n(v0 rc2023-10-08T13:28:33.637762+0000 b4719 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4108d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b3:[<0x100000000b1/dataascii.c v4>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b3:[<0x100000000b1/dataascii.c v34>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.229 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.741+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000bc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c auth v36 ap=1 s=4158 n(v0 rc2023-10-08T13:28:33.643762+0000 b4158 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000bc:[<0x100000000b1/str_to_bytes.c v22>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000bc:[<0x100000000b1/str_to_bytes.c v36>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.229 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.741+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000bf [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c auth v42 ap=1 s=12024 n(v0 b12024 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000bf:[<0x100000000b1/write_log.c v28>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000bf:[<0x100000000b1/write_log.c v42>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.230 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.771+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000582 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out auth v580 ap=1 s=50 n(v0 b50 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a12b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000582:[<0x100000004a7/107.out v320>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000582:[<0x100000004a7/107.out v580>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.230 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.772+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out auth v645 ap=1 s=217 n(v0 rc2023-10-08T13:28:42.492534+0000 b217 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a37c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008b2:[<0x100000004a7/515.out v528>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008b2:[<0x100000004a7/515.out v645>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.230 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.742+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000be [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c auth v38 ap=1 s=36312 n(v0 rc2023-10-08T13:28:33.645762+0000 b36312 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000be:[<0x100000000b1/tlibio.c v26>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000be:[<0x100000000b1/tlibio.c v38>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.230 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.742+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c auth v30 ap=1 s=4573 n(v0 rc2023-10-08T13:28:33.639762+0000 b4573 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b6:[<0x100000000b1/file_lock.c v10>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b6:[<0x100000000b1/file_lock.c v30>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.230 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.742+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000bb [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c auth v54 ap=1 s=21314 n(v0 rc2023-10-08T13:28:33.642762+0000 b21314 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000bb:[<0x100000000b1/random_range.c v20>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000bb:[<0x100000000b1/random_range.c v54>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.743+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b5 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c auth v56 ap=1 s=4216 n(v0 rc2023-10-08T13:28:33.638762+0000 b4216 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b5:[<0x100000000b1/datapid.c v8>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b5:[<0x100000000b1/datapid.c v56>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.743+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile auth v32 ap=1 s=633 n(v0 rc2023-10-08T13:28:33.629762+0000 b633 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b2:[<0x100000000b1/Makefile v2>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b2:[<0x100000000b1/Makefile v32>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.743+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c auth v40 ap=1 s=7197 n(v0 rc2023-10-08T13:28:33.640762+0000 b7197 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b8:[<0x100000000b1/open_flags.c v14>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b8:[<0x100000000b1/open_flags.c v40>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.744+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b9 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c auth v44 ap=1 s=2737 n(v0 rc2023-10-08T13:28:33.641762+0000 b2737 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b9:[<0x100000000b1/pattern.c v16>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b9:[<0x100000000b1/pattern.c v44>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.744+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ba [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c auth v50 ap=1 s=4175 n(v0 b4175 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ba:[<0x100000000b1/random.c v18>,<0x1000000000c/lib v368>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ba:[<0x100000000b1/random.c v50>,<0x1000000000c/lib v1422>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.745+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a7 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h auth v48 ap=1 s=308 n(v0 b308 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4105a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a7:[<0x1000000009f/file_lock.h v16>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a7:[<0x1000000009f/file_lock.h v48>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.231 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.745+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ab [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h auth v54 ap=1 s=2687 n(v0 rc2023-10-08T13:28:33.623762+0000 b2687 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4105a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ab:[<0x1000000009f/pattern.h v24>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ab:[<0x1000000009f/pattern.h v54>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.772+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005f2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out auth v582 ap=1 s=107 n(v0 rc2023-10-08T13:28:41.865551+0000 b107 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a37cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005f2:[<0x100000004a7/163.out v342>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005f2:[<0x100000004a7/163.out v582>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.772+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out auth v590 ap=1 s=44 n(v0 rc2023-10-08T13:28:42.239541+0000 b44 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a260580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007b0:[<0x100000004a7/386.out v458>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007b0:[<0x100000004a7/386.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.773+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out auth v646 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.518534+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a37e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008cc:[<0x100000004a7/528.out v536>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008cc:[<0x100000004a7/528.out v646>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.773+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000066e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out auth v633 ap=1 s=110 n(v0 b110 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a261600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000066e:[<0x100000004a7/225.out v388>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000066e:[<0x100000004a7/225.out v633>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.774+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005b4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out auth v594 ap=1 s=36183 n(v0 rc2023-10-08T13:28:41.812552+0000 b36183 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3adb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005b4:[<0x100000004a7/132.out v338>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005b4:[<0x100000004a7/132.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.774+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out auth v634 ap=1 s=397 n(v0 rc2023-10-08T13:28:41.738554+0000 b397 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000055c:[<0x100000004a7/088.out v312>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000055c:[<0x100000004a7/088.out v634>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.774+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c3 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out auth v590 ap=1 s=67 n(v0 rc2023-10-08T13:28:37.751656+0000 b67 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004c3:[<0x100000004a7/014.out v56>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004c3:[<0x100000004a7/014.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.775+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out auth v566 ap=1 s=704 n(v0 rc2023-10-08T13:28:41.840551+0000 b704 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a08c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005d4:[<0x100000004a7/148.out v356>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005d4:[<0x100000004a7/148.out v566>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.775+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d7 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out auth v586 ap=1 s=1857 n(v0 rc2023-10-08T13:28:37.767656+0000 b1857 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d7:[<0x100000004a7/024.out v96>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004d7:[<0x100000004a7/024.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.232 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.775+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000584 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out auth v632 ap=1 s=51 n(v0 rc2023-10-08T13:28:41.773553+0000 b51 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a08db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000584:[<0x100000004a7/108.out v324>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000584:[<0x100000004a7/108.out v632>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.775+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d5 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out auth v578 ap=1 s=1933 n(v0 b1933 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a08d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004d5:[<0x100000004a7/023.out v92>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004d5:[<0x100000004a7/023.out v578>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.745+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000b0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h auth v42 ap=1 s=4653 n(v0 b4653 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4105b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000b0:[<0x1000000009f/write_log.h v34>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000b0:[<0x1000000009f/write_log.h v42>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.745+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules auth v56 ap=1 s=3547 n(v0 rc2023-10-08T13:28:33.613762+0000 b3547 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4105b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a4:[<0x1000000009f/buildrules v10>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a4:[<0x1000000009f/buildrules v56>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.746+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ae [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h auth v46 ap=1 s=625 n(v0 rc2023-10-08T13:28:33.625762+0000 b625 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4105ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ae:[<0x1000000009f/string_to_tokens.h v30>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ae:[<0x1000000009f/string_to_tokens.h v46>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.746+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a9 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh auth v66 ap=1 s=6973 n(v0 rc2023-10-08T13:28:33.617762+0000 b6973 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41066000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a9:[<0x1000000009f/install-sh v20>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a9:[<0x1000000009f/install-sh v66>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.746+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile auth v44 ap=1 s=370 n(v0 b370 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41066580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a0:[<0x1000000009f/Makefile v2>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a0:[<0x1000000009f/Makefile v44>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.233 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.747+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ad [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h auth v40 ap=1 s=275 n(v0 b275 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41066b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ad:[<0x1000000009f/str_to_bytes.h v28>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ad:[<0x1000000009f/str_to_bytes.h v40>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.747+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a3 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros auth v58 ap=1 s=4489 n(v0 b4489 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41067080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a3:[<0x1000000009f/buildmacros v8>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a3:[<0x1000000009f/buildmacros v58>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.747+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h auth v36 ap=1 s=1361 n(v0 rc2023-10-08T13:28:33.615762+0000 b1361 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41067600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a6:[<0x1000000009f/databin.h v14>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a6:[<0x1000000009f/databin.h v36>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.747+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h auth v52 ap=1 s=1306 n(v0 rc2023-10-08T13:28:33.616762+0000 b1306 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41067b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a8:[<0x1000000009f/forker.h v18>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a8:[<0x1000000009f/forker.h v52>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.748+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000af [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h auth v60 ap=1 s=2774 n(v0 rc2023-10-08T13:28:33.626762+0000 b2774 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41068100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000af:[<0x1000000009f/tlibio.h v32>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000af:[<0x1000000009f/tlibio.h v60>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.748+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000a5 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h auth v38 ap=1 s=1322 n(v0 rc2023-10-08T13:28:33.614762+0000 b1322 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41068680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000a5:[<0x1000000009f/dataascii.h v12>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000a5:[<0x1000000009f/dataascii.h v38>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.776+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000684 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out auth v580 ap=1 s=36 n(v0 rc2023-10-08T13:28:41.987547+0000 b36 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a378100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000684:[<0x100000004a7/236.out v402>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000684:[<0x100000004a7/236.out v580>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.234 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.777+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000538 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out auth v631 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a326100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000538:[<0x100000004a7/070.out v290>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000538:[<0x100000004a7/070.out v631>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.778+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out auth v630 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.475535+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a212b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008a0:[<0x100000004a7/506.out v536>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008a0:[<0x100000004a7/506.out v630>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.778+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000068a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out auth v629 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a325600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000068a:[<0x100000004a7/239.out v404>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000068a:[<0x100000004a7/239.out v629>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.778+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out auth v590 ap=1 s=486 n(v0 rc2023-10-08T13:28:42.026546+0000 b486 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158ab5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006b2:[<0x100000004a7/259.out v388>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006b2:[<0x100000004a7/259.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.778+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out auth v586 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.416536+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000086e:[<0x100000004a7/481.out v506>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000086e:[<0x100000004a7/481.out v586>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.779+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out auth v606 ap=1 s=555 n(v0 rc2023-10-08T13:28:41.796552+0000 b555 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a326680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a0:[<0x100000004a7/122.out v318>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005a0:[<0x100000004a7/122.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.779+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b1 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out auth v580 ap=1 s=126 n(v0 b126 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004b1:[<0x100000004a7/005.out v20>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004b1:[<0x100000004a7/005.out v580>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.779+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000056e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out auth v582 ap=1 s=1196 n(v0 rc2023-10-08T13:28:41.754553+0000 b1196 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000056e:[<0x100000004a7/097.out v312>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000056e:[<0x100000004a7/097.out v582>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.779+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000876 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out auth v642 ap=1 s=88 n(v0 rc2023-10-08T13:28:42.423536+0000 b88 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000876:[<0x100000004a7/485.out v508>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000876:[<0x100000004a7/485.out v642>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.235 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.749+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ac [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h auth v62 ap=1 s=646 n(v0 rc2023-10-08T13:28:33.624762+0000 b646 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41068c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ac:[<0x1000000009f/random_range.h v26>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ac:[<0x1000000009f/random_range.h v62>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.749+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000aa [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h auth v64 ap=1 s=1922 n(v0 b1922 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41069180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000aa:[<0x1000000009f/open_flags.h v22>,<0x1000000000c/include v338>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000aa:[<0x1000000009f/open_flags.h v64>,<0x1000000000c/include v1773>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.749+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000cf [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4 auth v44 ap=1 s=1836 n(v0 b1836 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fe2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000cf:[<0x100000000cc/multilib.m4 v6>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000cf:[<0x100000000cc/multilib.m4 v44>,<0x1000000000c/m4 v1994>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.750+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4 auth v46 ap=1 s=190 n(v0 b190 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fe2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d4:[<0x100000000cc/package_libbtrfs.m4 v16>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d4:[<0x100000000cc/package_libbtrfs.m4 v46>,<0x1000000000c/m4 v1994>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.751+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000db [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4 auth v52 ap=1 s=3880 n(v0 rc2023-10-08T13:28:33.669761+0000 b3880 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fe3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000db:[<0x100000000cc/package_utilies.m4 v30>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000db:[<0x100000000cc/package_utilies.m4 v52>,<0x1000000000c/m4 v1994>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.751+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d0 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4 auth v70 ap=1 s=1217 n(v0 rc2023-10-08T13:28:33.662761+0000 b1217 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fe3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d0:[<0x100000000cc/package_acldev.m4 v8>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d0:[<0x100000000cc/package_acldev.m4 v70>,<0x1000000000c/m4 v1994>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.752+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4 auth v54 ap=1 s=1572 n(v0 rc2023-10-08T13:28:33.663761+0000 b1572 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d2:[<0x100000000cc/package_gdbmdev.m4 v12>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d2:[<0x100000000cc/package_gdbmdev.m4 v54>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.753+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d1 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4 auth v48 ap=1 s=130 n(v0 b130 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40feeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d1:[<0x100000000cc/package_aiodev.m4 v10>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d1:[<0x100000000cc/package_aiodev.m4 v48>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.753+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d9 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4 auth v50 ap=1 s=469 n(v0 b469 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d9:[<0x100000000cc/package_pthread.m4 v26>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d9:[<0x100000000cc/package_pthread.m4 v50>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.754+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000de [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4 auth v68 ap=1 s=768 n(v0 b768 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40ff0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000de:[<0x100000000cc/visibility_hidden.m4 v36>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000de:[<0x100000000cc/visibility_hidden.m4 v68>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.236 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.754+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000da [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4 auth v42 ap=1 s=1378 n(v0 rc2023-10-08T13:28:33.668761+0000 b1378 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40ff0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000da:[<0x100000000cc/package_types.m4 v28>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000da:[<0x100000000cc/package_types.m4 v42>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.780+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000886 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out auth v600 ap=1 s=167 n(v0 rc2023-10-08T13:28:42.450535+0000 b167 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000886:[<0x100000004a7/493.out v510>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000886:[<0x100000004a7/493.out v600>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.780+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cd [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out auth v592 ap=1 s=209 n(v0 rc2023-10-08T13:28:37.759656+0000 b209 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004cd:[<0x100000004a7/019.out v76>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004cd:[<0x100000004a7/019.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.780+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000596 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out auth v641 ap=1 s=295 n(v0 b295 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a350000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000596:[<0x100000004a7/117.out v314>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000596:[<0x100000004a7/117.out v641>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.780+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000546 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out auth v578 ap=1 s=158 n(v0 rc2023-10-08T13:28:41.721554+0000 b158 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a351b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000546:[<0x100000004a7/077.out v304>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000546:[<0x100000004a7/077.out v578>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.780+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000772 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out auth v638 ap=1 s=331 n(v0 rc2023-10-08T13:28:42.184542+0000 b331 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a353700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000772:[<0x100000004a7/355.out v434>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000772:[<0x100000004a7/355.out v638>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.781+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a2 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out auth v594 ap=1 s=2567 n(v0 rc2023-10-08T13:28:42.225541+0000 b2567 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a351080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007a2:[<0x100000004a7/379.out v450>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007a2:[<0x100000004a7/379.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.237 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.782+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000676 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out auth v639 ap=1 s=1546 n(v0 rc2023-10-08T13:28:41.976548+0000 b1546 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a351600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000676:[<0x100000004a7/229.out v366>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000676:[<0x100000004a7/229.out v639>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.814+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049d [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out auth v306 ap=1 s=89 n(v0 rc2023-10-08T13:28:37.721657+0000 b89 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a902100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000049d:[<0x10000000414/307.out v274>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000049d:[<0x10000000414/307.out v306>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.814+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000449 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out auth v292 ap=1 s=138 n(v0 rc2023-10-08T13:28:37.661658+0000 b138 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a903700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000449:[<0x10000000414/025.out v106>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000449:[<0x10000000414/025.out v292>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.814+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000044b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out auth v318 ap=1 s=1271 n(v0 b1271 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a903180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000044b:[<0x10000000414/026.out v110>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000044b:[<0x10000000414/026.out v318>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.814+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out auth v304 ap=1 s=200 n(v0 rc2023-10-08T13:28:37.640659+0000 b200 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a902c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000042b:[<0x10000000414/010.out v46>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000042b:[<0x10000000414/010.out v304>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.755+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000dc [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4 auth v66 ap=1 s=760 n(v0 b760 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40ff1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000dc:[<0x100000000cc/package_uuiddev.m4 v32>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000dc:[<0x100000000cc/package_uuiddev.m4 v66>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.755+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000ce [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4 auth v40 ap=1 s=489 n(v0 rc2023-10-08T13:28:33.661761+0000 b489 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40ff1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000ce:[<0x100000000cc/manual_format.m4 v4>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000ce:[<0x100000000cc/manual_format.m4 v40>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.756+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000d3 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4 auth v64 ap=1 s=1292 n(v0 rc2023-10-08T13:28:33.664761+0000 b1292 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40ff8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000d3:[<0x100000000cc/package_globals.m4 v14>,<0x1000000000c/m4 v430>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000d3:[<0x100000000cc/package_globals.m4 v64>,<0x1000000000c/m4 v1996>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.238 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.758+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description auth v189 ap=1 s=73 n(v0 rc2023-10-08T13:28:31.473817+0000 b73 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41076680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000000f:[<0x1000000000d/description v4>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000000f:[<0x1000000000d/description v189>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.758+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000002a [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/ auth{0=1,2=1,3=1,4=1} v180 ap=1 f(v0 m2023-10-08T13:28:31.522816+0000 2=0+2) n(v1 rc2023-10-08T13:28:33.517765+0000 b12877962 5=2+3) (inest mix) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@2},l=25304 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55ec40d1e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000002a:[<0x1000000000d/objects v118>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000002a:[<0x1000000000d/objects v180>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:31.522816+0000 2=0+2)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.517765+0000 b12877962 5=2+3)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:31.522816+0000 2=0+2)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:33.517765+0000 b12877962 5=2+3)","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.759+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000012 [...4,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/ auth v209 ap=1 f(v0 m2023-10-08T13:28:31.485817+0000 13=13+0) n(v1 rc2023-10-08T13:28:31.486817+0000 b23442 14=13+1) old_inodes=1 (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@6},l=25304 | dirtyscattered=0 request=0 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d1f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000012:[<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000012:[<0x1000000000d/hooks v209>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:31.485817+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:31.486817+0000 b23442 14=13+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:31.485817+0000 13=13+0)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:31.486817+0000 b23442 14=13+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.759+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000037 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs auth v195 ap=1 s=5114 n(v0 rc2023-10-08T13:28:33.466766+0000 b5114 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/pFscr@2},l=25304 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41077180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000037:[<0x1000000000d/packed-refs v132>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000037:[<0x1000000000d/packed-refs v195>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.760+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000047 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config auth v193 ap=1 s=262 n(v0 rc2023-10-08T13:28:33.515765+0000 b262 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/pFscr@1},l=25304 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41077700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000047:[<0x1000000000d/config v166>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000047:[<0x1000000000d/config v193>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.760+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000020 [...4,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/ auth{2=1,3=1,4=1} v211 ap=1 f(v0 m2023-10-08T13:28:33.468766+0000 3=0+3) n(v2 rc2023-10-08T13:28:33.500765+0000 b73 7=2+5) old_inodes=1 (inest mix dirty) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@8},l=25304 | dirtyscattered=1 request=0 lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55ec40d1e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000020:[<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000020:[<0x1000000000d/refs v211>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.468766+0000 3=0+3)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b73 7=2+5)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.468766+0000 3=0+3)","memory_value.rstat":"n(v2 rc2023-10-08T13:28:33.500765+0000 b73 7=2+5)","error_str":""},"return_code":0} 2023-10-08T13:29:09.239 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.760+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000035 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow auth v191 ap=1 s=41 n(v0 rc2023-10-08T13:28:33.449767+0000 b41 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/pFscr@1},l=25304 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4108a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000035:[<0x1000000000d/shallow v122>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000035:[<0x1000000000d/shallow v191>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.815+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000495 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out auth v312 ap=1 s=54 n(v0 rc2023-10-08T13:28:37.715657+0000 b54 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a914580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000495:[<0x10000000414/303.out v258>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000495:[<0x10000000414/303.out v312>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.816+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000499 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out auth v314 ap=1 s=43 n(v0 rc2023-10-08T13:28:37.718657+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a915600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000499:[<0x10000000414/305.out v266>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000499:[<0x10000000414/305.out v314>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.816+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000433 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out auth v282 ap=1 s=235 n(v0 b235 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a916100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000433:[<0x10000000414/014.out v62>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000433:[<0x10000000414/014.out v282>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.816+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out auth v290 ap=1 s=77 n(v0 rc2023-10-08T13:28:37.685658+0000 b77 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a915b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000046b:[<0x10000000414/042.out v174>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000046b:[<0x10000000414/042.out v290>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.817+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000447 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out auth v294 ap=1 s=39 n(v0 rc2023-10-08T13:28:37.660658+0000 b39 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a916680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000447:[<0x10000000414/024.out v102>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000447:[<0x10000000414/024.out v294>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.817+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000445 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out auth v284 ap=1 s=51 n(v0 rc2023-10-08T13:28:37.659658+0000 b51 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a916c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000445:[<0x10000000414/023.out v98>,<0x100000001aa/ext4 v3815>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000445:[<0x10000000414/023.out v284>,<0x100000001aa/ext4 v12320>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.822+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out auth v428 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a242580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000210:[<0x100000001ac/050.out v200>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000210:[<0x100000001ac/050.out v428>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.822+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ae [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out auth v524 ap=1 s=695 n(v0 b695 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a243b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ae:[<0x100000001ac/001.out v4>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ae:[<0x100000001ac/001.out v524>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.822+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ec [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out auth v448 ap=1 s=126 n(v0 rc2023-10-08T13:28:36.672684+0000 b126 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a245180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ec:[<0x100000001ac/032.out v128>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ec:[<0x100000001ac/032.out v448>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.240 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.823+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ee [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out auth v450 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.673684+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a258b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001ee:[<0x100000001ac/033.out v132>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001ee:[<0x100000001ac/033.out v450>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.761+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000e [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/AsLsXsFsx@2},l=25304 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55ec4108a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000000e:[<0x1000000000d/branches v2>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000000e:[<0x1000000000d/branches v2>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.761+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000097 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash auth v10 ap=1 s=10879 n(v0 rc2023-10-08T13:28:33.597763+0000 b10879 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000097:[<0x10000000094/xfscrash v6>,<0x1000000000c/crash v288>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000097:[<0x10000000094/xfscrash v10>,<0x1000000000c/crash v1320>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.763+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000096 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit auth v8 ap=1 s=1055 n(v0 b1055 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000096:[<0x10000000094/rc.sysinit v4>,<0x1000000000c/crash v288>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000096:[<0x10000000094/rc.sysinit v8>,<0x1000000000c/crash v1320>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.763+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000095 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README auth v12 ap=1 s=5195 n(v0 rc2023-10-08T13:28:33.596763+0000 b5195 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410fdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000095:[<0x10000000094/README v2>,<0x1000000000c/crash v288>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000095:[<0x10000000094/README v12>,<0x1000000000c/crash v1320>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.764+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000c9 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c auth v20 ap=1 s=77176 n(v0 rc2023-10-08T13:28:33.656761+0000 b77176 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec41029700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000c9:[<0x100000000c2/growfiles.c v14>,<0x1000000000c/ltp v392>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000c9:[<0x100000000c2/growfiles.c v20>,<0x1000000000c/ltp v1797>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.764+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000cb [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh auth v24 ap=1 s=6605 n(v0 rc2023-10-08T13:28:33.658761+0000 b6605 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4103e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000cb:[<0x100000000c2/rwtest.sh v18>,<0x1000000000c/ltp v392>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000cb:[<0x100000000c2/rwtest.sh v24>,<0x1000000000c/ltp v1797>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.766+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000c6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h auth v26 ap=1 s=4982 n(v0 b4982 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4103f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000c6:[<0x100000000c2/doio.h v8>,<0x1000000000c/ltp v392>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000c6:[<0x100000000c2/doio.h v26>,<0x1000000000c/ltp v1797>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.241 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.766+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000000c4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c auth v22 ap=1 s=38493 n(v0 rc2023-10-08T13:28:33.650761+0000 b38493 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec4103fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000000c4:[<0x100000000c2/aio-stress.c v4>,<0x1000000000c/ltp v392>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000000c4:[<0x100000000c2/aio-stress.c v22>,<0x1000000000c/ltp v1797>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.767+0000 7faafacc2700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000010 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/ auth{2=1,3=1,4=1} v205 ap=2 f(v0 m2023-10-08T13:28:31.474817+0000 1=1+0) n(v1 rc2023-10-08T13:28:31.475817+0000 b240 2=1+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={25304=pAsLsXsFs/pAsLsXsFsxcral@2} | lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55ec40d7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000010:[<0x1000000000d/info v8>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000010:[<0x1000000000d/info v205>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:31.474817+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:31.475817+0000 b240 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:31.474817+0000 1=1+0)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:31.475817+0000 b240 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.769+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000002b [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/ auth{0=1,2=1,3=1,4=1} v42 ap=1 f(v0 m2023-10-08T13:28:33.517765+0000 2=2+0) n(v0 rc2023-10-08T13:28:33.517765+0000 b12877962 3=2+1) (inest mix) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55ec40d1eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000002b:[<0x1000000002a/pack v42>,<0x1000000000d/objects v118>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000002b:[<0x1000000002a/pack v42>,<0x1000000000d/objects v180>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.517765+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.517765+0000 b12877962 3=2+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.517765+0000 2=2+0)","memory_value.rstat":"n(v0 rc2023-10-08T13:28:33.517765+0000 b12877962 3=2+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.826+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000242 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out auth v480 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.729682+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a263700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000242:[<0x100000001ac/075.out v300>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000242:[<0x100000001ac/075.out v480>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.826+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out auth v512 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.667684+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a2b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e4:[<0x100000001ac/028.out v112>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001e4:[<0x100000001ac/028.out v512>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.828+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000222 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out auth v424 ap=1 s=340 n(v0 b340 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a2b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000222:[<0x100000001ac/059.out v236>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000222:[<0x100000001ac/059.out v424>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.242 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.829+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fa [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out auth v432 ap=1 s=25 n(v0 rc2023-10-08T13:28:36.680684+0000 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001fa:[<0x100000001ac/039.out v156>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001fa:[<0x100000001ac/039.out v432>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.830+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out auth v418 ap=1 s=424 n(v0 rc2023-10-08T13:28:36.679684+0000 b424 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001f8:[<0x100000001ac/038.out v152>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001f8:[<0x100000001ac/038.out v418>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.830+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001e8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out auth v450 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001e8:[<0x100000001ac/030.out v120>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001e8:[<0x100000001ac/030.out v450>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.835+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000236 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out auth v460 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a2e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000236:[<0x100000001ac/069.out v276>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000236:[<0x100000001ac/069.out v460>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.835+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001d4 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out auth v458 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000001d4:[<0x100000001ac/020.out v80>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x100000001d4:[<0x100000001ac/020.out v458>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.836+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000240 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out auth v480 ap=1 s=43 n(v0 rc2023-10-08T13:28:36.728682+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000240:[<0x100000001ac/074.out v296>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000240:[<0x100000001ac/074.out v480>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.243 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:29:08.837+0000 7f6f9f666700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out auth v510 ap=1 s=25 n(v0 b25 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@2},l=25304(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56158a3fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000212:[<0x100000001ac/051.out v204>,<0x100000001aa/btrfs v312>,<0x1000000000c/tests v775>,<0x1000000000b/xfstests-dev v87>,<0x1000000000a/tmp v14>,<0x10000000007/client.0 v18>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v30>,<0x10000000001/sv_1 v54>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000212:[<0x100000001ac/051.out v510>,<0x100000001aa/btrfs v13710>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.769+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000002c [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFs@2},l=25304 | importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55ec4108ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000002c:[<0x1000000002a/info v4>,<0x1000000000d/objects v118>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000002c:[<0x1000000002a/info v4>,<0x1000000000d/objects v180>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.769+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample auth v34 ap=1 s=416 n(v0 rc2023-10-08T13:28:31.482817+0000 b416 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d1f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001a:[<0x10000000012/pre-merge-commit.sample v16>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001a:[<0x10000000012/pre-merge-commit.sample v34>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.770+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample auth v38 ap=1 s=1643 n(v0 b1643 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d1fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000015:[<0x10000000012/pre-commit.sample v6>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000015:[<0x10000000012/pre-commit.sample v38>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.770+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample auth v36 ap=1 s=4655 n(v0 rc2023-10-08T13:28:31.483817+0000 b4655 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001b:[<0x10000000012/fsmonitor-watchman.sample v18>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001b:[<0x10000000012/fsmonitor-watchman.sample v36>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.770+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000017 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample auth v30 ap=1 s=896 n(v0 rc2023-10-08T13:28:31.480817+0000 b896 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d20680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000017:[<0x10000000012/commit-msg.sample v10>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000017:[<0x10000000012/commit-msg.sample v30>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.246 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.771+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000018 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample auth v46 ap=1 s=4898 n(v0 rc2023-10-08T13:28:31.481817+0000 b4898 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000018:[<0x10000000012/pre-rebase.sample v12>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000018:[<0x10000000012/pre-rebase.sample v46>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.771+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample auth v42 ap=1 s=544 n(v0 b544 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d21180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001e:[<0x10000000012/pre-receive.sample v24>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001e:[<0x10000000012/pre-receive.sample v42>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.772+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000013 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample auth v52 ap=1 s=1492 n(v0 rc2023-10-08T13:28:31.477817+0000 b1492 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000013:[<0x10000000012/prepare-commit-msg.sample v2>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000013:[<0x10000000012/prepare-commit-msg.sample v52>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.772+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000016 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample auth v44 ap=1 s=3650 n(v0 rc2023-10-08T13:28:31.479817+0000 b3650 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d3f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000016:[<0x10000000012/update.sample v8>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000016:[<0x10000000012/update.sample v44>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.772+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000014 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample auth v32 ap=1 s=1374 n(v0 rc2023-10-08T13:28:31.478817+0000 b1374 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000014:[<0x10000000012/pre-push.sample v4>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000014:[<0x10000000012/pre-push.sample v32>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.773+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample auth v40 ap=1 s=424 n(v0 rc2023-10-08T13:28:31.484817+0000 b424 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001c:[<0x10000000012/pre-applypatch.sample v20>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001c:[<0x10000000012/pre-applypatch.sample v40>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.773+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001f [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample auth v50 ap=1 s=2783 n(v0 rc2023-10-08T13:28:31.486817+0000 b2783 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001f:[<0x10000000012/push-to-checkout.sample v26>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001f:[<0x10000000012/push-to-checkout.sample v50>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.775+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample auth v28 ap=1 s=189 n(v0 b189 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000019:[<0x10000000012/post-update.sample v14>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000019:[<0x10000000012/post-update.sample v28>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.776+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001d [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample auth v48 ap=1 s=478 n(v0 rc2023-10-08T13:28:31.485817+0000 b478 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d41180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000001d:[<0x10000000012/applypatch-msg.sample v22>,<0x1000000000d/hooks v36>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000001d:[<0x10000000012/applypatch-msg.sample v48>,<0x1000000000d/hooks v209>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.776+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000022 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags/ auth v4 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@4},l=25304 | request=0 lock=0 importingcaps=0 dirfrag=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55ec40d41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000022:[<0x10000000020/tags v4>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000022:[<0x10000000020/tags v4>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.247 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.777+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000021 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/ auth v23 ap=1 f(v0 m2023-10-08T13:28:33.500765+0000 1=1+0) n(v1 rc2023-10-08T13:28:33.500765+0000 b41 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@3},l=25304 | dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000021:[<0x10000000020/heads v14>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000021:[<0x10000000020/heads v23>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.500765+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b41 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.500765+0000 1=1+0)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:33.500765+0000 b41 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.778+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000038 [...4,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/ auth v27 ap=1 f(v0 m2023-10-08T13:28:33.469766+0000 1=0+1) n(v2 rc2023-10-08T13:28:33.475766+0000 b32 3=1+2) old_inodes=1 (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@3},l=25304 | dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000038:[<0x10000000020/remotes v8>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000038:[<0x10000000020/remotes v27>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.469766+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.475766+0000 b32 3=1+2)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.469766+0000 1=0+1)","memory_value.rstat":"n(v2 rc2023-10-08T13:28:33.475766+0000 b32 3=1+2)","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.779+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003b [...4,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/ auth{0=1,2=1,3=1,4=1} v230 ap=2 f(v0 m2023-10-08T13:28:33.495765+0000 2=1+1) n(v5 rc2023-10-08T13:28:33.500765+0000 b546 8=3+5) old_inodes=1 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={25304=pAsLsXsFs/pAsLsXsFsxcral@3} | dirtyscattered=0 request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55ec41074000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000003b:[<0x1000000000d/logs v153>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000003b:[<0x1000000000d/logs v207>,<0x1000000000c/.git v1998>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.495765+0000 2=1+1)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.500765+0000 b546 8=3+5)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.495765+0000 2=1+1)","memory_value.rstat":"n(v5 rc2023-10-08T13:28:33.500765+0000 b546 8=3+5)","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.780+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000080 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf auth v138 ap=1 s=937 n(v0 rc2023-10-08T13:28:33.574763+0000 b937 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40f87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000080:[<0x10000000060/perf v64>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000080:[<0x10000000060/perf v138>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.780+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000006d [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk auth v164 ap=1 s=1098 n(v0 rc2023-10-08T13:28:33.560764+0000 b1098 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40f88100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000006d:[<0x10000000060/dmhugedisk v26>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000006d:[<0x10000000060/dmhugedisk v164>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.781+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000007b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest auth v132 ap=1 s=1856 n(v0 rc2023-10-08T13:28:33.570763+0000 b1856 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40f89180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000007b:[<0x10000000060/locktest v54>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000007b:[<0x10000000060/locktest v132>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.782+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000066 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2 auth v148 ap=1 s=493 n(v0 rc2023-10-08T13:28:33.550764+0000 b493 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fa5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000066:[<0x10000000060/cgroup2 v12>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000066:[<0x10000000060/cgroup2 v148>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.783+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000061 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile auth v120 ap=1 s=305 n(v0 b305 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000061:[<0x10000000060/Makefile v2>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000061:[<0x10000000060/Makefile v120>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.783+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000007e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs auth v114 ap=1 s=794 n(v0 rc2023-10-08T13:28:33.572763+0000 b794 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fa6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000007e:[<0x10000000060/nfs v60>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000007e:[<0x10000000060/nfs v114>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.784+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000008b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names auth v158 ap=1 s=312 n(v0 b312 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fb2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000008b:[<0x10000000060/test_names v86>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000008b:[<0x10000000060/test_names v158>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.248 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.786+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000068 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag auth v116 ap=1 s=4131 n(v0 rc2023-10-08T13:28:33.551764+0000 b4131 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40fbd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000068:[<0x10000000060/defrag v16>,<0x1000000000c/common v272>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000068:[<0x10000000060/defrag v116>,<0x1000000000c/common v1753>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.787+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000032 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack auth{0=1} v111 ap=1 s=11600874 n(v0 rc2023-10-08T13:28:33.428767+0000 b11600874 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25304=0-25165824@2} caps={25304=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25304 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55ec4108b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000032:[<0x1000000002b/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack v111>,<0x1000000002a/pack v42>,<0x1000000000d/objects v118>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000032:[<0x1000000002b/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack v111>,<0x1000000002a/pack v42>,<0x1000000000d/objects v180>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.787+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000005d [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/ auth v17 ap=1 f(v0 m2023-10-08T13:28:33.543764+0000 1=1+0) n(v0 rc2023-10-08T13:28:33.544764+0000 b544 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000005d:[<0x10000000057/tar v14>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x1000000005d:[<0x10000000057/tar v17>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.543764+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.544764+0000 b544 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.543764+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-10-08T13:28:33.544764+0000 b544 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.787+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000033 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx auth v114 ap=1 s=1277088 n(v0 rc2023-10-08T13:28:33.432767+0000 b1277088 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={25304=0-4194304@2} caps={25304=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=25304 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55ec4108b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000033:[<0x1000000002b/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx v114>,<0x1000000002a/pack v42>,<0x1000000000d/objects v118>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000033:[<0x1000000002b/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx v114>,<0x1000000002a/pack v42>,<0x1000000000d/objects v180>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.788+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000058 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile auth v25 ap=1 s=1419 n(v0 rc2023-10-08T13:28:33.539764+0000 b1419 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000058:[<0x10000000057/Makefile v2>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000058:[<0x10000000057/Makefile v25>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.788+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000059 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/ auth v29 ap=1 f(v0 m2023-10-08T13:28:59.477099+0000 3=3+0) n(v0 rc2023-10-08T13:28:59.477099+0000 b3058 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000059:[<0x10000000057/rpm v10>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000059:[<0x10000000057/rpm v29>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:59.477099+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:59.477099+0000 b3058 4=3+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:59.477099+0000 3=3+0)","memory_value.rstat":"n(v0 rc2023-10-08T13:28:59.477099+0000 b3058 4=3+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.790+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bf [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out auth v624 ap=1 s=1216 n(v0 rc2023-10-08T13:28:37.748656+0000 b1216 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004bf:[<0x100000004a7/012.out v48>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004bf:[<0x100000004a7/012.out v624>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.249 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.790+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out auth v594 ap=1 s=622 n(v0 b622 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008e8:[<0x100000004a7/542.out v544>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008e8:[<0x100000004a7/542.out v594>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.791+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006be [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out auth v582 ap=1 s=312 n(v0 rc2023-10-08T13:28:42.035546+0000 b312 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006be:[<0x100000004a7/265.out v392>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006be:[<0x100000004a7/265.out v582>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.791+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ad [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out auth v578 ap=1 s=43 n(v0 rc2023-10-08T13:28:37.735657+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000004ad:[<0x100000004a7/003.out v12>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000004ad:[<0x100000004a7/003.out v578>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.791+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out auth v606 ap=1 s=1591 n(v0 rc2023-10-08T13:28:42.496534+0000 b1591 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008b6:[<0x100000004a7/517.out v522>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008b6:[<0x100000004a7/517.out v606>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.792+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000838 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out auth v620 ap=1 s=123 n(v0 b123 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000838:[<0x100000004a7/454.out v486>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000838:[<0x100000004a7/454.out v620>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.792+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000866 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out auth v622 ap=1 s=185 n(v0 rc2023-10-08T13:28:42.409537+0000 b185 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000866:[<0x100000004a7/477.out v504>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000866:[<0x100000004a7/477.out v622>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.792+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000720 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out auth v666 ap=1 s=43 n(v0 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000720:[<0x100000004a7/314.out v418>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000720:[<0x100000004a7/314.out v666>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.793+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out auth v596 ap=1 s=725 n(v0 rc2023-10-08T13:28:41.855551+0000 b725 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005e6:[<0x100000004a7/157.out v332>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005e6:[<0x100000004a7/157.out v596>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.793+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000900 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out auth v668 ap=1 s=79 n(v0 rc2023-10-08T13:28:42.566533+0000 b79 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000900:[<0x100000004a7/554.out v550>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000900:[<0x100000004a7/554.out v668>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.250 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.793+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out auth v602 ap=1 s=1145 n(v0 rc2023-10-08T13:28:42.338538+0000 b1145 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000081a:[<0x100000004a7/439.out v476>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000081a:[<0x100000004a7/439.out v602>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.794+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e6 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out auth v616 ap=1 s=752 n(v0 rc2023-10-08T13:28:42.542533+0000 b752 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000008e6:[<0x100000004a7/541.out v540>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000008e6:[<0x100000004a7/541.out v616>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.795+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ca [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out auth v590 ap=1 s=76 n(v0 rc2023-10-08T13:28:42.263540+0000 b76 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000007ca:[<0x100000004a7/399.out v458>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000007ca:[<0x100000004a7/399.out v590>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.795+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out auth v671 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.371538+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000083e:[<0x100000004a7/457.out v490>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000083e:[<0x100000004a7/457.out v671>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.795+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005a8 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out auth v669 ap=1 s=1066 n(v0 b1066 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000005a8:[<0x100000004a7/126.out v324>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000005a8:[<0x100000004a7/126.out v669>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.795+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ae [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out auth v610 ap=1 s=34 n(v0 rc2023-10-08T13:28:42.023546+0000 b34 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000006ae:[<0x100000004a7/257.out v384>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x100000006ae:[<0x100000004a7/257.out v610>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.796+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000616 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out auth v600 ap=1 s=257 n(v0 rc2023-10-08T13:28:41.896550+0000 b257 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000616:[<0x100000004a7/181.out v342>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000616:[<0x100000004a7/181.out v600>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.796+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out auth v580 ap=1 s=64 n(v0 rc2023-10-08T13:28:37.833654+0000 b64 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000052c:[<0x100000004a7/064.out v266>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000052c:[<0x100000004a7/064.out v580>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.797+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000894 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out auth v592 ap=1 s=43 n(v0 rc2023-10-08T13:28:42.463535+0000 b43 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000894:[<0x100000004a7/500.out v514>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x10000000894:[<0x100000004a7/500.out v592>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.251 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.797+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091c [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out auth v670 ap=1 s=148 n(v0 b148 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000091c:[<0x100000004a7/568.out v554>,<0x100000001aa/generic v4290>,<0x1000000000c/tests v816>,<0x1000000000b/xfstests-dev v95>,<0x1000000000a/tmp v19>,<0x10000000007/client.0 v22>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v34>,<0x10000000001/sv_1 v59>,<0x10000000000/_nogroup v41>,<0x1/volumes v39>]//[3]","memoryvalue":"(4)0x1000000091c:[<0x100000004a7/568.out v670>,<0x100000001aa/generic v15124>,<0x1000000000c/tests v1940>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.799+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000042 [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master auth v10 ap=1 s=41 n(v0 rc2023-10-08T13:28:33.500765+0000 b41 1=1+0) (iversion lock) caps={25304=pAsLsXsFscr/pFscr@2},l=25304 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000042:[<0x10000000021/master v4>,<0x10000000020/heads v14>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x10000000042:[<0x10000000021/master v10>,<0x10000000020/heads v23>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.799+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000039 [...3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/ auth v13 ap=1 f(v0 m2023-10-08T13:28:33.475766+0000 1=1+0) n(v1 rc2023-10-08T13:28:33.475766+0000 b32 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={25304=pAsLsXsFsx/pAsLsXsFsxcral@1},l=25304 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000039:[<0x10000000038/origin v8>,<0x10000000020/remotes v8>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x10000000039:[<0x10000000038/origin v13>,<0x10000000020/remotes v27>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-10-08T13:28:33.475766+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-10-08T13:28:33.475766+0000 b32 2=1+1)","memory_value.dirstat":"f(v0 m2023-10-08T13:28:33.475766+0000 1=1+0)","memory_value.rstat":"n(v1 rc2023-10-08T13:28:33.475766+0000 b32 2=1+1)","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.805+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000005e [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile auth v4 ap=1 s=544 n(v0 rc2023-10-08T13:28:33.544764+0000 b544 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000005e:[<0x1000000005d/Makefile v2>,<0x10000000057/tar v14>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000005e:[<0x1000000005d/Makefile v4>,<0x10000000057/tar v17>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.805+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000005b [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template auth v8 ap=1 s=842 n(v0 b842 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000005b:[<0x10000000059/macros.template v4>,<0x10000000057/rpm v10>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000005b:[<0x10000000059/macros.template v8>,<0x10000000057/rpm v29>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.805+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000005a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile auth v12 ap=1 s=2216 n(v0 rc2023-10-08T13:28:33.541764+0000 b2216 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec410cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000005a:[<0x10000000059/Makefile v2>,<0x10000000057/rpm v10>,<0x1000000000c/build v174>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000005a:[<0x10000000059/Makefile v12>,<0x10000000057/rpm v29>,<0x1000000000c/build v1935>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.252 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:29:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:29:08.805+0000 7faaf4cb6700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000003a [3,head] /volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD auth v10 ap=1 s=32 n(v0 rc2023-10-08T13:28:33.475766+0000 b32 1=1+0) (iversion lock) caps={25304=pAsLsXsFsc/-@1},l=25304(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55ec40d79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000003a:[<0x10000000039/HEAD v4>,<0x10000000038/origin v8>,<0x10000000020/remotes v8>,<0x1000000000d/refs v138>,<0x1000000000c/.git v749>,<0x1000000000b/xfstests-dev v77>,<0x1000000000a/tmp v11>,<0x10000000007/client.0 v14>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v28>,<0x10000000001/sv_1 v52>,<0x10000000000/_nogroup v37>,<0x1/volumes v35>]//[3]","memoryvalue":"(4)0x1000000003a:[<0x10000000039/HEAD v10>,<0x10000000038/origin v13>,<0x10000000020/remotes v27>,<0x1000000000d/refs v211>,<0x1000000000c/.git v2000>,<0x1000000000b/xfstests-dev v225>,<0x1000000000a/tmp v50>,<0x10000000007/client.0 v49>,<0x10000000006/fd33dcf5-3a36-4924-b584-e7cb8ee69587 v61>,<0x10000000001/sv_1 v83>,<0x10000000000/_nogroup v61>,<0x1/volumes v19>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-08T13:29:09.652 INFO:tasks.workunit.client.0.smithi139.stdout:autoheader 2023-10-08T13:29:09.972 INFO:tasks.workunit.client.0.smithi139.stdout:autoconf 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 503 op/s 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub queued for path: / 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000009a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000bd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000099 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ab (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000af (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000a5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000aa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000cf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000db (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000da (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000d3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000002a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000044 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000043 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000037 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000045 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000047 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000020 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000035 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000097 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000096 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000095 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000c9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000cb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000000c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000082c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000760 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000002c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000051e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000826 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000828 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000814 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000774 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000083a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.107 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008cc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.108 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000868 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000079e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.109 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004d5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000092c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000906 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.110 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.111 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.111 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000022 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.112 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000038 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000930 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000080 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000085e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000006d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000090c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000007b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000066 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000061 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000007e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000094c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000008b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000509 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000552 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000068 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.117 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000858 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000032 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000005d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000033 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000058 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.118 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000059 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000838 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.119 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000866 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000720 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000900 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000081a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000008e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000083e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.120 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000091c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000042 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000039 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000005e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000005b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000005a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000003a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000049f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.123 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000499 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.124 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001e2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000021c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000022a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001d8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.125 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000023c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000242 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001e4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000220 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000021e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.126 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000222 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x1000000022e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001fa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000236 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x100000001d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000240 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.127 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.128 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:09 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.146 INFO:tasks.workunit.client.0.smithi139.stdout:./configure \ 2023-10-08T13:29:10.146 INFO:tasks.workunit.client.0.smithi139.stdout: --libexecdir=/usr/lib \ 2023-10-08T13:29:10.146 INFO:tasks.workunit.client.0.smithi139.stdout: --exec_prefix=/var/lib 2023-10-08T13:29:10.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 503 op/s 2023-10-08T13:29:10.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub queued for path: / 2023-10-08T13:29:10.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000009a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000bd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000099 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ab (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000af (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000a5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000aa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000cf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000db (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000da (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000d3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000002a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000044 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000043 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000037 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000045 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000047 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000020 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000035 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000097 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000096 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000095 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000c9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000cb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000000c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000082c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000760 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000002c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000051e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000826 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000828 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000814 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000774 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000083a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.200 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008cc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000868 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.201 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000079e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004d5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000092c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.202 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000906 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000022 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.203 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000038 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.204 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000930 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.205 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000080 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000085e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000006d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.206 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000090c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000007b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.207 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000066 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000061 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000007e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.208 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000094c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000008b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000509 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.209 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000552 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000068 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000858 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.210 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000032 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000005d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000033 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.211 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000058 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000059 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.212 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000838 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000866 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.213 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000720 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000900 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000081a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000008e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.214 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000083e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000091c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000042 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000039 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000005e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000005b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000005a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000003a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.217 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000049f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.218 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000499 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.219 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.220 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001e2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000021c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000022a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001d8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.221 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.222 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.222 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.222 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000023c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000242 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001e4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.223 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000220 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000021e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.224 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000222 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x1000000022e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001fa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000236 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.225 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x100000001d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.226 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000240 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.226 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.226 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:09 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: pgmap v349: 129 pgs: 129 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 503 op/s 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub queued for path: / 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000009a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000bd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000099 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.230 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ab (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.231 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000af (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000a5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000aa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.232 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000cf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000db (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.233 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000da (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000d3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000000f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000002a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.234 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000012 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000044 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000043 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000037 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000045 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.235 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000011 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000047 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000020 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000035 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000000e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000097 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.236 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000096 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000095 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000c9 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000cb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.237 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000000c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000010 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000082c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000760 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000598 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000066c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000065c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.238 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000061e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004ef (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000634 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000002b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000002c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000051e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000015 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000826 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.239 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000017 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000804 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000828 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000586 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000814 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000774 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000018 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000055e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000078c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000582 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000083a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.240 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000013 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005f2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000016 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008a6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007b0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000708 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000014 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008cc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000890 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.241 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000066e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005b4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000055c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000868 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004c3 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000051a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004d7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000878 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.242 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000019 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000584 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000079e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004d5 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000792 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000092c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000001d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000906 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000570 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000684 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000022 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000065a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.243 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006c4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005d0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000712 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000538 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000021 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000063c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000038 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000054c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.244 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000068a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000086e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008ba (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000930 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005a0 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005b2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004b1 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000782 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000056e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000876 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000050b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.245 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000886 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004cd (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000080 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000085e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000596 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000006d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000546 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000870 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000772 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000090c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007a2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000007b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.246 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000556 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000676 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000518 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000066 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000762 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005de (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000061 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000007e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.247 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.248 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000053a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006bc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000094c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000008b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000509 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005c8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000503 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000670 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004bb (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000552 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000740 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.249 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000068 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000858 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004c7 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000032 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000652 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000005d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005dc (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000680 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000033 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005ac (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000058 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000800 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000059 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006a4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004bf (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000004ad (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008b6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000838 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.251 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000866 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000720 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000900 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000081a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000008e6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000007ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000083e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000005a8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000006ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000616 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.252 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000052c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000894 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000091c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000042 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000039 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000005e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000005b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000005a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000003a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD) see mds.c log and `damage ls` output for details 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.253 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000443 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000049d (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000429 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000425 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000423 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000449 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000044b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000049f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000491 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000042b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000048f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.254 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000495 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000451 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000439 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000045f (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000416 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000441 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000499 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000455 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000433 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000435 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000046b (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.255 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000447 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000445 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001e2 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000021c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000022a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001d8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.256 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000210 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ae (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001be (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ec (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ee (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001c6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000023c (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000242 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001e4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000021a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ce (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000020a (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000220 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.257 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000021e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ea (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001d6 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000222 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001ca (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x1000000022e (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out) see mds.b log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001fa (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001f8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001e8 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000236 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.258 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x100000001d4 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.259 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000240 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.259 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: Scrub error on inode 0x10000000212 (/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.f log and `damage ls` output for details 2023-10-08T13:29:10.259 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:09 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:10.295 INFO:tasks.workunit.client.0.smithi139.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-08T13:29:10.295 INFO:tasks.workunit.client.0.smithi139.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-08T13:29:10.296 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to print strings... printf 2023-10-08T13:29:10.297 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gcc... gcc 2023-10-08T13:29:10.377 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether the C compiler works... yes 2023-10-08T13:29:10.377 INFO:tasks.workunit.client.0.smithi139.stdout:checking for C compiler default output file name... a.out 2023-10-08T13:29:10.420 INFO:tasks.workunit.client.0.smithi139.stdout:checking for suffix of executables... 2023-10-08T13:29:10.457 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether we are cross compiling... no 2023-10-08T13:29:10.493 INFO:tasks.workunit.client.0.smithi139.stdout:checking for suffix of object files... o 2023-10-08T13:29:10.516 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether we are using the GNU C compiler... yes 2023-10-08T13:29:10.539 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether gcc accepts -g... yes 2023-10-08T13:29:10.575 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-08T13:29:10.579 INFO:tasks.workunit.client.0.smithi139.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-10-08T13:29:10.582 INFO:tasks.workunit.client.0.smithi139.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-10-08T13:29:10.583 INFO:tasks.workunit.client.0.smithi139.stdout:checking for egrep... /usr/bin/grep -E 2023-10-08T13:29:10.584 INFO:tasks.workunit.client.0.smithi139.stdout:checking for fgrep... /usr/bin/grep -F 2023-10-08T13:29:10.587 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ld used by gcc... /usr/bin/ld 2023-10-08T13:29:10.589 INFO:tasks.workunit.client.0.smithi139.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-10-08T13:29:10.594 INFO:tasks.workunit.client.0.smithi139.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-10-08T13:29:10.639 INFO:tasks.workunit.client.0.smithi139.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-10-08T13:29:10.639 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether ln -s works... yes 2023-10-08T13:29:10.646 INFO:tasks.workunit.client.0.smithi139.stdout:checking the maximum length of command line arguments... 1572864 2023-10-08T13:29:10.649 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-08T13:29:10.649 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-08T13:29:10.649 INFO:tasks.workunit.client.0.smithi139.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-10-08T13:29:10.650 INFO:tasks.workunit.client.0.smithi139.stdout:checking for objdump... objdump 2023-10-08T13:29:10.650 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to recognize dependent libraries... pass_all 2023-10-08T13:29:10.651 INFO:tasks.workunit.client.0.smithi139.stdout:checking for dlltool... no 2023-10-08T13:29:10.651 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-08T13:29:10.651 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ar... ar 2023-10-08T13:29:10.728 INFO:tasks.workunit.client.0.smithi139.stdout:checking for archiver @FILE support... @ 2023-10-08T13:29:10.728 INFO:tasks.workunit.client.0.smithi139.stdout:checking for strip... strip 2023-10-08T13:29:10.729 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ranlib... ranlib 2023-10-08T13:29:10.729 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gawk... gawk 2023-10-08T13:29:10.828 INFO:tasks.workunit.client.0.smithi139.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-10-08T13:29:10.829 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sysroot... no 2023-10-08T13:29:10.839 INFO:tasks.workunit.client.0.smithi139.stdout:checking for a working dd... /usr/bin/dd 2023-10-08T13:29:10.848 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-10-08T13:29:10.884 INFO:tasks.workunit.client.0.smithi139.stdout:checking for mt... no 2023-10-08T13:29:10.898 INFO:tasks.workunit.client.0.smithi139.stdout:checking if : is a manifest tool... no 2023-10-08T13:29:10.981 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to run the C preprocessor... gcc -E 2023-10-08T13:29:11.153 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ANSI C header files... yes 2023-10-08T13:29:11.184 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/types.h... yes 2023-10-08T13:29:11.222 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/stat.h... yes 2023-10-08T13:29:11.260 INFO:tasks.workunit.client.0.smithi139.stdout:checking for stdlib.h... yes 2023-10-08T13:29:11.300 INFO:tasks.workunit.client.0.smithi139.stdout:checking for string.h... yes 2023-10-08T13:29:11.338 INFO:tasks.workunit.client.0.smithi139.stdout:checking for memory.h... yes 2023-10-08T13:29:11.375 INFO:tasks.workunit.client.0.smithi139.stdout:checking for strings.h... yes 2023-10-08T13:29:11.416 INFO:tasks.workunit.client.0.smithi139.stdout:checking for inttypes.h... yes 2023-10-08T13:29:11.456 INFO:tasks.workunit.client.0.smithi139.stdout:checking for stdint.h... yes 2023-10-08T13:29:11.503 INFO:tasks.workunit.client.0.smithi139.stdout:checking for unistd.h... yes 2023-10-08T13:29:11.572 INFO:tasks.workunit.client.0.smithi139.stdout:checking for dlfcn.h... yes 2023-10-08T13:29:11.579 INFO:tasks.workunit.client.0.smithi139.stdout:checking for objdir... .libs 2023-10-08T13:29:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:11 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:11.426+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:11.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:11 smithi139 ceph-mon[99506]: pgmap v350: 129 pgs: 129 active+clean; 31 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 648 op/s 2023-10-08T13:29:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:11 smithi187 ceph-mon[104336]: pgmap v350: 129 pgs: 129 active+clean; 31 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 648 op/s 2023-10-08T13:29:11.816 INFO:tasks.workunit.client.0.smithi139.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-08T13:29:11.816 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-08T13:29:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:11 smithi155 ceph-mon[103467]: pgmap v350: 129 pgs: 129 active+clean; 31 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 648 op/s 2023-10-08T13:29:11.856 INFO:tasks.workunit.client.0.smithi139.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-08T13:29:11.905 INFO:tasks.workunit.client.0.smithi139.stdout:checking if gcc static flag -static works... no 2023-10-08T13:29:11.979 INFO:tasks.workunit.client.0.smithi139.stdout:checking if gcc supports -c -o file.o... yes 2023-10-08T13:29:11.980 INFO:tasks.workunit.client.0.smithi139.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-08T13:29:11.985 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-08T13:29:12.045 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether -lc should be explicitly linked in... no 2023-10-08T13:29:12.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:12 smithi139 ceph-mon[99506]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:12.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:12 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:29:12.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:12 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:12.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:12 smithi187 ceph-mon[104336]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:12.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:12 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:29:12.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:12 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:12.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:12 smithi155 ceph-mon[103467]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:12.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:12 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] up:active 2023-10-08T13:29:12.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:12 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:13 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:29:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:13 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:13.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:13 smithi187 ceph-mon[104336]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 671 op/s 2023-10-08T13:29:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:13 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:29:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:13 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:13 smithi155 ceph-mon[103467]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 671 op/s 2023-10-08T13:29:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:13 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] up:active 2023-10-08T13:29:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:13 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:13 smithi139 ceph-mon[99506]: pgmap v351: 129 pgs: 129 active+clean; 34 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 671 op/s 2023-10-08T13:29:14.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:14 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:29:14.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:14 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:14.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:14 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:29:14.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:14 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:14.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:14 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] up:active 2023-10-08T13:29:14.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:14 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:14.960 INFO:tasks.workunit.client.0.smithi139.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-08T13:29:14.960 INFO:tasks.workunit.client.0.smithi139.stdout:checking how to hardcode library paths into programs... immediate 2023-10-08T13:29:14.970 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether stripping libraries is possible... yes 2023-10-08T13:29:14.970 INFO:tasks.workunit.client.0.smithi139.stdout:checking if libtool supports shared libraries... yes 2023-10-08T13:29:14.970 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether to build shared libraries... yes 2023-10-08T13:29:14.970 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether to build static libraries... yes 2023-10-08T13:29:14.975 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gcc... (cached) gcc 2023-10-08T13:29:15.014 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-08T13:29:15.014 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T13:29:15.014 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-08T13:29:15.014 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gmake... /usr/bin/gmake 2023-10-08T13:29:15.014 INFO:tasks.workunit.client.0.smithi139.stderr:./configure: line 11956: test: $(SHELL): binary operator expected 2023-10-08T13:29:15.015 INFO:tasks.workunit.client.0.smithi139.stdout:checking for tar... /bin/tar 2023-10-08T13:29:15.015 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gzip... /bin/gzip 2023-10-08T13:29:15.024 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether gcc -MM is supported... yes 2023-10-08T13:29:15.025 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sort... /bin/sort 2023-10-08T13:29:15.025 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether ln -s works... yes 2023-10-08T13:29:15.025 INFO:tasks.workunit.client.0.smithi139.stdout:checking for rpm... /bin/rpm 2023-10-08T13:29:15.029 INFO:tasks.workunit.client.0.smithi139.stdout:checking for rpmbuild... no 2023-10-08T13:29:15.029 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ANSI C header files... (cached) yes 2023-10-08T13:29:15.438 INFO:tasks.workunit.client.0.smithi139.stdout:checking assert.h usability... yes 2023-10-08T13:29:15.453 INFO:tasks.workunit.client.0.smithi139.stdout:checking assert.h presence... yes 2023-10-08T13:29:15.453 INFO:tasks.workunit.client.0.smithi139.stdout:checking for assert.h... yes 2023-10-08T13:29:15.510 INFO:tasks.workunit.client.0.smithi139.stdout:checking bstring.h usability... no 2023-10-08T13:29:15.536 INFO:tasks.workunit.client.0.smithi139.stdout:checking bstring.h presence... no 2023-10-08T13:29:15.536 INFO:tasks.workunit.client.0.smithi139.stdout:checking for bstring.h... no 2023-10-08T13:29:15.603 INFO:tasks.workunit.client.0.smithi139.stdout:checking libgen.h usability... yes 2023-10-08T13:29:15.629 INFO:tasks.workunit.client.0.smithi139.stdout:checking libgen.h presence... yes 2023-10-08T13:29:15.629 INFO:tasks.workunit.client.0.smithi139.stdout:checking for libgen.h... yes 2023-10-08T13:29:15.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:15 smithi187 ceph-mon[104336]: pgmap v352: 129 pgs: 129 active+clean; 35 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 660 op/s 2023-10-08T13:29:15.734 INFO:tasks.workunit.client.0.smithi139.stdout:checking dirent.h usability... yes 2023-10-08T13:29:15.759 INFO:tasks.workunit.client.0.smithi139.stdout:checking dirent.h presence... yes 2023-10-08T13:29:15.759 INFO:tasks.workunit.client.0.smithi139.stdout:checking for dirent.h... yes 2023-10-08T13:29:15.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:15 smithi155 ceph-mon[103467]: pgmap v352: 129 pgs: 129 active+clean; 35 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 660 op/s 2023-10-08T13:29:15.902 INFO:tasks.workunit.client.0.smithi139.stdout:checking errno.h usability... yes 2023-10-08T13:29:15.920 INFO:tasks.workunit.client.0.smithi139.stdout:checking errno.h presence... yes 2023-10-08T13:29:15.920 INFO:tasks.workunit.client.0.smithi139.stdout:checking for errno.h... yes 2023-10-08T13:29:15.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:15 smithi139 ceph-mon[99506]: pgmap v352: 129 pgs: 129 active+clean; 35 MiB data, 527 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 660 op/s 2023-10-08T13:29:15.998 INFO:tasks.workunit.client.0.smithi139.stdout:checking malloc.h usability... yes 2023-10-08T13:29:16.021 INFO:tasks.workunit.client.0.smithi139.stdout:checking malloc.h presence... yes 2023-10-08T13:29:16.021 INFO:tasks.workunit.client.0.smithi139.stdout:checking for malloc.h... yes 2023-10-08T13:29:16.094 INFO:tasks.workunit.client.0.smithi139.stdout:checking uuid.h usability... no 2023-10-08T13:29:16.120 INFO:tasks.workunit.client.0.smithi139.stdout:checking uuid.h presence... no 2023-10-08T13:29:16.120 INFO:tasks.workunit.client.0.smithi139.stdout:checking for uuid.h... no 2023-10-08T13:29:16.175 INFO:tasks.workunit.client.0.smithi139.stdout:checking uuid/uuid.h usability... yes 2023-10-08T13:29:16.193 INFO:tasks.workunit.client.0.smithi139.stdout:checking uuid/uuid.h presence... yes 2023-10-08T13:29:16.193 INFO:tasks.workunit.client.0.smithi139.stdout:checking for uuid/uuid.h... yes 2023-10-08T13:29:16.249 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/uuid.h usability... no 2023-10-08T13:29:16.278 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/uuid.h presence... no 2023-10-08T13:29:16.278 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/uuid.h... no 2023-10-08T13:29:16.332 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/file.h usability... yes 2023-10-08T13:29:16.347 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/file.h presence... yes 2023-10-08T13:29:16.347 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/file.h... yes 2023-10-08T13:29:16.409 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fcntl.h usability... yes 2023-10-08T13:29:16.424 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fcntl.h presence... yes 2023-10-08T13:29:16.424 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/fcntl.h... yes 2023-10-08T13:29:16.484 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/syssgi.h usability... no 2023-10-08T13:29:16.513 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/syssgi.h presence... no 2023-10-08T13:29:16.513 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/syssgi.h... no 2023-10-08T13:29:16.590 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/param.h usability... yes 2023-10-08T13:29:16.661 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/param.h presence... yes 2023-10-08T13:29:16.661 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/param.h... yes 2023-10-08T13:29:16.675 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/stat.h... (cached) yes 2023-10-08T13:29:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:16 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:16.426+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:16 smithi139 ceph-mon[99506]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:16 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:29:16.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:16 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:16.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:16 smithi187 ceph-mon[104336]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:16.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:16 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:29:16.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:16 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:16.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:16 smithi155 ceph-mon[103467]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-08T13:29:16.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:16 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] up:active 2023-10-08T13:29:16.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:16 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:16.900 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/statvfs.h usability... yes 2023-10-08T13:29:16.914 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/statvfs.h presence... yes 2023-10-08T13:29:16.914 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/statvfs.h... yes 2023-10-08T13:29:16.970 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/time.h usability... yes 2023-10-08T13:29:16.985 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/time.h presence... yes 2023-10-08T13:29:16.985 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/time.h... yes 2023-10-08T13:29:17.038 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/ioctl.h usability... yes 2023-10-08T13:29:17.052 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/ioctl.h presence... yes 2023-10-08T13:29:17.052 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/ioctl.h... yes 2023-10-08T13:29:17.106 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/wait.h usability... yes 2023-10-08T13:29:17.122 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/wait.h presence... yes 2023-10-08T13:29:17.122 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/wait.h... yes 2023-10-08T13:29:17.138 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/types.h... (cached) yes 2023-10-08T13:29:17.142 INFO:tasks.workunit.client.0.smithi139.stdout:checking for strings.h... (cached) yes 2023-10-08T13:29:17.183 INFO:tasks.workunit.client.0.smithi139.stdout:checking err.h usability... yes 2023-10-08T13:29:17.197 INFO:tasks.workunit.client.0.smithi139.stdout:checking err.h presence... yes 2023-10-08T13:29:17.197 INFO:tasks.workunit.client.0.smithi139.stdout:checking for err.h... yes 2023-10-08T13:29:17.250 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/falloc.h usability... yes 2023-10-08T13:29:17.263 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/falloc.h presence... yes 2023-10-08T13:29:17.264 INFO:tasks.workunit.client.0.smithi139.stdout:checking for linux/falloc.h... yes 2023-10-08T13:29:17.322 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-08T13:29:17.349 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-08T13:29:17.349 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-08T13:29:17.397 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-08T13:29:17.423 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-08T13:29:17.423 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-08T13:29:17.472 INFO:tasks.workunit.client.0.smithi139.stdout:checking xfs/platform_defs.h usability... no 2023-10-08T13:29:17.500 INFO:tasks.workunit.client.0.smithi139.stdout:checking xfs/platform_defs.h presence... no 2023-10-08T13:29:17.500 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/platform_defs.h... no 2023-10-08T13:29:17.548 INFO:tasks.workunit.client.0.smithi139.stdout:checking btrfs/ioctl.h usability... no 2023-10-08T13:29:17.575 INFO:tasks.workunit.client.0.smithi139.stdout:checking btrfs/ioctl.h presence... no 2023-10-08T13:29:17.576 INFO:tasks.workunit.client.0.smithi139.stdout:checking for btrfs/ioctl.h... no 2023-10-08T13:29:17.622 INFO:tasks.workunit.client.0.smithi139.stdout:checking cifs/ioctl.h usability... no 2023-10-08T13:29:17.648 INFO:tasks.workunit.client.0.smithi139.stdout:checking cifs/ioctl.h presence... no 2023-10-08T13:29:17.648 INFO:tasks.workunit.client.0.smithi139.stdout:checking for cifs/ioctl.h... no 2023-10-08T13:29:17.692 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/mman.h usability... yes 2023-10-08T13:29:17.707 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/mman.h presence... yes 2023-10-08T13:29:17.707 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/mman.h... yes 2023-10-08T13:29:17.756 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/xfs_log_format.h... no 2023-10-08T13:29:17.821 INFO:tasks.workunit.client.0.smithi139.stdout:checking for uuid_compare... no 2023-10-08T13:29:17.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:17 smithi155 ceph-mon[103467]: pgmap v353: 129 pgs: 129 active+clean; 50 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 823 op/s 2023-10-08T13:29:17.868 INFO:tasks.workunit.client.0.smithi139.stdout:checking for uuid_compare in -luuid... yes 2023-10-08T13:29:17.921 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/xfs.h... yes 2023-10-08T13:29:17.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:17 smithi139 ceph-mon[99506]: pgmap v353: 129 pgs: 129 active+clean; 50 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 823 op/s 2023-10-08T13:29:17.955 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/libxfs.h... no 2023-10-08T13:29:17.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:17 smithi187 ceph-mon[104336]: pgmap v353: 129 pgs: 129 active+clean; 50 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 823 op/s 2023-10-08T13:29:17.988 INFO:tasks.workunit.client.0.smithi139.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-08T13:29:18.027 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/xqm.h... yes 2023-10-08T13:29:18.087 INFO:tasks.workunit.client.0.smithi139.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-08T13:29:18.130 INFO:tasks.workunit.client.0.smithi139.stdout:checking xfs/handle.h usability... yes 2023-10-08T13:29:18.144 INFO:tasks.workunit.client.0.smithi139.stdout:checking xfs/handle.h presence... yes 2023-10-08T13:29:18.144 INFO:tasks.workunit.client.0.smithi139.stdout:checking for xfs/handle.h... yes 2023-10-08T13:29:18.207 INFO:tasks.workunit.client.0.smithi139.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-08T13:29:18.261 INFO:tasks.workunit.client.0.smithi139.stdout:checking attr/attributes.h usability... yes 2023-10-08T13:29:18.275 INFO:tasks.workunit.client.0.smithi139.stdout:checking attr/attributes.h presence... yes 2023-10-08T13:29:18.276 INFO:tasks.workunit.client.0.smithi139.stdout:checking for attr/attributes.h... yes 2023-10-08T13:29:18.332 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/attributes.h usability... no 2023-10-08T13:29:18.358 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/attributes.h presence... no 2023-10-08T13:29:18.358 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/attributes.h... no 2023-10-08T13:29:18.410 INFO:tasks.workunit.client.0.smithi139.stdout:checking for attr_list in -lattr... yes 2023-10-08T13:29:18.462 INFO:tasks.workunit.client.0.smithi139.stdout:checking for attr_set in -lattr... yes 2023-10-08T13:29:18.513 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/acl.h usability... yes 2023-10-08T13:29:18.530 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/acl.h presence... yes 2023-10-08T13:29:18.530 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/acl.h... yes 2023-10-08T13:29:18.583 INFO:tasks.workunit.client.0.smithi139.stdout:checking acl/libacl.h usability... yes 2023-10-08T13:29:18.598 INFO:tasks.workunit.client.0.smithi139.stdout:checking acl/libacl.h presence... yes 2023-10-08T13:29:18.599 INFO:tasks.workunit.client.0.smithi139.stdout:checking for acl/libacl.h... yes 2023-10-08T13:29:18.689 INFO:tasks.workunit.client.0.smithi139.stdout:checking for acl_init in -lacl... yes 2023-10-08T13:29:18.732 INFO:tasks.workunit.client.0.smithi139.stdout:checking gdbm-ndbm.h usability... no 2023-10-08T13:29:18.760 INFO:tasks.workunit.client.0.smithi139.stdout:checking gdbm-ndbm.h presence... no 2023-10-08T13:29:18.760 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gdbm-ndbm.h... no 2023-10-08T13:29:18.801 INFO:tasks.workunit.client.0.smithi139.stdout:checking gdbm/ndbm.h usability... no 2023-10-08T13:29:18.826 INFO:tasks.workunit.client.0.smithi139.stdout:checking gdbm/ndbm.h presence... no 2023-10-08T13:29:18.826 INFO:tasks.workunit.client.0.smithi139.stdout:checking for gdbm/ndbm.h... no 2023-10-08T13:29:18.866 INFO:tasks.workunit.client.0.smithi139.stdout:checking ndbm.h usability... no 2023-10-08T13:29:18.892 INFO:tasks.workunit.client.0.smithi139.stdout:checking ndbm.h presence... no 2023-10-08T13:29:18.892 INFO:tasks.workunit.client.0.smithi139.stdout:checking for ndbm.h... no 2023-10-08T13:29:18.931 INFO:tasks.workunit.client.0.smithi139.stdout:checking libaio.h usability... yes 2023-10-08T13:29:18.948 INFO:tasks.workunit.client.0.smithi139.stdout:checking libaio.h presence... yes 2023-10-08T13:29:18.948 INFO:tasks.workunit.client.0.smithi139.stdout:checking for libaio.h... yes 2023-10-08T13:29:19.008 INFO:tasks.workunit.client.0.smithi139.stdout:checking for dm_make_handle in -ldm... no 2023-10-08T13:29:19.008 INFO:tasks.workunit.client.0.smithi139.stdout: 2023-10-08T13:29:19.009 INFO:tasks.workunit.client.0.smithi139.stdout:WARNING: could not find a valid DMAPI base library. 2023-10-08T13:29:19.009 INFO:tasks.workunit.client.0.smithi139.stdout:If you want DMAPI support please install the data migration 2023-10-08T13:29:19.009 INFO:tasks.workunit.client.0.smithi139.stdout:API (dmapi) library package. Alternatively, run "make install" 2023-10-08T13:29:19.009 INFO:tasks.workunit.client.0.smithi139.stdout:from the dmapi source. 2023-10-08T13:29:19.009 INFO:tasks.workunit.client.0.smithi139.stdout: 2023-10-08T13:29:19.044 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/fiemap.h usability... yes 2023-10-08T13:29:19.058 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/fiemap.h presence... yes 2023-10-08T13:29:19.058 INFO:tasks.workunit.client.0.smithi139.stdout:checking for linux/fiemap.h... yes 2023-10-08T13:29:19.108 INFO:tasks.workunit.client.0.smithi139.stdout:checking for fallocate... yes 2023-10-08T13:29:19.159 INFO:tasks.workunit.client.0.smithi139.stdout:checking for open_by_handle_at... yes 2023-10-08T13:29:19.205 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/prctl.h usability... yes 2023-10-08T13:29:19.221 INFO:tasks.workunit.client.0.smithi139.stdout:checking sys/prctl.h presence... yes 2023-10-08T13:29:19.221 INFO:tasks.workunit.client.0.smithi139.stdout:checking for sys/prctl.h... yes 2023-10-08T13:29:19.267 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/fs.h usability... yes 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 -- 172.21.15.139:0/432460287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc04105670 msgr2=0x7efc04105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/432460287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc04105670 0x7efc04105a50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efc00009990 tx=0x7efc00009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 -- 172.21.15.139:0/432460287 shutdown_connections 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/432460287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc0410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/432460287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc04105670 0x7efc04105a50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/432460287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc040ff8d0 0x7efc040ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 -- 172.21.15.139:0/432460287 >> 172.21.15.139:0/432460287 conn(0x7efc040764c0 msgr2=0x7efc040768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 -- 172.21.15.139:0/432460287 shutdown_connections 2023-10-08T13:29:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 -- 172.21.15.139:0/432460287 wait complete. 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.271+0000 7efc0bdbd700 1 Processor -- start 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 -- start start 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc04197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc04105670 0x7efc041a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041986a0 con 0x7efc040ff8d0 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041a2ed0 con 0x7efc04105670 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0bdbd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc041a3010 con 0x7efc04100290 2023-10-08T13:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc04197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41876/0 (socket says 172.21.15.139:41876) 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc0a35a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc04105670 0x7efc041a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09b59700 1 -- 172.21.15.139:0/3577907862 learned_addr learned my addr 172.21.15.139:0/3577907862 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 -- 172.21.15.139:0/3577907862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc04105670 msgr2=0x7efc041a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc04105670 0x7efc041a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 -- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 msgr2=0x7efc04197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 -- 172.21.15.139:0/3577907862 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000095f0 con 0x7efc04100290 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09b59700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.272+0000 7efc09358700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc04197e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e9f0 tx=0x7efbf400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.273+0000 7efbfaffd700 1 -- 172.21.15.139:0/3577907862 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400c9c0 con 0x7efc04100290 2023-10-08T13:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.273+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc041a3270 con 0x7efc04100290 2023-10-08T13:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.273+0000 7efbfaffd700 1 -- 172.21.15.139:0/3577907862 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbf4010430 con 0x7efc04100290 2023-10-08T13:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.273+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc041a37d0 con 0x7efc04100290 2023-10-08T13:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.273+0000 7efbfaffd700 1 -- 172.21.15.139:0/3577907862 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4018680 con 0x7efc04100290 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.275+0000 7efbfaffd700 1 -- 172.21.15.139:0/3577907862 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7efbf40187e0 con 0x7efc04100290 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.276+0000 7efbfaffd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 0x7efbf00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.276+0000 7efc09b59700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 0x7efbf00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.276+0000 7efbfaffd700 1 -- 172.21.15.139:0/3577907862 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7efbf4014070 con 0x7efc04100290 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.276+0000 7efc17fa6b80 1 Processor -- start 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.276+0000 7efc09b59700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 0x7efbf00a3ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc0000b2e0 tx=0x7efc00005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 -- start start 2023-10-08T13:29:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 0x5583a46d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a462f400 con 0x5583a46cb170 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a4620bc0 con 0x5583a46cfe60 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a461e4e0 con 0x5583a46cba90 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41884/0 (socket says 172.21.15.139:41884) 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc09b59700 1 -- 172.21.15.139:0/1455920622 learned_addr learned my addr 172.21.15.139:0/1455920622 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 0x5583a46d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc09358700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 -- 172.21.15.139:0/1455920622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 msgr2=0x5583a46cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 -- 172.21.15.139:0/1455920622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 msgr2=0x5583a46cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc0a35a700 1 -- 172.21.15.139:0/1455920622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583a4444d80 con 0x5583a46cfe60 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.277+0000 7efc09b59700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 0x5583a46d02a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efbfc011550 tx=0x7efbfc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef5583f2f14144e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efbeffff700 1 -- 172.21.15.139:0/1455920622 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00e040 con 0x5583a46cfe60 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efbeffff700 1 -- 172.21.15.139:0/1455920622 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbfc00f040 con 0x5583a46cfe60 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efbeffff700 1 -- 172.21.15.139:0/1455920622 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc004450 con 0x5583a46cfe60 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1455920622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 msgr2=0x5583a46d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 0x5583a46d02a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efbfc011550 tx=0x7efbfc009920 comp rx=0 tx=0).stop 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1455920622 shutdown_connections 2023-10-08T13:29:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cfe60 0x5583a46d02a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1455920622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.278+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1455920622 >> 172.21.15.139:0/1455920622 conn(0x5583a463b200 msgr2=0x5583a46c1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1455920622 shutdown_connections 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1455920622 wait complete. 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- start start 2023-10-08T13:29:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 Processor -- start 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a4619dd0 con 0x5583a46cfe60 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a45b66b0 con 0x5583a46cb170 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a45b6350 con 0x5583a46cba90 2023-10-08T13:29:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.279+0000 7efc17fa6b80 10 client.0 _ll_register_callbacks cb 0x5583a44137a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09b59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09358700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09b59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60410/0 (socket says 172.21.15.139:60410) 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09358700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41608/0 (socket says 172.21.15.139:41608) 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09b59700 1 -- 172.21.15.139:0/1881743890 learned_addr learned my addr 172.21.15.139:0/1881743890 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 -- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 msgr2=0x5583a46d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 -- 172.21.15.139:0/1881743890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 msgr2=0x5583a46d7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 -- 172.21.15.139:0/1881743890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0410cda0 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09b59700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc09358700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc0a35a700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46d4ef0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efbfc000f80 tx=0x7efbfc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76b3d1205433a3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efbed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00e040 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7efbfc003e30 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583a45e1e50 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbfc004d60 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc17fa6b80 10 client.16494 fetch_fsmap learned FSMap version 32 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7efbfc011230 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.280+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5583a45e1e50 con 0x5583a46cfe60 2023-10-08T13:29:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efbfc01b020 con 0x5583a46cfe60 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 10 client.16494 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 20 client.16494 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a46e4fc0 0x5583a46e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 4 client.16494 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583a4612db0 con 0x5583a46e4fc0 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc09b59700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a46e4fc0 0x5583a46e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efbed7fa700 10 client.16494 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.281+0000 7efc09b59700 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a46e4fc0 0x5583a46e73e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4978edf01eed404 server_cookie=ada8988978cd3391 in_seq=0 out_seq=0 2023-10-08T13:29:19.290 INFO:tasks.workunit.client.0.smithi139.stdout:checking linux/fs.h presence... yes 2023-10-08T13:29:19.290 INFO:tasks.workunit.client.0.smithi139.stdout:checking for linux/fs.h... yes 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efbed7fa700 1 -- 172.21.15.139:0/1881743890 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5583a4612db0 con 0x5583a46e4fc0 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efbed7fa700 10 client.16494 handle_command_reply: tid=0 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 client.16494 shutdown 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 msgr2=0x5583a46d4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46d4ef0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efbfc000f80 tx=0x7efbfc0042f0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 shutdown_connections 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46d4ef0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a46e4fc0 0x5583a46e73e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46d7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efbed7fa700 0 client.16494 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/1881743890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 >> 172.21.15.139:0/1881743890 conn(0x5583a463b200 msgr2=0x5583a46c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 shutdown_connections 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 1 -- 172.21.15.139:0/1881743890 wait complete. 2023-10-08T13:29:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.283+0000 7efc17fa6b80 20 client.16494 trim_cache size 0 max 16384 2023-10-08T13:29:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 Processor -- start 2023-10-08T13:29:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 -- start start 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46dc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a449a8c0 con 0x5583a46cfe60 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a46c3350 con 0x5583a46cb170 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.298+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a46cc170 con 0x5583a46cba90 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc0a35a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60418/0 (socket says 172.21.15.139:60418) 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc0a35a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41902/0 (socket says 172.21.15.139:41902) 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 -- 172.21.15.139:0/3824184169 learned_addr learned my addr 172.21.15.139:0/3824184169 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09358700 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 -- 172.21.15.139:0/3824184169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 msgr2=0x5583a46dc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46dc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 -- 172.21.15.139:0/3824184169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 msgr2=0x5583a46c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 -- 172.21.15.139:0/3824184169 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583a442dc00 con 0x5583a46cb170 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc0a35a700 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efc09b59700 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc00005910 tx=0x7efc00020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddfa53d443456d1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efbf8ff9700 1 -- 172.21.15.139:0/3824184169 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0002b040 con 0x5583a46cb170 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efbf8ff9700 1 -- 172.21.15.139:0/3824184169 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc0002c040 con 0x5583a46cb170 2023-10-08T13:29:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.299+0000 7efbf8ff9700 1 -- 172.21.15.139:0/3824184169 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00024c50 con 0x5583a46cb170 2023-10-08T13:29:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3824184169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 msgr2=0x5583a46c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc00005910 tx=0x7efc00020000 comp rx=0 tx=0).stop 2023-10-08T13:29:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3824184169 shutdown_connections 2023-10-08T13:29:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cfe60 0x5583a46c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cb170 0x5583a46c6270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3824184169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cba90 0x5583a46dc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3824184169 >> 172.21.15.139:0/3824184169 conn(0x5583a463b200 msgr2=0x5583a46c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3824184169 shutdown_connections 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3824184169 wait complete. 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 -- start start 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.300+0000 7efc17fa6b80 1 Processor -- start 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cba90 0x5583a46da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cfe60 0x5583a46daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a4737df0 con 0x5583a46cb170 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a4737f30 con 0x5583a46cba90 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583a4738070 con 0x5583a46cfe60 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 10 client.0 _ll_register_callbacks cb 0x7efc00005650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41904/0 (socket says 172.21.15.139:41904) 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 -- 172.21.15.139:0/3423813017 learned_addr learned my addr 172.21.15.139:0/3423813017 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc0a35a700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cfe60 0x5583a46daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09358700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cba90 0x5583a46da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 -- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cfe60 msgr2=0x5583a46daa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cfe60 0x5583a46daa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 -- 172.21.15.139:0/3423813017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cba90 msgr2=0x5583a46da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cba90 0x5583a46da540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 -- 172.21.15.139:0/3423813017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc011230 con 0x5583a46cb170 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc09b59700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efc000093c0 tx=0x7efc0000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f492bacac803acb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efbed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0002b030 con 0x5583a46cb170 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbfc00f040 con 0x5583a46cb170 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.301+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7efc00036360 con 0x5583a46cb170 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc00036520 con 0x5583a46cb170 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 10 client.16500 fetch_fsmap learned FSMap version 32 2023-10-08T13:29:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7efc0000fa90 con 0x5583a46cb170 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbfc00f040 con 0x5583a46cb170 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 32) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efc000337e0 con 0x5583a46cb170 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 10 client.16500 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 20 client.16500 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a4739510 0x5583a473b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 4 client.16500 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5583a4612ad0 con 0x5583a4739510 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.302+0000 7efc09358700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a4739510 0x5583a473b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.303+0000 7efbed7fa700 10 client.16500 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.303+0000 7efc09358700 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a4739510 0x5583a473b930 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954e17e51ecf7be3 server_cookie=9ac685e2d3e846ec in_seq=0 out_seq=0 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efbed7fa700 1 -- 172.21.15.139:0/3423813017 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5583a4612ad0 con 0x5583a4739510 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efbed7fa700 10 client.16500 handle_command_reply: tid=0 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 client.16500 shutdown 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 msgr2=0x5583a46da000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efc000093c0 tx=0x7efc0000bf60 comp rx=0 tx=0).stop 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 shutdown_connections 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583a46cfe60 0x5583a46daa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a46cb170 0x5583a46da000 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583a4739510 0x5583a473b930 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 --2- 172.21.15.139:0/3423813017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583a46cba90 0x5583a46da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efbed7fa700 0 client.16500 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 >> 172.21.15.139:0/3423813017 conn(0x5583a463b200 msgr2=0x5583a46ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 shutdown_connections 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.457+0000 7efc17fa6b80 1 -- 172.21.15.139:0/3423813017 wait complete. 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc17fa6b80 20 client.16500 trim_cache size 0 max 16384 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:29:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:29:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:29:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:29:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 msgr2=0x7efbf00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 0x7efbf00a3ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc0000b2e0 tx=0x7efc00005bc0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 msgr2=0x7efc04197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc04197e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e9f0 tx=0x7efbf400ed00 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 shutdown_connections 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efbf00a15f0 0x7efbf00a3ab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc04105670 0x7efc041a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc040ff8d0 0x7efc04197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 --2- 172.21.15.139:0/3577907862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc04100290 0x7efc04197e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 >> 172.21.15.139:0/3577907862 conn(0x7efc040764c0 msgr2=0x7efc040fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:19.462 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 shutdown_connections 2023-10-08T13:29:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:19.458+0000 7efc0bdbd700 1 -- 172.21.15.139:0/3577907862 wait complete. 2023-10-08T13:29:19.466 INFO:tasks.workunit.client.0.smithi139.stdout:checking btrfsutil.h usability... no 2023-10-08T13:29:19.492 INFO:tasks.workunit.client.0.smithi139.stdout:checking btrfsutil.h presence... no 2023-10-08T13:29:19.492 INFO:tasks.workunit.client.0.smithi139.stdout:checking for btrfsutil.h... no 2023-10-08T13:29:19.553 INFO:tasks.workunit.client.0.smithi139.stdout:checking for copy_file_range... yes 2023-10-08T13:29:19.610 INFO:tasks.workunit.client.0.smithi139.stdout:checking for renameat2... yes 2023-10-08T13:29:19.635 INFO:tasks.workunit.client.0.smithi139.stdout:configure: creating ./config.status 2023-10-08T13:29:19.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:19 smithi187 ceph-mon[104336]: pgmap v354: 129 pgs: 129 active+clean; 52 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 721 op/s 2023-10-08T13:29:19.978 INFO:tasks.workunit.client.0.smithi139.stdout:config.status: creating include/builddefs 2023-10-08T13:29:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:19 smithi155 ceph-mon[103467]: pgmap v354: 129 pgs: 129 active+clean; 52 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 721 op/s 2023-10-08T13:29:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:19 smithi139 ceph-mon[99506]: pgmap v354: 129 pgs: 129 active+clean; 52 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 721 op/s 2023-10-08T13:29:21.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:21 smithi139 ceph-mon[99506]: pgmap v355: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 662 op/s 2023-10-08T13:29:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:21 smithi187 ceph-mon[104336]: pgmap v355: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 662 op/s 2023-10-08T13:29:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:21 smithi155 ceph-mon[103467]: pgmap v355: 129 pgs: 129 active+clean; 51 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.6 MiB/s wr, 662 op/s 2023-10-08T13:29:22.100 INFO:tasks.workunit.client.0.smithi139.stdout:config.status: creating include/config.h 2023-10-08T13:29:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:23 smithi187 ceph-mon[104336]: pgmap v356: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 522 op/s 2023-10-08T13:29:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:23 smithi155 ceph-mon[103467]: pgmap v356: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 522 op/s 2023-10-08T13:29:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:23 smithi139 ceph-mon[99506]: pgmap v356: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 522 op/s 2023-10-08T13:29:25.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:25 smithi187 ceph-mon[104336]: pgmap v357: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 501 op/s 2023-10-08T13:29:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:25 smithi155 ceph-mon[103467]: pgmap v357: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 501 op/s 2023-10-08T13:29:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:25 smithi139 ceph-mon[99506]: pgmap v357: 129 pgs: 129 active+clean; 44 MiB data, 591 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 501 op/s 2023-10-08T13:29:26.656 INFO:tasks.workunit.client.0.smithi139.stdout:config.status: executing libtool commands 2023-10-08T13:29:26.830 INFO:tasks.workunit.client.0.smithi139.stdout:Building include 2023-10-08T13:29:26.830 INFO:tasks.workunit.client.0.smithi139.stdout:Building lib 2023-10-08T13:29:26.830 INFO:tasks.workunit.client.0.smithi139.stdout:Building tests 2023-10-08T13:29:26.838 INFO:tasks.workunit.client.0.smithi139.stdout: [LTDEP] 2023-10-08T13:29:27.160 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dataascii.lo 2023-10-08T13:29:27.160 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] databin.lo 2023-10-08T13:29:27.160 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] datapid.lo 2023-10-08T13:29:27.160 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] file_lock.lo 2023-10-08T13:29:27.325 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] forker.lo 2023-10-08T13:29:27.339 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] pattern.lo 2023-10-08T13:29:27.366 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] random_range.lo 2023-10-08T13:29:27.367 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] open_flags.lo 2023-10-08T13:29:27.537 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] str_to_bytes.lo 2023-10-08T13:29:27.537 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] string_to_tokens.lo 2023-10-08T13:29:27.556 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] tlibio.lo 2023-10-08T13:29:27.651 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] write_log.lo 2023-10-08T13:29:27.708 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] random.lo 2023-10-08T13:29:27.948 INFO:tasks.workunit.client.0.smithi139.stdout: [LD] 2023-10-08T13:29:27.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: pgmap v358: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.979 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.981 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.982 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.984 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.985 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:27.986 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:27 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.055 INFO:tasks.workunit.client.0.smithi139.stdout:Building ltp 2023-10-08T13:29:28.055 INFO:tasks.workunit.client.0.smithi139.stdout:Building src 2023-10-08T13:29:28.055 INFO:tasks.workunit.client.0.smithi139.stdout:Building m4 2023-10-08T13:29:28.056 INFO:tasks.workunit.client.0.smithi139.stdout:Building common 2023-10-08T13:29:28.063 INFO:tasks.workunit.client.0.smithi139.stdout: [DEP] 2023-10-08T13:29:28.084 INFO:tasks.workunit.client.0.smithi139.stdout: [DEP] 2023-10-08T13:29:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: pgmap v358: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.100 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.102 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.104 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.105 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:28.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:27 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: pgmap v358: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 460 op/s 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.192 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.193 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.194 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.195 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.196 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.197 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.198 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:28.199 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:27 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.342 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] doio 2023-10-08T13:29:28.342 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fsstress 2023-10-08T13:29:28.342 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fsx 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c: In function 'attr_list_path': 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c:859:2: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr: rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~ 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr:In file included from ../src/global.h:25, 2023-10-08T13:29:28.547 INFO:tasks.workunit.client.0.smithi139.stderr: from fsstress.c:12: 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~ 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c: In function 'attr_remove_path': 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c:878:2: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: rval = attr_remove(name->path, attrname, flags); 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~ 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr:In file included from ../src/global.h:25, 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: from fsstress.c:12: 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: extern int attr_remove (const char *__path, const char *__attrname, 2023-10-08T13:29:28.548 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~ 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c: In function 'attr_set_path': 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr:fsstress.c:898:2: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr: rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~ 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr:In file included from ../src/global.h:25, 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr: from fsstress.c:12: 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-10-08T13:29:28.549 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~ 2023-10-08T13:29:28.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:28.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:28.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:28.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:28.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:28 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.071 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] growfiles 2023-10-08T13:29:29.082 INFO:tasks.workunit.client.0.smithi139.stderr:fsx.c: In function 'main': 2023-10-08T13:29:29.082 INFO:tasks.workunit.client.0.smithi139.stderr:fsx.c:2662:5: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-10-08T13:29:29.083 INFO:tasks.workunit.client.0.smithi139.stderr: strncpy(opsfile, optarg, sizeof(opsfile)); 2023-10-08T13:29:29.083 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:29.083 INFO:tasks.workunit.client.0.smithi139.stderr:fsx.c:2632:4: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2023-10-08T13:29:29.083 INFO:tasks.workunit.client.0.smithi139.stderr: strncpy(dname, optarg, sizeof(dname)); 2023-10-08T13:29:29.083 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:29.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:28 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:29.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:28 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:29.190 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] iogen 2023-10-08T13:29:29.436 INFO:tasks.workunit.client.0.smithi139.stdout: [DEP] 2023-10-08T13:29:29.473 INFO:tasks.workunit.client.0.smithi139.stdout: [DEP] 2023-10-08T13:29:29.487 INFO:tasks.workunit.client.0.smithi139.stdout: [DEP] 2023-10-08T13:29:29.591 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-stress 2023-10-08T13:29:29.696 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dirstress 2023-10-08T13:29:29.699 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fill 2023-10-08T13:29:29.734 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fill2 2023-10-08T13:29:29.914 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] getpagesize 2023-10-08T13:29:29.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:29 smithi187 ceph-mon[104336]: pgmap v359: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 708 KiB/s wr, 269 op/s 2023-10-08T13:29:30.005 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] holes 2023-10-08T13:29:30.006 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] lstat64 2023-10-08T13:29:30.086 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] nametest 2023-10-08T13:29:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:29 smithi155 ceph-mon[103467]: pgmap v359: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 708 KiB/s wr, 269 op/s 2023-10-08T13:29:30.117 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] permname 2023-10-08T13:29:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:29 smithi139 ceph-mon[99506]: pgmap v359: 129 pgs: 129 active+clean; 45 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 708 KiB/s wr, 269 op/s 2023-10-08T13:29:30.232 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] randholes 2023-10-08T13:29:30.232 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] runas 2023-10-08T13:29:30.359 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] truncfile 2023-10-08T13:29:30.364 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] usemem 2023-10-08T13:29:30.446 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] mmapcat 2023-10-08T13:29:30.518 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] append_reader 2023-10-08T13:29:30.553 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] append_writer 2023-10-08T13:29:30.610 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dirperf 2023-10-08T13:29:30.613 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] metaperf 2023-10-08T13:29:30.705 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] devzero 2023-10-08T13:29:30.758 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] feature 2023-10-08T13:29:30.858 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] alloc 2023-10-08T13:29:30.927 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fault 2023-10-08T13:29:30.928 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fstest 2023-10-08T13:29:31.006 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_access_root 2023-10-08T13:29:31.101 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] godown 2023-10-08T13:29:31.128 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c: In function 'run_child': 2023-10-08T13:29:31.128 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:95:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~ 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:95:17: note: directive argument in the range [0, 2147483647] 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~ 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:95:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:166:20: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.129 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~ 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:166:17: note: directive argument in the range [0, 2147483647] 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~ 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr:fstest.c:166:2: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr: sprintf(fname, "%s/file%d", dir, fnum); 2023-10-08T13:29:31.130 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:31.144 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] resvtest 2023-10-08T13:29:31.209 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] writemod 2023-10-08T13:29:31.213 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] writev_on_pagefault 2023-10-08T13:29:31.307 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] makeextents 2023-10-08T13:29:31.381 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] itrash 2023-10-08T13:29:31.382 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] rename 2023-10-08T13:29:31.414 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] multi_open_unlink 2023-10-08T13:29:31.539 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dmiperf 2023-10-08T13:29:31.540 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] unwritten_sync 2023-10-08T13:29:31.559 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] genhashnames 2023-10-08T13:29:31.575 INFO:tasks.workunit.client.0.smithi139.stderr:multi_open_unlink.c: In function 'main': 2023-10-08T13:29:31.575 INFO:tasks.workunit.client.0.smithi139.stderr:multi_open_unlink.c:101:4: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr: sts = attr_set(path, attrname, attrvalue, value_size, flags); 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~ 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr:In file included from multi_open_unlink.c:15: 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr: extern int attr_set (const char *__path, const char *__attrname, 2023-10-08T13:29:31.576 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~ 2023-10-08T13:29:31.633 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_holes 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr:dmiperf.c: In function 'mkfile': 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr:dmiperf.c:192:2: warning: 'attr_setf' is deprecated: Use fsetxattr instead [-Wdeprecated-declarations] 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr: if (attr_setf(fd, DMFATTRNAME, attr, DMFATTRLEN, ATTR_ROOT) < 0) { 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr: ^~ 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr:In file included from dmiperf.c:20: 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr:/usr/include/attr/attributes.h:143:12: note: declared here 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr: extern int attr_setf (int __fd, const char *__attrname, 2023-10-08T13:29:31.716 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~ 2023-10-08T13:29:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:31 smithi187 ceph-mon[104336]: pgmap v360: 129 pgs: 129 active+clean; 45 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 541 KiB/s wr, 198 op/s 2023-10-08T13:29:31.751 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_writev 2023-10-08T13:29:31.784 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_truncate_cmtime 2023-10-08T13:29:31.811 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dirhash_collide 2023-10-08T13:29:31.818 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_rename_overwrite 2023-10-08T13:29:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:31 smithi155 ceph-mon[103467]: pgmap v360: 129 pgs: 129 active+clean; 45 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 541 KiB/s wr, 198 op/s 2023-10-08T13:29:31.920 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] holetest 2023-10-08T13:29:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:31 smithi139 ceph-mon[99506]: pgmap v360: 129 pgs: 129 active+clean; 45 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 541 KiB/s wr, 198 op/s 2023-10-08T13:29:31.999 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_truncate_self 2023-10-08T13:29:32.001 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_dio 2023-10-08T13:29:32.035 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] af_unix 2023-10-08T13:29:32.165 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_stale_pmd 2023-10-08T13:29:32.188 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_cow_race 2023-10-08T13:29:32.205 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_fallocate 2023-10-08T13:29:32.242 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fsync-err 2023-10-08T13:29:32.366 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_write_ro 2023-10-08T13:29:32.397 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-08T13:29:32.399 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-08T13:29:32.456 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_ofd_locks 2023-10-08T13:29:32.585 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_locks_execve 2023-10-08T13:29:32.587 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mmap_collision 2023-10-08T13:29:32.596 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] mmap-write-concurrent 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 -- 172.21.15.139:0/468308399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0ff5d0 msgr2=0x7fb51c0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 --2- 172.21.15.139:0/468308399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c0ffa50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb510009990 tx=0x7fb510009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 -- 172.21.15.139:0/468308399 shutdown_connections 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 --2- 172.21.15.139:0/468308399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c0fff90 0x7fb51c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 --2- 172.21.15.139:0/468308399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c1045e0 0x7fb51c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 --2- 172.21.15.139:0/468308399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c0ffa50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 -- 172.21.15.139:0/468308399 >> 172.21.15.139:0/468308399 conn(0x7fb51c076790 msgr2=0x7fb51c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 -- 172.21.15.139:0/468308399 shutdown_connections 2023-10-08T13:29:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.609+0000 7fb522634700 1 -- 172.21.15.139:0/468308399 wait complete. 2023-10-08T13:29:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 Processor -- start 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 -- start start 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0fff90 0x7fb51c1a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 0x7fb51c19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19da90 con 0x7fb51c1045e0 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19dc00 con 0x7fb51c0fff90 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.610+0000 7fb522634700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb51c19ddc0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41634/0 (socket says 172.21.15.139:41634) 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 -- 172.21.15.139:0/2007915606 learned_addr learned my addr 172.21.15.139:0/2007915606 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0fff90 0x7fb51c1a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb520bd1700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 0x7fb51c19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 -- 172.21.15.139:0/2007915606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0fff90 msgr2=0x7fb51c1a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0fff90 0x7fb51c1a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 -- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 msgr2=0x7fb51c19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 0x7fb51c19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 -- 172.21.15.139:0/2007915606 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100095f0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb520bd1700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 0x7fb51c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e970 tx=0x7fb50c00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb5197fa700 1 -- 172.21.15.139:0/2007915606 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c009790 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb5197fa700 1 -- 172.21.15.139:0/2007915606 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50c00eec0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb51c19e0a0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.611+0000 7fb5197fa700 1 -- 172.21.15.139:0/2007915606 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c003cf0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.612+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51c1a9f20 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.614+0000 7fb5197fa700 1 -- 172.21.15.139:0/2007915606 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb50c00ccd0 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.615+0000 7fb5197fa700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 0x7fb5040a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.615+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 0x7fb5040a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.615+0000 7fb5197fa700 1 -- 172.21.15.139:0/2007915606 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb50c014070 con 0x7fb51c0ff5d0 2023-10-08T13:29:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.615+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 0x7fb5040a3b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b2e0 tx=0x7fb510005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.616+0000 7fb52e81db80 1 Processor -- start 2023-10-08T13:29:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.616+0000 7fb52e81db80 1 -- start start 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d38c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 0x55e2a0d32b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c9b400 con 0x55e2a0d391a0 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c8cbc0 con 0x55e2a0d330b0 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb52e81db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c8a4e0 con 0x55e2a0d38880 2023-10-08T13:29:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb520bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb520bd1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60450/0 (socket says 172.21.15.139:60450) 2023-10-08T13:29:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb520bd1700 1 -- 172.21.15.139:0/414961151 learned_addr learned my addr 172.21.15.139:0/414961151 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 0x55e2a0d32b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 -- 172.21.15.139:0/414961151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 msgr2=0x55e2a0d38c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d38c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 -- 172.21.15.139:0/414961151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 msgr2=0x55e2a0d33510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb51b7fe700 1 -- 172.21.15.139:0/414961151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a0ab0d80 con 0x55e2a0d391a0 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.617+0000 7fb520bd1700 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.618+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 0x55e2a0d32b70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb5100059d0 tx=0x7fb510020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25532112d3f4b06e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.618+0000 7fb5027fc700 1 -- 172.21.15.139:0/414961151 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510004700 con 0x55e2a0d391a0 2023-10-08T13:29:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.618+0000 7fb5027fc700 1 -- 172.21.15.139:0/414961151 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb51001e040 con 0x55e2a0d391a0 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.618+0000 7fb5027fc700 1 -- 172.21.15.139:0/414961151 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000fad0 con 0x55e2a0d391a0 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 -- 172.21.15.139:0/414961151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 msgr2=0x55e2a0d32b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 0x55e2a0d32b70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb5100059d0 tx=0x7fb510020000 comp rx=0 tx=0).stop 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 -- 172.21.15.139:0/414961151 shutdown_connections 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d33510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d38c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 --2- 172.21.15.139:0/414961151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d391a0 0x55e2a0d32b70 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.619+0000 7fb52e81db80 1 -- 172.21.15.139:0/414961151 >> 172.21.15.139:0/414961151 conn(0x55e2a0ca7200 msgr2=0x55e2a0d2db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.625+0000 7fb52e81db80 1 -- 172.21.15.139:0/414961151 shutdown_connections 2023-10-08T13:29:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.625+0000 7fb52e81db80 1 -- 172.21.15.139:0/414961151 wait complete. 2023-10-08T13:29:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.625+0000 7fb52e81db80 1 -- start start 2023-10-08T13:29:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.625+0000 7fb52e81db80 1 Processor -- start 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d3cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d3d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c85dd0 con 0x55e2a0d38880 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c226b0 con 0x55e2a0d330b0 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0c22350 con 0x55e2a0d391a0 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb52e81db80 10 client.0 _ll_register_callbacks cb 0x55e2a0a7f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb520bd1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d3d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60452/0 (socket says 172.21.15.139:60452) 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 -- 172.21.15.139:0/2956886661 learned_addr learned my addr 172.21.15.139:0/2956886661 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 -- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 msgr2=0x55e2a0d3d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d3d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 -- 172.21.15.139:0/2956886661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 msgr2=0x55e2a0d3cb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d3cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 -- 172.21.15.139:0/2956886661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb514009ca0 con 0x55e2a0d330b0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb51bfff700 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0967e0 tx=0x7fb50c099cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda2abbeaeeb83fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.626+0000 7fb4fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c09e430 con 0x55e2a0d330b0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb50c0a2670 con 0x55e2a0d330b0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2a0c4de50 con 0x55e2a0d330b0 2023-10-08T13:29:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb50c0cd2b0 con 0x55e2a0d330b0 2023-10-08T13:29:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 10 client.25958 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fb51c10cd90 con 0x55e2a0d330b0 2023-10-08T13:29:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2a0c4de50 con 0x55e2a0d330b0 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fb50c0a21e0 con 0x55e2a0d330b0 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 10 client.25958 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 10 client.25958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 20 client.25958 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0d4cdc0 0x55e2a0d4f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 4 client.25958 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.627+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2a0c7edb0 con 0x55e2a0d4cdc0 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.628+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0d4cdc0 0x55e2a0d4f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.628+0000 7fb4fb7fe700 10 client.25958 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.628+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0d4cdc0 0x55e2a0d4f1e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed48b920cde6c41 server_cookie=b0f6db9f79c0dd51 in_seq=0 out_seq=0 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/2956886661 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2a0c7edb0 con 0x55e2a0d4cdc0 2023-10-08T13:29:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb4fb7fe700 10 client.25958 handle_command_reply: tid=0 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 client.25958 shutdown 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 msgr2=0x55e2a0d3c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0967e0 tx=0x7fb50c099cc0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 shutdown_connections 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d3d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0d4cdc0 0x55e2a0d4f1e0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d3c5f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb4fb7fe700 0 client.25958 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 --2- 172.21.15.139:0/2956886661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d3cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 >> 172.21.15.139:0/2956886661 conn(0x55e2a0ca7200 msgr2=0x55e2a0d2d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 shutdown_connections 2023-10-08T13:29:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 1 -- 172.21.15.139:0/2956886661 wait complete. 2023-10-08T13:29:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.629+0000 7fb52e81db80 20 client.25958 trim_cache size 0 max 16384 2023-10-08T13:29:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 Processor -- start 2023-10-08T13:29:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 -- start start 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d4f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d2d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0b068c0 con 0x55e2a0d38880 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0d36300 con 0x55e2a0d330b0 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.653+0000 7fb52e81db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0d282b0 con 0x55e2a0d391a0 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d4f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb520bd1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb520bd1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41656/0 (socket says 172.21.15.139:41656) 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb520bd1700 1 -- 172.21.15.139:0/288317746 learned_addr learned my addr 172.21.15.139:0/288317746 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 -- 172.21.15.139:0/288317746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 msgr2=0x55e2a0d2dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 -- 172.21.15.139:0/288317746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 msgr2=0x55e2a0d2d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d2d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 -- 172.21.15.139:0/288317746 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a0a99c00 con 0x55e2a0d330b0 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb520bd1700 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb51bfff700 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d4f1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb50c005950 tx=0x7fb50c09a460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f644636031c616 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.654+0000 7fb502ffd700 1 -- 172.21.15.139:0/288317746 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c09a9e0 con 0x55e2a0d330b0 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.655+0000 7fb502ffd700 1 -- 172.21.15.139:0/288317746 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb50c0a2670 con 0x55e2a0d330b0 2023-10-08T13:29:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.655+0000 7fb502ffd700 1 -- 172.21.15.139:0/288317746 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c09a540 con 0x55e2a0d330b0 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.655+0000 7fb52e81db80 1 -- 172.21.15.139:0/288317746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 msgr2=0x55e2a0d4f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.655+0000 7fb52e81db80 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d4f1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb50c005950 tx=0x7fb50c09a460 comp rx=0 tx=0).stop 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 -- 172.21.15.139:0/288317746 shutdown_connections 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d391a0 0x55e2a0d2dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d330b0 0x55e2a0d4f1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 --2- 172.21.15.139:0/288317746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d38880 0x55e2a0d2d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 -- 172.21.15.139:0/288317746 >> 172.21.15.139:0/288317746 conn(0x55e2a0ca7200 msgr2=0x55e2a0d36740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 -- 172.21.15.139:0/288317746 shutdown_connections 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 -- 172.21.15.139:0/288317746 wait complete. 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 -- start start 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.656+0000 7fb52e81db80 1 Processor -- start 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d391a0 0x55e2a0d42620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0d9fc10 con 0x55e2a0d330b0 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0d9fd50 con 0x55e2a0d391a0 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a0d9ff10 con 0x55e2a0d38880 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb52e81db80 10 client.0 _ll_register_callbacks cb 0x7fb50c09a0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41944/0 (socket says 172.21.15.139:41944) 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 -- 172.21.15.139:0/1299808361 learned_addr learned my addr 172.21.15.139:0/1299808361 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb520bd1700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d391a0 0x55e2a0d42620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 -- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 msgr2=0x55e2a0d420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 -- 172.21.15.139:0/1299808361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d391a0 msgr2=0x55e2a0d42620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d391a0 0x55e2a0d42620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.657+0000 7fb51bfff700 1 -- 172.21.15.139:0/1299808361 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51400c540 con 0x55e2a0d330b0 2023-10-08T13:29:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.658+0000 7fb51bfff700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0967e0 tx=0x7fb50c099aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc650f722c59061 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb4fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0cd4b0 con 0x55e2a0d330b0 2023-10-08T13:29:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb50c09a9e0 con 0x55e2a0d330b0 2023-10-08T13:29:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb51001e040 con 0x55e2a0d330b0 2023-10-08T13:29:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb50c09a540 con 0x55e2a0d330b0 2023-10-08T13:29:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb52e81db80 10 client.16509 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.662+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fb51c10cd90 con 0x55e2a0d330b0 2023-10-08T13:29:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb51001e040 con 0x55e2a0d330b0 2023-10-08T13:29:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fb50c09f170 con 0x55e2a0d330b0 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 10 client.16509 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 20 client.16509 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0da1260 0x55e2a0da3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 4 client.16509 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e2a0c7ead0 con 0x55e2a0da1260 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.663+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0da1260 0x55e2a0da3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.664+0000 7fb4fb7fe700 10 client.16509 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:32.665 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.664+0000 7fb51b7fe700 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0da1260 0x55e2a0da3680 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e2f0db48daae93 server_cookie=f4699c31317847a7 in_seq=0 out_seq=0 2023-10-08T13:29:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb4fb7fe700 1 -- 172.21.15.139:0/1299808361 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e2a0c7ead0 con 0x55e2a0da1260 2023-10-08T13:29:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb4fb7fe700 10 client.16509 handle_command_reply: tid=0 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 client.16509 shutdown 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 msgr2=0x55e2a0d41ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0967e0 tx=0x7fb50c099aa0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 shutdown_connections 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55e2a0da1260 0x55e2a0da3680 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2a0d391a0 0x55e2a0d42620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e2a0d330b0 0x55e2a0d41ba0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 --2- 172.21.15.139:0/1299808361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e2a0d38880 0x55e2a0d420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 >> 172.21.15.139:0/1299808361 conn(0x55e2a0ca7200 msgr2=0x55e2a0d376c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb4fb7fe700 0 client.16509 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 shutdown_connections 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 1 -- 172.21.15.139:0/1299808361 wait complete. 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.708+0000 7fb52e81db80 20 client.16509 trim_cache size 0 max 16384 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:29:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 msgr2=0x7fb5040a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 0x7fb5040a3b30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb51000b2e0 tx=0x7fb510005960 comp rx=0 tx=0).stop 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 msgr2=0x7fb51c1a2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e970 tx=0x7fb50c00ec80 comp rx=0 tx=0).stop 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 shutdown_connections 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb5040a1670 0x7fb5040a3b30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb51c1045e0 0x7fb51c19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb51c0ff5d0 0x7fb51c1a2ef0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 --2- 172.21.15.139:0/2007915606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb51c0fff90 0x7fb51c1a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 >> 172.21.15.139:0/2007915606 conn(0x7fb51c076790 msgr2=0x7fb51c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 shutdown_connections 2023-10-08T13:29:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:32.709+0000 7fb522634700 1 -- 172.21.15.139:0/2007915606 wait complete. 2023-10-08T13:29:32.748 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] xfsctl 2023-10-08T13:29:32.821 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] bstat 2023-10-08T13:29:32.837 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_mtab 2023-10-08T13:29:32.841 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] getdevicesize 2023-10-08T13:29:32.951 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] preallo_rw_pattern_reader 2023-10-08T13:29:33.019 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] preallo_rw_pattern_writer 2023-10-08T13:29:33.058 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] ftrunc 2023-10-08T13:29:33.104 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] trunc 2023-10-08T13:29:33.148 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fs_perms 2023-10-08T13:29:33.217 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] testx 2023-10-08T13:29:33.240 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] looptest 2023-10-08T13:29:33.325 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] locktest 2023-10-08T13:29:33.326 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] unwritten_mmap 2023-10-08T13:29:33.399 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] bulkstat_unlink_test 2023-10-08T13:29:33.479 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] bulkstat_unlink_test_modified 2023-10-08T13:29:33.534 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_dir_offset 2023-10-08T13:29:33.656 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_futimens 2023-10-08T13:29:33.685 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_immutable 2023-10-08T13:29:33.691 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] stale_handle 2023-10-08T13:29:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:33 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:33 smithi187 ceph-mon[104336]: pgmap v361: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 240 KiB/s wr, 144 op/s 2023-10-08T13:29:33.740 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] pwrite_mmap_blocked 2023-10-08T13:29:33.819 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_dir_offset2 2023-10-08T13:29:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:33 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:33 smithi155 ceph-mon[103467]: pgmap v361: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 240 KiB/s wr, 144 op/s 2023-10-08T13:29:33.898 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] seek_sanity_test 2023-10-08T13:29:33.917 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] seek_copy_test 2023-10-08T13:29:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:33 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:33 smithi139 ceph-mon[99506]: pgmap v361: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 240 KiB/s wr, 144 op/s 2023-10-08T13:29:33.999 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_readdir_1 2023-10-08T13:29:34.123 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_readdir_2 2023-10-08T13:29:34.408 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fsync-tester 2023-10-08T13:29:34.461 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] nsexec 2023-10-08T13:29:34.511 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] cloner 2023-10-08T13:29:34.517 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] renameat2 2023-10-08T13:29:34.770 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] e4compact 2023-10-08T13:29:34.770 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_getcwd 2023-10-08T13:29:34.778 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] test-nextquota 2023-10-08T13:29:34.889 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] punch-alternating 2023-10-08T13:29:34.986 INFO:tasks.workunit.client.0.smithi139.stderr:t_getcwd.c: In function 'do_rename': 2023-10-08T13:29:34.987 INFO:tasks.workunit.client.0.smithi139.stderr:t_getcwd.c:40:2: warning: 'strncpy' specified bound 256 equals destination size [-Wstringop-truncation] 2023-10-08T13:29:34.987 INFO:tasks.workunit.client.0.smithi139.stderr: strncpy(c_name, prefix, BUF_SIZE); 2023-10-08T13:29:34.987 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:35.019 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-08T13:29:35.065 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] listxattr 2023-10-08T13:29:35.081 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dio-interleaved 2023-10-08T13:29:35.157 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_dir_type 2023-10-08T13:29:35.240 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] dio-invalidate-cache 2023-10-08T13:29:35.242 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] stat_test 2023-10-08T13:29:35.276 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_encrypted_d_revalidate 2023-10-08T13:29:35.352 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] attr_replace_test 2023-10-08T13:29:35.487 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] swapon 2023-10-08T13:29:35.492 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] mkswap 2023-10-08T13:29:35.561 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_attr_corruption 2023-10-08T13:29:35.578 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_open_tmpfiles 2023-10-08T13:29:35.642 INFO:tasks.workunit.client.0.smithi139.stderr:swapon.c: In function 'main': 2023-10-08T13:29:35.642 INFO:tasks.workunit.client.0.smithi139.stderr:swapon.c:135:3: warning: 'p' may be used uninitialized in this function [-Wmaybe-uninitialized] 2023-10-08T13:29:35.642 INFO:tasks.workunit.client.0.smithi139.stderr: memcpy(p, buf, BUF_SIZE); 2023-10-08T13:29:35.642 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:35.676 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fscrypt-crypt-util 2023-10-08T13:29:35.681 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] bulkstat_null_ocount 2023-10-08T13:29:35.759 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] splice-test 2023-10-08T13:29:35.792 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fiemap-tester 2023-10-08T13:29:35.877 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] t_stripealign 2023-10-08T13:29:35.974 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] open_by_handle 2023-10-08T13:29:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:35 smithi187 ceph-mon[104336]: pgmap v362: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 147 KiB/s wr, 94 op/s 2023-10-08T13:29:36.054 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] fssum 2023-10-08T13:29:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:35 smithi155 ceph-mon[103467]: pgmap v362: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 147 KiB/s wr, 94 op/s 2023-10-08T13:29:36.104 INFO:tasks.workunit.client.0.smithi139.stdout:Building log-writes 2023-10-08T13:29:36.111 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] replay-log 2023-10-08T13:29:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:35 smithi139 ceph-mon[99506]: pgmap v362: 129 pgs: 129 active+clean; 46 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 147 KiB/s wr, 94 op/s 2023-10-08T13:29:36.272 INFO:tasks.workunit.client.0.smithi139.stdout:Building perf 2023-10-08T13:29:36.278 INFO:tasks.workunit.client.0.smithi139.stdout:Building aio-dio-regress 2023-10-08T13:29:36.287 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-08T13:29:36.287 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-fcntl-race 2023-10-08T13:29:36.449 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-subblock-eof-read 2023-10-08T13:29:36.480 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-append-write-read-race 2023-10-08T13:29:36.484 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-invalidate-readahead 2023-10-08T13:29:36.579 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-hole-filling-race 2023-10-08T13:29:36.612 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-08T13:29:36.677 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-last-ref-held-by-io 2023-10-08T13:29:36.693 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-cycle-write 2023-10-08T13:29:36.754 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-extend-stat 2023-10-08T13:29:36.771 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-08T13:29:36.890 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aiocp 2023-10-08T13:29:36.905 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-invalidate-failure 2023-10-08T13:29:36.913 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aiodio_sparse2 2023-10-08T13:29:36.951 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-cow-race 2023-10-08T13:29:37.081 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-write-verify 2023-10-08T13:29:37.112 INFO:tasks.workunit.client.0.smithi139.stderr:aiodio_sparse2.c: In function 'main': 2023-10-08T13:29:37.112 INFO:tasks.workunit.client.0.smithi139.stderr:aiodio_sparse2.c:404:2: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2023-10-08T13:29:37.113 INFO:tasks.workunit.client.0.smithi139.stderr: strncpy(filename, argv[argc-1], PATH_MAX); 2023-10-08T13:29:37.113 INFO:tasks.workunit.client.0.smithi139.stderr: ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T13:29:37.122 INFO:tasks.workunit.client.0.smithi139.stdout: [CC] aio-dio-eof-race 2023-10-08T13:29:37.305 INFO:tasks.workunit.client.0.smithi139.stderr:+ cd .. 2023-10-08T13:29:37.305 INFO:tasks.workunit.client.0.smithi139.stderr:+ cp xfstests-dev/ltp/fsx . 2023-10-08T13:29:37.307 INFO:tasks.workunit.client.0.smithi139.stderr:+ OPTIONS=-z 2023-10-08T13:29:37.307 INFO:tasks.workunit.client.0.smithi139.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2023-10-08T13:29:37.308 INFO:tasks.workunit.client.0.smithi139.stdout:Seed set to 1 2023-10-08T13:29:37.328 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-08T13:29:37.329 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-08T13:29:37.331 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-08T13:29:37.331 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-08T13:29:37.331 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support clone range, disabling! 2023-10-08T13:29:37.334 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-08T13:29:37.342 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x38fe9 2023-10-08T13:29:37.383 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0xead53 2023-10-08T13:29:37.514 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0xf2cdd 2023-10-08T13:29:37.524 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0xfca47 2023-10-08T13:29:37.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:37 smithi187 ceph-mon[104336]: pgmap v363: 129 pgs: 129 active+clean; 51 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 644 KiB/s wr, 139 op/s 2023-10-08T13:29:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:37 smithi155 ceph-mon[103467]: pgmap v363: 129 pgs: 129 active+clean; 51 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 644 KiB/s wr, 139 op/s 2023-10-08T13:29:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:37 smithi139 ceph-mon[99506]: pgmap v363: 129 pgs: 129 active+clean; 51 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 644 KiB/s wr, 139 op/s 2023-10-08T13:29:38.349 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0xfcdd6 2023-10-08T13:29:38.377 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0xfe854 2023-10-08T13:29:38.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 -- 172.21.15.139:0/1058428414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a4105b80 msgr2=0x7f82a410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 --2- 172.21.15.139:0/1058428414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a4105b80 0x7f82a410d590 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f82940099c0 tx=0x7f8294009cd0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 -- 172.21.15.139:0/1058428414 shutdown_connections 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 --2- 172.21.15.139:0/1058428414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a4105b80 0x7f82a410d590 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 --2- 172.21.15.139:0/1058428414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4067ce0 0x7f82a40680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 --2- 172.21.15.139:0/1058428414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a41051c0 0x7f82a4105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 -- 172.21.15.139:0/1058428414 >> 172.21.15.139:0/1058428414 conn(0x7f82a4076780 msgr2=0x7f82a4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.081 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 -- 172.21.15.139:0/1058428414 shutdown_connections 2023-10-08T13:29:39.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.080+0000 7f82abe1c700 1 -- 172.21.15.139:0/1058428414 wait complete. 2023-10-08T13:29:39.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 Processor -- start 2023-10-08T13:29:39.082 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 -- start start 2023-10-08T13:29:39.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4105b80 0x7f82a4100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41a4f20 con 0x7f82a41051c0 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41a5090 con 0x7f82a4067ce0 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82abe1c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41a5250 con 0x7f82a4105b80 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41960/0 (socket says 172.21.15.139:41960) 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60478/0 (socket says 172.21.15.139:60478) 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82a93b7700 1 -- 172.21.15.139:0/579041858 learned_addr learned my addr 172.21.15.139:0/579041858 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.081+0000 7f82aa3b9700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4105b80 0x7f82a4100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 -- 172.21.15.139:0/579041858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4105b80 msgr2=0x7f82a4100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4105b80 0x7f82a4100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 -- 172.21.15.139:0/579041858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 msgr2=0x7f82a40ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 -- 172.21.15.139:0/579041858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940095f0 con 0x7f82a41051c0 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a93b7700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f829800e9a0 tx=0x7f829800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a2ffd700 1 -- 172.21.15.139:0/579041858 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298009790 con 0x7f82a41051c0 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a41a5530 con 0x7f82a41051c0 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a2ffd700 1 -- 172.21.15.139:0/579041858 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8298010430 con 0x7f82a41051c0 2023-10-08T13:29:39.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82a2ffd700 1 -- 172.21.15.139:0/579041858 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298018680 con 0x7f82a41051c0 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.082+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a41a5a90 con 0x7f82a41051c0 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.085+0000 7f82a2ffd700 1 -- 172.21.15.139:0/579041858 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f82980105a0 con 0x7f82a41051c0 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.085+0000 7f82a2ffd700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 0x7f828c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.085+0000 7f82a2ffd700 1 -- 172.21.15.139:0/579041858 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8298014070 con 0x7f82a41051c0 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.085+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 0x7f828c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.086+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 0x7f828c0a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f829c009480 tx=0x7f829c00b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 Processor -- start 2023-10-08T13:29:39.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 -- start start 2023-10-08T13:29:39.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.088 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162e011a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162df6d460 con 0x56162e0047a0 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162df5ec20 con 0x56162e003e80 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82b8005b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162df5c540 con 0x56162e00f650 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41968/0 (socket says 172.21.15.139:41968) 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82a93b7700 1 -- 172.21.15.139:0/1034075347 learned_addr learned my addr 172.21.15.139:0/1034075347 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.087+0000 7f82aa3b9700 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162e011a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1034075347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 msgr2=0x56162e011a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162e011a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1034075347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 msgr2=0x56162e00f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1034075347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56162dd82de0 con 0x56162e003e80 2023-10-08T13:29:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e004260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e8c0 tx=0x7f829c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b778f075ec4c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f828bfff700 1 -- 172.21.15.139:0/1034075347 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c017990 con 0x56162e003e80 2023-10-08T13:29:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f828bfff700 1 -- 172.21.15.139:0/1034075347 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c00f040 con 0x56162e003e80 2023-10-08T13:29:39.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.088+0000 7f828bfff700 1 -- 172.21.15.139:0/1034075347 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c021e50 con 0x56162e003e80 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 -- 172.21.15.139:0/1034075347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 msgr2=0x56162e004260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e004260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f829c00e8c0 tx=0x7f829c014000 comp rx=0 tx=0).stop 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 -- 172.21.15.139:0/1034075347 shutdown_connections 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162e011a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e004260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1034075347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 -- 172.21.15.139:0/1034075347 >> 172.21.15.139:0/1034075347 conn(0x56162df79260 msgr2=0x56162e0002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 -- 172.21.15.139:0/1034075347 shutdown_connections 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.089+0000 7f82b8005b80 1 -- 172.21.15.139:0/1034075347 wait complete. 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 -- start start 2023-10-08T13:29:39.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 Processor -- start 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 0x56162e00f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e00c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162df57e30 con 0x56162e0047a0 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162def4710 con 0x56162e00f650 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162def43b0 con 0x56162e003e80 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82b8005b80 10 client.0 _ll_register_callbacks cb 0x56162dd51800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 0x56162e00f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41974/0 (socket says 172.21.15.139:41974) 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82a93b7700 1 -- 172.21.15.139:0/4269778322 learned_addr learned my addr 172.21.15.139:0/4269778322 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:39.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.090+0000 7f82aa3b9700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e00c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 -- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 msgr2=0x56162e00f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 0x56162e00f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 -- 172.21.15.139:0/4269778322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 msgr2=0x56162e00c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e00c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 -- 172.21.15.139:0/4269778322 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c00e5a0 con 0x56162e0047a0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 0x56162e00f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82a93b7700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8298099f40 tx=0x7f829809aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2519acecdce9ab37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82897fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980a25d0 con 0x56162e0047a0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f829809a4a0 con 0x56162e0047a0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56162df1feb0 con 0x56162e0047a0 2023-10-08T13:29:39.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829809a660 con 0x56162e0047a0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82b8005b80 10 client.16521 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56162dd6bc60 con 0x56162e0047a0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.091+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8298063070 con 0x56162e0047a0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f82980991a0 con 0x56162e0047a0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 10 client.16521 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 20 client.16521 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e01f1c0 0x56162e0215e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 4 client.16521 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56162df50e10 con 0x56162e01f1c0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e01f1c0 0x56162e0215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82897fa700 10 client.16521 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.092+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e01f1c0 0x56162e0215e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6563e22d6ee673 server_cookie=e6794ccc31605583 in_seq=0 out_seq=0 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.093+0000 7f82897fa700 1 -- 172.21.15.139:0/4269778322 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56162df50e10 con 0x56162e01f1c0 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.093+0000 7f82897fa700 10 client.16521 handle_command_reply: tid=0 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.093+0000 7f82b8005b80 1 client.16521 shutdown 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.093+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 msgr2=0x56162e00c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.093+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8298099f40 tx=0x7f829809aa30 comp rx=0 tx=0).stop 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 shutdown_connections 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e01f1c0 0x56162e0215e0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e00c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e003e80 0x56162e00f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 --2- 172.21.15.139:0/4269778322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00c350 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82897fa700 0 client.16521 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:39.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 >> 172.21.15.139:0/4269778322 conn(0x56162df79260 msgr2=0x56162dfffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 shutdown_connections 2023-10-08T13:29:39.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 1 -- 172.21.15.139:0/4269778322 wait complete. 2023-10-08T13:29:39.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.094+0000 7f82b8005b80 20 client.16521 trim_cache size 0 max 16384 2023-10-08T13:29:39.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 Processor -- start 2023-10-08T13:29:39.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 -- start start 2023-10-08T13:29:39.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.114 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162dfffd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162ddd8920 con 0x56162e0047a0 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162e0071b0 con 0x56162e003e80 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82b8005b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162dffcae0 con 0x56162e00f650 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.113+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60500/0 (socket says 172.21.15.139:60500) 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82aa3b9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162dfffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a93b7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41982/0 (socket says 172.21.15.139:41982) 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 -- 172.21.15.139:0/2925084253 learned_addr learned my addr 172.21.15.139:0/2925084253 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 -- 172.21.15.139:0/2925084253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 msgr2=0x56162dfffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.115 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162dfffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 -- 172.21.15.139:0/2925084253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 msgr2=0x56162e00eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 -- 172.21.15.139:0/2925084253 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56162dda9250 con 0x56162e003e80 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a93b7700 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f829c022b10 tx=0x7f829c0219f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c63bd4b36b26b237 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a0ff9700 1 -- 172.21.15.139:0/2925084253 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c037070 con 0x56162e003e80 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a0ff9700 1 -- 172.21.15.139:0/2925084253 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c004cb0 con 0x56162e003e80 2023-10-08T13:29:39.116 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.114+0000 7f82a0ff9700 1 -- 172.21.15.139:0/2925084253 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c033a70 con 0x56162e003e80 2023-10-08T13:29:39.119 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- 172.21.15.139:0/2925084253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 msgr2=0x56162e0161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f829c022b10 tx=0x7f829c0219f0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- 172.21.15.139:0/2925084253 shutdown_connections 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e00f650 0x56162dfffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e003e80 0x56162e0161a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 --2- 172.21.15.139:0/2925084253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e0047a0 0x56162e00eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- 172.21.15.139:0/2925084253 >> 172.21.15.139:0/2925084253 conn(0x56162df79260 msgr2=0x56162e00ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- 172.21.15.139:0/2925084253 shutdown_connections 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- 172.21.15.139:0/2925084253 wait complete. 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 -- start start 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.115+0000 7f82b8005b80 1 Processor -- start 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.120 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e0047a0 0x56162e014410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e014950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162e014e90 con 0x56162e003e80 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162e015000 con 0x56162e00f650 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56162e0151c0 con 0x56162e0047a0 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82b8005b80 10 client.0 _ll_register_callbacks cb 0x7f8298099e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:41986/0 (socket says 172.21.15.139:41986) 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1937140117 learned_addr learned my addr 172.21.15.139:0/1937140117 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a93b7700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e0047a0 0x56162e014410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82aa3b9700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e014950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e0047a0 msgr2=0x56162e014410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e0047a0 0x56162e014410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.121 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1937140117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 msgr2=0x56162e014950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e014950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 -- 172.21.15.139:0/1937140117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56162dd6bc60 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82aa3b9700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e014950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82a9bb8700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f829c035040 tx=0x7f829c009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679e014b4e577335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.116+0000 7f82897fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c037030 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f829c038070 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f829c00f040 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c021e70 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 10 client.16527 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56162dd82de0 con 0x56162e003e80 2023-10-08T13:29:39.122 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c00f040 con 0x56162e003e80 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f829c017ac0 con 0x56162e003e80 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 20 client.16527 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e0741b0 0x56162e0765d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 4 client.16527 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56162df50b30 con 0x56162e0741b0 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.117+0000 7f82a93b7700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e0741b0 0x56162e0765d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82897fa700 10 client.16527 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82a93b7700 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e0741b0 0x56162e0765d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=829adaedfecd644f server_cookie=845711d54f4d79dc in_seq=0 out_seq=0 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82897fa700 1 -- 172.21.15.139:0/1937140117 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56162df50b30 con 0x56162e0741b0 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82897fa700 10 client.16527 handle_command_reply: tid=0 2023-10-08T13:29:39.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 client.16527 shutdown 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 msgr2=0x56162e015fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f829c035040 tx=0x7f829c009a00 comp rx=0 tx=0).stop 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 shutdown_connections 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56162e0741b0 0x56162e0765d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56162e00f650 0x56162e014950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82897fa700 0 client.16527 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56162e003e80 0x56162e015fe0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 --2- 172.21.15.139:0/1937140117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56162e0047a0 0x56162e014410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 >> 172.21.15.139:0/1937140117 conn(0x56162df79260 msgr2=0x56162e00aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 shutdown_connections 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 1 -- 172.21.15.139:0/1937140117 wait complete. 2023-10-08T13:29:39.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.118+0000 7f82b8005b80 20 client.16527 trim_cache size 0 max 16384 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:29:39.125 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:29:39.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 msgr2=0x7f828c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 0x7f828c0a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f829c009480 tx=0x7f829c00b040 comp rx=0 tx=0).stop 2023-10-08T13:29:39.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 msgr2=0x7f82a40ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f829800e9a0 tx=0x7f829800ecb0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 shutdown_connections 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f828c0a15f0 0x7f828c0a3ab0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a4105b80 0x7f82a4100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82a4067ce0 0x7f82a40ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 --2- 172.21.15.139:0/579041858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82a41051c0 0x7f82a40ffbf0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 >> 172.21.15.139:0/579041858 conn(0x7f82a4076780 msgr2=0x7f82a40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 shutdown_connections 2023-10-08T13:29:39.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:29:39.119+0000 7f82abe1c700 1 -- 172.21.15.139:0/579041858 wait complete. 2023-10-08T13:29:39.133 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:29:39.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:39 smithi187 ceph-mon[104336]: pgmap v364: 129 pgs: 129 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 752 KiB/s wr, 153 op/s 2023-10-08T13:29:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:39 smithi155 ceph-mon[103467]: pgmap v364: 129 pgs: 129 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 752 KiB/s wr, 153 op/s 2023-10-08T13:29:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:39 smithi139 ceph-mon[99506]: pgmap v364: 129 pgs: 129 active+clean; 52 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 752 KiB/s wr, 153 op/s 2023-10-08T13:29:40.836 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0xffce4 2023-10-08T13:29:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:41 smithi187 ceph-mon[104336]: pgmap v365: 129 pgs: 129 active+clean; 53 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 884 KiB/s wr, 190 op/s 2023-10-08T13:29:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:41 smithi155 ceph-mon[103467]: pgmap v365: 129 pgs: 129 active+clean; 53 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 884 KiB/s wr, 190 op/s 2023-10-08T13:29:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:41 smithi139 ceph-mon[99506]: pgmap v365: 129 pgs: 129 active+clean; 53 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 884 KiB/s wr, 190 op/s 2023-10-08T13:29:42.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:42 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:29:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:42 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:29:42.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:42 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:29:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:43 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:43.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:43 smithi187 ceph-mon[104336]: pgmap v366: 129 pgs: 129 active+clean; 54 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.6 MiB/s wr, 281 op/s 2023-10-08T13:29:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:43 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:43 smithi155 ceph-mon[103467]: pgmap v366: 129 pgs: 129 active+clean; 54 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.6 MiB/s wr, 281 op/s 2023-10-08T13:29:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:43 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:29:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:43 smithi139 ceph-mon[99506]: pgmap v366: 129 pgs: 129 active+clean; 54 MiB data, 621 MiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.6 MiB/s wr, 281 op/s 2023-10-08T13:29:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 -- 172.21.15.139:0/2580237449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280fec60 msgr2=0x7ffa280ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/2580237449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280fec60 0x7ffa280ff0e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009990 tx=0x7ffa14009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 -- 172.21.15.139:0/2580237449 shutdown_connections 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/2580237449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280ff620 0x7ffa2810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/2580237449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 0x7ffa28106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/2580237449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280fec60 0x7ffa280ff0e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 -- 172.21.15.139:0/2580237449 >> 172.21.15.139:0/2580237449 conn(0x7ffa28075bf0 msgr2=0x7ffa280fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 -- 172.21.15.139:0/2580237449 shutdown_connections 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.841+0000 7ffa2ee77700 1 -- 172.21.15.139:0/2580237449 wait complete. 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 Processor -- start 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 -- start start 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280ff620 0x7ffa2819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 0x7ffa28196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28196fd0 con 0x7ffa280fec60 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28197140 con 0x7ffa280ff620 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2ee77700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28197300 con 0x7ffa28106760 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42000/0 (socket says 172.21.15.139:42000) 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2cc13700 1 -- 172.21.15.139:0/1555894111 learned_addr learned my addr 172.21.15.139:0/1555894111 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa27fff700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280ff620 0x7ffa2819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.842+0000 7ffa2d414700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 0x7ffa28196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 -- 172.21.15.139:0/1555894111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 msgr2=0x7ffa28196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 0x7ffa28196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 -- 172.21.15.139:0/1555894111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280ff620 msgr2=0x7ffa2819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280ff620 0x7ffa2819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 -- 172.21.15.139:0/1555894111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20009c40 con 0x7ffa280fec60 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e9a0 tx=0x7ffa1c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa25ffb700 1 -- 172.21.15.139:0/1555894111 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c009790 con 0x7ffa280fec60 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa140095f0 con 0x7ffa280fec60 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa281a3650 con 0x7ffa280fec60 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa25ffb700 1 -- 172.21.15.139:0/1555894111 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa1c010430 con 0x7ffa280fec60 2023-10-08T13:29:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.843+0000 7ffa25ffb700 1 -- 172.21.15.139:0/1555894111 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c018680 con 0x7ffa280fec60 2023-10-08T13:29:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.846+0000 7ffa25ffb700 1 -- 172.21.15.139:0/1555894111 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7ffa1c0187e0 con 0x7ffa280fec60 2023-10-08T13:29:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.847+0000 7ffa25ffb700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 0x7ffa180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.847+0000 7ffa25ffb700 1 -- 172.21.15.139:0/1555894111 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffa1c014070 con 0x7ffa280fec60 2023-10-08T13:29:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.847+0000 7ffa27fff700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 0x7ffa180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.847+0000 7ffa27fff700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 0x7ffa180a3ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b2e0 tx=0x7ffa14005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 Processor -- start 2023-10-08T13:29:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 -- start start 2023-10-08T13:29:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b60b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b61510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0ac9400 con 0x55bef0b66880 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0ababc0 con 0x55bef0b671a0 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0ab84e0 con 0x55bef0b610b0 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42008/0 (socket says 172.21.15.139:42008) 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa27fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b60b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 -- 172.21.15.139:0/3344028561 learned_addr learned my addr 172.21.15.139:0/3344028561 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 -- 172.21.15.139:0/3344028561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 msgr2=0x55bef0b61510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b61510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 -- 172.21.15.139:0/3344028561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 msgr2=0x55bef0b60b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.848+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b60b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.849+0000 7ffa2cc13700 1 -- 172.21.15.139:0/3344028561 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bef08ded80 con 0x55bef0b66880 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.849+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0967e0 tx=0x7ffa1c099f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317ccbb12a523e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.849+0000 7ffa12ffd700 1 -- 172.21.15.139:0/3344028561 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c09e430 con 0x55bef0b66880 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.849+0000 7ffa12ffd700 1 -- 172.21.15.139:0/3344028561 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa1c0a2670 con 0x55bef0b66880 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.849+0000 7ffa12ffd700 1 -- 172.21.15.139:0/3344028561 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c09a540 con 0x55bef0b66880 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- 172.21.15.139:0/3344028561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 msgr2=0x55bef0b66c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0967e0 tx=0x7ffa1c099f50 comp rx=0 tx=0).stop 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- 172.21.15.139:0/3344028561 shutdown_connections 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b61510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b66880 0x55bef0b66c60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/3344028561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b60b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- 172.21.15.139:0/3344028561 >> 172.21.15.139:0/3344028561 conn(0x55bef0ad5200 msgr2=0x55bef0b5bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- 172.21.15.139:0/3344028561 shutdown_connections 2023-10-08T13:29:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- 172.21.15.139:0/3344028561 wait complete. 2023-10-08T13:29:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 -- start start 2023-10-08T13:29:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.850+0000 7ffa3b060b80 1 Processor -- start 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b6aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b671a0 0x55bef0b6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0ab3dd0 con 0x55bef0b610b0 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0a506b0 con 0x55bef0b66880 2023-10-08T13:29:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0a50350 con 0x55bef0b671a0 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa3b060b80 10 client.0 _ll_register_callbacks cb 0x55bef08ad7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa27fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b6aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42012/0 (socket says 172.21.15.139:42012) 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa27fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b6aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60534/0 (socket says 172.21.15.139:60534) 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 -- 172.21.15.139:0/422054547 learned_addr learned my addr 172.21.15.139:0/422054547 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2d414700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b671a0 0x55bef0b6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 -- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b671a0 msgr2=0x55bef0b6afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b671a0 0x55bef0b6afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 -- 172.21.15.139:0/422054547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 msgr2=0x55bef0b6aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b6aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 -- 172.21.15.139:0/422054547 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa281a3650 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.851+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0a2140 tx=0x7ffa1c0caa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01fca870df0bb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0b6070 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffa1c0cd2c0 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bef0a7be50 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1c07b020 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 10 client.16539 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55bef08c7c00 con 0x55bef0b610b0 2023-10-08T13:29:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bef0a7be50 con 0x55bef0b610b0 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ffa1c09a660 con 0x55bef0b610b0 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 10 client.16539 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 20 client.16539 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0b7ee30 0x55bef0b81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 4 client.16539 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.852+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bef0aacdb0 con 0x55bef0b7ee30 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.853+0000 7ffa27fff700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0b7ee30 0x55bef0b81250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.853+0000 7ffa07fff700 10 client.16539 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.853+0000 7ffa27fff700 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0b7ee30 0x55bef0b81250 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b988de7a2b6bca6a server_cookie=438e4b16578f4240 in_seq=0 out_seq=0 2023-10-08T13:29:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa07fff700 1 -- 172.21.15.139:0/422054547 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bef0aacdb0 con 0x55bef0b7ee30 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa07fff700 10 client.16539 handle_command_reply: tid=0 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 client.16539 shutdown 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 msgr2=0x55bef0b6a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0a2140 tx=0x7ffa1c0caa70 comp rx=0 tx=0).stop 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 shutdown_connections 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b671a0 0x55bef0b6afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b6a530 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0b7ee30 0x55bef0b81250 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/422054547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b6aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 >> 172.21.15.139:0/422054547 conn(0x55bef0ad5200 msgr2=0x55bef0b5b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa07fff700 0 client.16539 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 shutdown_connections 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 1 -- 172.21.15.139:0/422054547 wait complete. 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.854+0000 7ffa3b060b80 20 client.16539 trim_cache size 0 max 16384 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 Processor -- start 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 -- start start 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b60b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 0x55bef0b5b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef09348c0 con 0x55bef0b671a0 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0b5c610 con 0x55bef0b66880 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0b58830 con 0x55bef0b610b0 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa27fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa2d414700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 0x55bef0b5b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa27fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60542/0 (socket says 172.21.15.139:60542) 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.872+0000 7ffa27fff700 1 -- 172.21.15.139:0/28446080 learned_addr learned my addr 172.21.15.139:0/28446080 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b60b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 -- 172.21.15.139:0/28446080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 msgr2=0x55bef0b60b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b60b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 -- 172.21.15.139:0/28446080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 msgr2=0x55bef0b71c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 -- 172.21.15.139:0/28446080 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bef09051f0 con 0x55bef0b671a0 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa27fff700 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa2d414700 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 0x55bef0b5b790 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ffa20014790 tx=0x7ffa20009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0601402a63e3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa137fe700 1 -- 172.21.15.139:0/28446080 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000e040 con 0x55bef0b671a0 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa137fe700 1 -- 172.21.15.139:0/28446080 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa2000f040 con 0x55bef0b671a0 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.873+0000 7ffa137fe700 1 -- 172.21.15.139:0/28446080 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20007c30 con 0x55bef0b671a0 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 -- 172.21.15.139:0/28446080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 msgr2=0x55bef0b5b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 0x55bef0b5b790 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ffa20014790 tx=0x7ffa20009920 comp rx=0 tx=0).stop 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 -- 172.21.15.139:0/28446080 shutdown_connections 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b671a0 0x55bef0b5b790 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b610b0 0x55bef0b60b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/28446080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b66880 0x55bef0b71c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 -- 172.21.15.139:0/28446080 >> 172.21.15.139:0/28446080 conn(0x55bef0ad5200 msgr2=0x55bef0b68e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 -- 172.21.15.139:0/28446080 shutdown_connections 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.874+0000 7ffa3b060b80 1 -- 172.21.15.139:0/28446080 wait complete. 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 -- start start 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 Processor -- start 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b66880 0x55bef0b63db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b62400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0b629b0 con 0x55bef0b610b0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0b62b20 con 0x55bef0b671a0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bef0b62ce0 con 0x55bef0b66880 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa3b060b80 10 client.0 _ll_register_callbacks cb 0x7ffa14005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2cc13700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42026/0 (socket says 172.21.15.139:42026) 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2cc13700 1 -- 172.21.15.139:0/4005295766 learned_addr learned my addr 172.21.15.139:0/4005295766 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa27fff700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b66880 0x55bef0b63db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2d414700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b62400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2cc13700 1 -- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b66880 msgr2=0x55bef0b63db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.875+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b66880 0x55bef0b63db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa2cc13700 1 -- 172.21.15.139:0/4005295766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 msgr2=0x55bef0b62400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b62400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa2cc13700 1 -- 172.21.15.139:0/4005295766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2810de30 con 0x55bef0b610b0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa2cc13700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cb050 tx=0x7ffa1c0cd570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae7875bc134226 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0b6070 con 0x55bef0b610b0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 9351+0+0 (secure 0 0 0) 0x7ffa1c09e430 con 0x55bef0b610b0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa1c0a2670 con 0x55bef0b610b0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1c09a0b0 con 0x55bef0b610b0 2023-10-08T13:29:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 10 client.16545 fetch_fsmap learned FSMap version 33 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7ffa20014440 con 0x55bef0b610b0 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa1c0a6020 con 0x55bef0b610b0 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 33) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ffa1c099240 con 0x55bef0b610b0 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 10 client.16545 fetch_fsmap finished waiting for FSMap version 33 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 20 client.16545 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0bd38f0 0x55bef0bd5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 4 client.16545 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.876+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bef0aacad0 con 0x55bef0bd38f0 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.877+0000 7ffa27fff700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0bd38f0 0x55bef0bd5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.877+0000 7ffa07fff700 10 client.16545 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.877+0000 7ffa27fff700 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0bd38f0 0x55bef0bd5d10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dec7686a7016234a server_cookie=bf45704dd28d31ef in_seq=0 out_seq=0 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa07fff700 1 -- 172.21.15.139:0/4005295766 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bef0aacad0 con 0x55bef0bd38f0 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa07fff700 10 client.16545 handle_command_reply: tid=0 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 client.16545 shutdown 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 msgr2=0x55bef0b63870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cb050 tx=0x7ffa1c0cd570 comp rx=0 tx=0).stop 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 shutdown_connections 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55bef0bd38f0 0x55bef0bd5d10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bef0b671a0 0x55bef0b62400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa07fff700 0 client.16545 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bef0b610b0 0x55bef0b63870 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 --2- 172.21.15.139:0/4005295766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bef0b66880 0x55bef0b63db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 >> 172.21.15.139:0/4005295766 conn(0x55bef0ad5200 msgr2=0x55bef0b65630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 shutdown_connections 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.907+0000 7ffa3b060b80 1 -- 172.21.15.139:0/4005295766 wait complete. 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa3b060b80 20 client.16545 trim_cache size 0 max 16384 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:29:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:29:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 msgr2=0x7ffa180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 0x7ffa180a3ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b2e0 tx=0x7ffa14005960 comp rx=0 tx=0).stop 2023-10-08T13:29:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 msgr2=0x7ffa2819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00e9a0 tx=0x7ffa1c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 shutdown_connections 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ffa180a15f0 0x7ffa180a3ab0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa28106760 0x7ffa28196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffa280fec60 0x7ffa2819c840 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 --2- 172.21.15.139:0/1555894111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa280ff620 0x7ffa2819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 >> 172.21.15.139:0/1555894111 conn(0x7ffa28075bf0 msgr2=0x7ffa280fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 shutdown_connections 2023-10-08T13:29:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:45.908+0000 7ffa2ee77700 1 -- 172.21.15.139:0/1555894111 wait complete. 2023-10-08T13:29:45.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:45 smithi187 ceph-mon[104336]: pgmap v367: 129 pgs: 129 active+clean; 54 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1.6 MiB/s wr, 258 op/s 2023-10-08T13:29:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:45 smithi155 ceph-mon[103467]: pgmap v367: 129 pgs: 129 active+clean; 54 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1.6 MiB/s wr, 258 op/s 2023-10-08T13:29:46.097 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:29:45 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setuser ceph since I am not root 2023-10-08T13:29:46.097 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:29:45 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setgroup ceph since I am not root 2023-10-08T13:29:46.097 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:29:45 smithi155 ceph-mds[140612]: -- 172.21.15.155:0/2864007078 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558979e1d1e0 con 0x558979df2800 2023-10-08T13:29:46.097 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:29:45 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: starting mds.e at 2023-10-08T13:29:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:45 smithi139 ceph-mon[99506]: pgmap v367: 129 pgs: 129 active+clean; 54 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 1.6 MiB/s wr, 258 op/s 2023-10-08T13:29:46.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:46 smithi187 ceph-mon[104336]: daemon mds.e restarted 2023-10-08T13:29:47.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:46 smithi155 ceph-mon[103467]: daemon mds.e restarted 2023-10-08T13:29:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:46 smithi139 ceph-mon[99506]: daemon mds.e restarted 2023-10-08T13:29:47.223 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0xfffc5 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: pgmap v368: 129 pgs: 129 active+clean; 55 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 455 op/s 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6834/1597491843,v1:172.21.15.155:6835/1597491843] up:boot 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:29:47.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:47.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:47 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: pgmap v368: 129 pgs: 129 active+clean; 55 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 455 op/s 2023-10-08T13:29:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:29:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6834/1597491843,v1:172.21.15.155:6835/1597491843] up:boot 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:47 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: pgmap v368: 129 pgs: 129 active+clean; 55 MiB data, 674 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 455 op/s 2023-10-08T13:29:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T13:29:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6834/1597491843,v1:172.21.15.155:6835/1597491843] up:boot 2023-10-08T13:29:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T13:29:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:47 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:48.931 INFO:tasks.workunit.client.0.smithi139.stdout:10000 mapread 0x32cdc thru 0x3e88f (0xbbb4 bytes) 2023-10-08T13:29:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:29:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:29:48.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:29:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:29:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:29:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:29:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:29:49.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:49 smithi187 ceph-mon[104336]: pgmap v370: 129 pgs: 129 active+clean; 55 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2023-10-08T13:29:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:49 smithi155 ceph-mon[103467]: pgmap v370: 129 pgs: 129 active+clean; 55 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2023-10-08T13:29:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:49 smithi139 ceph-mon[99506]: pgmap v370: 129 pgs: 129 active+clean; 55 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 442 op/s 2023-10-08T13:29:51.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:51 smithi139 ceph-mon[99506]: pgmap v371: 129 pgs: 129 active+clean; 49 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 463 op/s 2023-10-08T13:29:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:51 smithi187 ceph-mon[104336]: pgmap v371: 129 pgs: 129 active+clean; 49 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 463 op/s 2023-10-08T13:29:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:51 smithi155 ceph-mon[103467]: pgmap v371: 129 pgs: 129 active+clean; 49 MiB data, 670 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 463 op/s 2023-10-08T13:29:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:53 smithi187 ceph-mon[104336]: pgmap v372: 129 pgs: 129 active+clean; 50 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 478 op/s 2023-10-08T13:29:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:53 smithi155 ceph-mon[103467]: pgmap v372: 129 pgs: 129 active+clean; 50 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 478 op/s 2023-10-08T13:29:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:53 smithi139 ceph-mon[99506]: pgmap v372: 129 pgs: 129 active+clean; 50 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 478 op/s 2023-10-08T13:29:55.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:55 smithi187 ceph-mon[104336]: pgmap v373: 129 pgs: 129 active+clean; 50 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 477 op/s 2023-10-08T13:29:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:55 smithi155 ceph-mon[103467]: pgmap v373: 129 pgs: 129 active+clean; 50 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 477 op/s 2023-10-08T13:29:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:55 smithi139 ceph-mon[99506]: pgmap v373: 129 pgs: 129 active+clean; 50 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 477 op/s 2023-10-08T13:29:57.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:57 smithi187 ceph-mon[104336]: pgmap v374: 129 pgs: 129 active+clean; 51 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 454 op/s 2023-10-08T13:29:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:57 smithi155 ceph-mon[103467]: pgmap v374: 129 pgs: 129 active+clean; 51 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 454 op/s 2023-10-08T13:29:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:57 smithi139 ceph-mon[99506]: pgmap v374: 129 pgs: 129 active+clean; 51 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 454 op/s 2023-10-08T13:29:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3439642597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a01045b0 msgr2=0x7f08a0104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3439642597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a01045b0 0x7f08a0104990 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0894009990 tx=0x7f0894009ca0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3439642597 shutdown_connections 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3439642597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a0100730 0x7f08a010c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3439642597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a01045b0 0x7f08a0104990 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3439642597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 0x7f08a01001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3439642597 >> 172.21.15.139:0/3439642597 conn(0x7f08a0075bf0 msgr2=0x7f08a00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3439642597 shutdown_connections 2023-10-08T13:29:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.027+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3439642597 wait complete. 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 Processor -- start 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 -- start start 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 0x7f08a019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a01045b0 0x7f08a0195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0195ec0 con 0x7f08a0100730 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a0196030 con 0x7f08a00ffd70 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a6ad7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a01961f0 con 0x7f08a01045b0 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f089ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a4873700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 0x7f08a019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f089ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42040/0 (socket says 172.21.15.139:42040) 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f089ffff700 1 -- 172.21.15.139:0/3641493294 learned_addr learned my addr 172.21.15.139:0/3641493294 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.028+0000 7f08a5074700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a01045b0 0x7f08a0195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 -- 172.21.15.139:0/3641493294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a01045b0 msgr2=0x7f08a0195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a01045b0 0x7f08a0195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 -- 172.21.15.139:0/3641493294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 msgr2=0x7f08a019b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 0x7f08a019b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 -- 172.21.15.139:0/3641493294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940095f0 con 0x7f08a0100730 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089ffff700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f088c00e9a0 tx=0x7f088c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089dffb700 1 -- 172.21.15.139:0/3641493294 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c009790 con 0x7f08a0100730 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089dffb700 1 -- 172.21.15.139:0/3641493294 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f088c010430 con 0x7f08a0100730 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a01964d0 con 0x7f08a0100730 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f089dffb700 1 -- 172.21.15.139:0/3641493294 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c018680 con 0x7f08a0100730 2023-10-08T13:29:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.029+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a01a2710 con 0x7f08a0100730 2023-10-08T13:29:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.031+0000 7f089dffb700 1 -- 172.21.15.139:0/3641493294 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f088c0105a0 con 0x7f08a0100730 2023-10-08T13:29:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.032+0000 7f089dffb700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 0x7f08900a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.032+0000 7f089dffb700 1 -- 172.21.15.139:0/3641493294 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f088c014070 con 0x7f08a0100730 2023-10-08T13:29:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.032+0000 7f08a4873700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 0x7f08900a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.032+0000 7f08a4873700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 0x7f08900a3ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f089400b2e0 tx=0x7f0894005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.033+0000 7f08b2cc0b80 1 Processor -- start 2023-10-08T13:29:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.033+0000 7f08b2cc0b80 1 -- start start 2023-10-08T13:29:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b630890 0x55ff6b6346f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 0x55ff6b635090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b596400 con 0x55ff6b62ff70 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b587bc0 con 0x55ff6b634c30 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b5854e0 con 0x55ff6b630890 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42046/0 (socket says 172.21.15.139:42046) 2023-10-08T13:29:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 -- 172.21.15.139:0/1494883785 learned_addr learned my addr 172.21.15.139:0/1494883785 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f089ffff700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b630890 0x55ff6b6346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a5074700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 0x55ff6b635090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 -- 172.21.15.139:0/1494883785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b630890 msgr2=0x55ff6b6346f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b630890 0x55ff6b6346f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 -- 172.21.15.139:0/1494883785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 msgr2=0x55ff6b635090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 0x55ff6b635090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 -- 172.21.15.139:0/1494883785 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff6b3abd80 con 0x55ff6b62ff70 2023-10-08T13:29:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a5074700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 0x55ff6b635090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:29:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.034+0000 7f08a4873700 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0894009990 tx=0x7f0894020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64cea40ce1e6619 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.035+0000 7f088affd700 1 -- 172.21.15.139:0/1494883785 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894004700 con 0x55ff6b62ff70 2023-10-08T13:29:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.035+0000 7f088affd700 1 -- 172.21.15.139:0/1494883785 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f089401e040 con 0x55ff6b62ff70 2023-10-08T13:29:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.035+0000 7f088affd700 1 -- 172.21.15.139:0/1494883785 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400f9c0 con 0x55ff6b62ff70 2023-10-08T13:29:59.043 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1494883785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 msgr2=0x55ff6b630350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0894009990 tx=0x7f0894020000 comp rx=0 tx=0).stop 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1494883785 shutdown_connections 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b634c30 0x55ff6b635090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b630350 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1494883785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b630890 0x55ff6b6346f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1494883785 >> 172.21.15.139:0/1494883785 conn(0x55ff6b5a2200 msgr2=0x55ff6b628b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1494883785 shutdown_connections 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1494883785 wait complete. 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 -- start start 2023-10-08T13:29:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.036+0000 7f08b2cc0b80 1 Processor -- start 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b637e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b634c30 0x55ff6b638340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b580dd0 con 0x55ff6b634c30 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b51d6b0 con 0x55ff6b630890 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b51d350 con 0x55ff6b62ff70 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08b2cc0b80 10 client.0 _ll_register_callbacks cb 0x55ff6b37a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41768/0 (socket says 172.21.15.139:41768) 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 -- 172.21.15.139:0/3168448595 learned_addr learned my addr 172.21.15.139:0/3168448595 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a5074700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b634c30 0x55ff6b638340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.045 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f089ffff700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b637e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 -- 172.21.15.139:0/3168448595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 msgr2=0x55ff6b637e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b637e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 -- 172.21.15.139:0/3168448595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b634c30 msgr2=0x55ff6b638340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b634c30 0x55ff6b638340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.037+0000 7f08a4873700 1 -- 172.21.15.139:0/3168448595 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a010cd90 con 0x55ff6b62ff70 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f08a4873700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f089400f4a0 tx=0x7f089400fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cff1aa9546293581 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f087ffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894004700 con 0x55ff6b62ff70 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff6b548e50 con 0x55ff6b62ff70 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0894004860 con 0x55ff6b62ff70 2023-10-08T13:29:59.046 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0894004a20 con 0x55ff6b62ff70 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f08b2cc0b80 10 client.26011 fetch_fsmap learned FSMap version 35 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.038+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ff6b394c00 con 0x55ff6b62ff70 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff6b548e50 con 0x55ff6b62ff70 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f089402fc60 con 0x55ff6b62ff70 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 10 client.26011 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:29:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 10 client.26011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 20 client.26011 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b64bc90 0x55ff6b64e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 4 client.26011 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff6b579db0 con 0x55ff6b64bc90 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.039+0000 7f089ffff700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b64bc90 0x55ff6b64e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.040+0000 7f087ffff700 10 client.26011 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.040+0000 7f089ffff700 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b64bc90 0x55ff6b64e0b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1259915aa345a822 server_cookie=e477d949ded9283b in_seq=0 out_seq=0 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.040+0000 7f087ffff700 1 -- 172.21.15.139:0/3168448595 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ff6b579db0 con 0x55ff6b64bc90 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.040+0000 7f087ffff700 10 client.26011 handle_command_reply: tid=0 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.040+0000 7f08b2cc0b80 1 client.26011 shutdown 2023-10-08T13:29:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 msgr2=0x55ff6b6378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f089400f4a0 tx=0x7f089400fbd0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 shutdown_connections 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b634c30 0x55ff6b638340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b62ff70 0x55ff6b6378c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b64bc90 0x55ff6b64e0b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/3168448595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b637e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f087ffff700 0 client.26011 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 >> 172.21.15.139:0/3168448595 conn(0x55ff6b5a2200 msgr2=0x55ff6b62cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 shutdown_connections 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/3168448595 wait complete. 2023-10-08T13:29:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.041+0000 7f08b2cc0b80 20 client.26011 trim_cache size 0 max 16384 2023-10-08T13:29:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 Processor -- start 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 -- start start 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b62eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b62f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b4018c0 con 0x55ff6b62ff70 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b630fa0 con 0x55ff6b630890 2023-10-08T13:29:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b6232b0 con 0x55ff6b634c30 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42060/0 (socket says 172.21.15.139:42060) 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f089ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b62eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08a4873700 1 -- 172.21.15.139:0/1943259753 learned_addr learned my addr 172.21.15.139:0/1943259753 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.057+0000 7f08a5074700 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b62f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 -- 172.21.15.139:0/1943259753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 msgr2=0x55ff6b62f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.067 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b62f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 -- 172.21.15.139:0/1943259753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 msgr2=0x55ff6b62eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b62eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 -- 172.21.15.139:0/1943259753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff6b3d21f0 con 0x55ff6b62ff70 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f089ffff700 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b62eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f08a4873700 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0894009ce0 tx=0x7f0894005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f131dbad3bd71232 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f088b7fe700 1 -- 172.21.15.139:0/1943259753 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bdc0 con 0x55ff6b62ff70 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f088b7fe700 1 -- 172.21.15.139:0/1943259753 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0894024e70 con 0x55ff6b62ff70 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.058+0000 7f088b7fe700 1 -- 172.21.15.139:0/1943259753 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894004d90 con 0x55ff6b62ff70 2023-10-08T13:29:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1943259753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 msgr2=0x55ff6b647620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0894009ce0 tx=0x7f0894005100 comp rx=0 tx=0).stop 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1943259753 shutdown_connections 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b62f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b647620 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/1943259753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b62eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1943259753 >> 172.21.15.139:0/1943259753 conn(0x55ff6b5a2200 msgr2=0x55ff6b6343d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1943259753 shutdown_connections 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/1943259753 wait complete. 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 -- start start 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.059+0000 7f08b2cc0b80 1 Processor -- start 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b643400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b643940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b6454c0 con 0x55ff6b62ff70 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b69ea30 con 0x55ff6b630890 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff6b69ebc0 con 0x55ff6b634c30 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 10 client.0 _ll_register_callbacks cb 0x7f0894005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42066/0 (socket says 172.21.15.139:42066) 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 -- 172.21.15.139:0/2615962501 learned_addr learned my addr 172.21.15.139:0/2615962501 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f089ffff700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b643400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a5074700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b643940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 -- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 msgr2=0x55ff6b643940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b643940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 -- 172.21.15.139:0/2615962501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 msgr2=0x55ff6b643400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b643400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 -- 172.21.15.139:0/2615962501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c0cc040 con 0x55ff6b62ff70 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08a4873700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0894005f50 tx=0x7f0894009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0d5c37bc10c36c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f087ffff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bdc0 con 0x55ff6b62ff70 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f08940249b0 con 0x55ff6b62ff70 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.060+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f089401e040 con 0x55ff6b62ff70 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0894024b70 con 0x55ff6b62ff70 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 10 client.16569 fetch_fsmap learned FSMap version 35 2023-10-08T13:29:59.071 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ff6b394c00 con 0x55ff6b62ff70 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f089401e040 con 0x55ff6b62ff70 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f0894042040 con 0x55ff6b62ff70 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 10 client.16569 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 20 client.16569 populate_metadata read hostname 'smithi139' 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b6a0100 0x55ff6b6a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 4 client.16569 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff6b579ad0 con 0x55ff6b6a0100 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.061+0000 7f089ffff700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b6a0100 0x55ff6b6a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.062+0000 7f089ffff700 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b6a0100 0x55ff6b6a2520 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c357dcebed75b76f server_cookie=d3b302c9cc2f9608 in_seq=0 out_seq=0 2023-10-08T13:29:59.072 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.062+0000 7f087ffff700 10 client.16569 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.079+0000 7f087ffff700 1 -- 172.21.15.139:0/2615962501 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff6b579ad0 con 0x55ff6b6a0100 2023-10-08T13:29:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f087ffff700 10 client.16569 handle_command_reply: tid=0 2023-10-08T13:29:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 client.16569 shutdown 2023-10-08T13:29:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 msgr2=0x55ff6b642ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0894005f50 tx=0x7f0894009310 comp rx=0 tx=0).stop 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 shutdown_connections 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ff6b634c30 0x55ff6b643940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ff6b62ff70 0x55ff6b642ec0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ff6b6a0100 0x55ff6b6a2520 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 --2- 172.21.15.139:0/2615962501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff6b630890 0x55ff6b643400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f087ffff700 0 client.16569 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 >> 172.21.15.139:0/2615962501 conn(0x55ff6b5a2200 msgr2=0x55ff6b647620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 shutdown_connections 2023-10-08T13:29:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 1 -- 172.21.15.139:0/2615962501 wait complete. 2023-10-08T13:29:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.080+0000 7f08b2cc0b80 20 client.16569 trim_cache size 0 max 16384 2023-10-08T13:29:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:29:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:29:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:29:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:29:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 msgr2=0x7f08900a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 0x7f08900a3ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f089400b2e0 tx=0x7f0894005960 comp rx=0 tx=0).stop 2023-10-08T13:29:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 msgr2=0x7f08a019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:29:59.084 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f088c00e9a0 tx=0x7f088c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 shutdown_connections 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08900a15f0 0x7f08900a3ab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08a01045b0 0x7f08a0195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f08a00ffd70 0x7f08a019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 --2- 172.21.15.139:0/3641493294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08a0100730 0x7f08a019bc60 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 >> 172.21.15.139:0/3641493294 conn(0x7f08a0075bf0 msgr2=0x7f08a0102340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 shutdown_connections 2023-10-08T13:29:59.085 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:29:59.081+0000 7f08a6ad7700 1 -- 172.21.15.139:0/3641493294 wait complete. 2023-10-08T13:29:59.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:29:59 smithi187 ceph-mon[104336]: pgmap v375: 129 pgs: 129 active+clean; 51 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 382 op/s 2023-10-08T13:30:00.001 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:29:59 smithi139 ceph-mon[99506]: pgmap v375: 129 pgs: 129 active+clean; 51 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 382 op/s 2023-10-08T13:30:00.001 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.998+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-08T13:30:00.001 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.999+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-08T13:30:00.001 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.999+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : mds.h(mds.4): Metadata damage detected 2023-10-08T13:30:00.002 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.999+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : mds.f(mds.3): Metadata damage detected 2023-10-08T13:30:00.002 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.999+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : mds.b(mds.2): Metadata damage detected 2023-10-08T13:30:00.002 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:29:59.999+0000 7f404d0d8700 -1 log_channel(cluster) log [ERR] : mds.c(mds.1): Metadata damage detected 2023-10-08T13:30:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:29:59 smithi155 ceph-mon[103467]: pgmap v375: 129 pgs: 129 active+clean; 51 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 382 op/s 2023-10-08T13:30:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-08T13:30:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-08T13:30:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: mds.h(mds.4): Metadata damage detected 2023-10-08T13:30:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: mds.f(mds.3): Metadata damage detected 2023-10-08T13:30:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: mds.b(mds.2): Metadata damage detected 2023-10-08T13:30:01.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:00 smithi155 ceph-mon[103467]: mds.c(mds.1): Metadata damage detected 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: mds.h(mds.4): Metadata damage detected 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: mds.f(mds.3): Metadata damage detected 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: mds.b(mds.2): Metadata damage detected 2023-10-08T13:30:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:00 smithi139 ceph-mon[99506]: mds.c(mds.1): Metadata damage detected 2023-10-08T13:30:01.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: Health detail: HEALTH_ERR 4 MDSs report damaged metadata 2023-10-08T13:30:01.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: [ERR] MDS_DAMAGE: 4 MDSs report damaged metadata 2023-10-08T13:30:01.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: mds.h(mds.4): Metadata damage detected 2023-10-08T13:30:01.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: mds.f(mds.3): Metadata damage detected 2023-10-08T13:30:01.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: mds.b(mds.2): Metadata damage detected 2023-10-08T13:30:01.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:00 smithi187 ceph-mon[104336]: mds.c(mds.1): Metadata damage detected 2023-10-08T13:30:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:01 smithi155 ceph-mon[103467]: pgmap v376: 129 pgs: 129 active+clean; 49 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 432 op/s 2023-10-08T13:30:02.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:01 smithi139 ceph-mon[99506]: pgmap v376: 129 pgs: 129 active+clean; 49 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 432 op/s 2023-10-08T13:30:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:01 smithi187 ceph-mon[104336]: pgmap v376: 129 pgs: 129 active+clean; 49 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 432 op/s 2023-10-08T13:30:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:03 smithi155 ceph-mon[103467]: pgmap v377: 129 pgs: 129 active+clean; 50 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 492 op/s 2023-10-08T13:30:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:03 smithi139 ceph-mon[99506]: pgmap v377: 129 pgs: 129 active+clean; 50 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 492 op/s 2023-10-08T13:30:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:03 smithi187 ceph-mon[104336]: pgmap v377: 129 pgs: 129 active+clean; 50 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 492 op/s 2023-10-08T13:30:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:05 smithi155 ceph-mon[103467]: pgmap v378: 129 pgs: 129 active+clean; 50 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 370 op/s 2023-10-08T13:30:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:05 smithi139 ceph-mon[99506]: pgmap v378: 129 pgs: 129 active+clean; 50 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 370 op/s 2023-10-08T13:30:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:05 smithi187 ceph-mon[104336]: pgmap v378: 129 pgs: 129 active+clean; 50 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 370 op/s 2023-10-08T13:30:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:07 smithi155 ceph-mon[103467]: pgmap v379: 129 pgs: 129 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 520 op/s 2023-10-08T13:30:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:07 smithi139 ceph-mon[99506]: pgmap v379: 129 pgs: 129 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 520 op/s 2023-10-08T13:30:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:07 smithi187 ceph-mon[104336]: pgmap v379: 129 pgs: 129 active+clean; 53 MiB data, 793 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 520 op/s 2023-10-08T13:30:09.029 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0xfffe8 2023-10-08T13:30:09.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:30:09.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 -- 172.21.15.139:0/3279809024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c1010e0 msgr2=0x7fa22c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 --2- 172.21.15.139:0/3279809024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c1010e0 0x7fa22c10d5f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa224009f90 tx=0x7fa22400b330 comp rx=0 tx=0).stop 2023-10-08T13:30:09.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 -- 172.21.15.139:0/3279809024 shutdown_connections 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 --2- 172.21.15.139:0/3279809024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c1010e0 0x7fa22c10d5f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 --2- 172.21.15.139:0/3279809024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c106730 0x7fa22c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 --2- 172.21.15.139:0/3279809024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c100720 0x7fa22c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 -- 172.21.15.139:0/3279809024 >> 172.21.15.139:0/3279809024 conn(0x7fa22c0fc230 msgr2=0x7fa22c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 -- 172.21.15.139:0/3279809024 shutdown_connections 2023-10-08T13:30:09.285 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.283+0000 7fa230e9c700 1 -- 172.21.15.139:0/3279809024 wait complete. 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.284+0000 7fa230e9c700 1 Processor -- start 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.284+0000 7fa230e9c700 1 -- start start 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 0x7fa22c1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.287 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c197180 con 0x7fa22c100720 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c1972f0 con 0x7fa22c1010e0 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa230e9c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c1974b0 con 0x7fa22c106730 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa229d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42078/0 (socket says 172.21.15.139:42078) 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa229d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60600/0 (socket says 172.21.15.139:60600) 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 -- 172.21.15.139:0/2160452136 learned_addr learned my addr 172.21.15.139:0/2160452136 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 0x7fa22c1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 -- 172.21.15.139:0/2160452136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 msgr2=0x7fa22c1969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 0x7fa22c1969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 -- 172.21.15.139:0/2160452136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 msgr2=0x7fa22c19ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.288 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 -- 172.21.15.139:0/2160452136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009c40 con 0x7fa22c100720 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa229d9b700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 0x7fa22c1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.285+0000 7fa22a59c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9c0 tx=0x7fa21c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.286+0000 7fa21b7fe700 1 -- 172.21.15.139:0/2160452136 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004a30 con 0x7fa22c100720 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.286+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c197790 con 0x7fa22c100720 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.286+0000 7fa21b7fe700 1 -- 172.21.15.139:0/2160452136 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa21c00cc80 con 0x7fa22c100720 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.286+0000 7fa21b7fe700 1 -- 172.21.15.139:0/2160452136 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c0054e0 con 0x7fa22c100720 2023-10-08T13:30:09.289 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.286+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1a3890 con 0x7fa22c100720 2023-10-08T13:30:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.288+0000 7fa21b7fe700 1 -- 172.21.15.139:0/2160452136 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa21c021440 con 0x7fa22c100720 2023-10-08T13:30:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.288+0000 7fa21b7fe700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 0x7fa2140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.289+0000 7fa229d9b700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 0x7fa2140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.289+0000 7fa21b7fe700 1 -- 172.21.15.139:0/2160452136 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa21c014070 con 0x7fa22c100720 2023-10-08T13:30:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.289+0000 7fa229d9b700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 0x7fa2140a3ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa22c198120 tx=0x7fa220009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.289+0000 7fa23d085b80 1 Processor -- start 2023-10-08T13:30:09.291 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 -- start start 2023-10-08T13:30:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909c6650 0x5589909c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558990924460 con 0x5589909bae80 2023-10-08T13:30:09.292 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558990915c20 con 0x5589909c6650 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa23d085b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558990913540 con 0x5589909bb7a0 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42086/0 (socket says 172.21.15.139:42086) 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 -- 172.21.15.139:0/1607771325 learned_addr learned my addr 172.21.15.139:0/1607771325 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa229d9b700 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909c6650 0x5589909c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 -- 172.21.15.139:0/1607771325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 msgr2=0x5589909c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 -- 172.21.15.139:0/1607771325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909c6650 msgr2=0x5589909c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909c6650 0x5589909c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.293 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.290+0000 7fa22a59c700 1 -- 172.21.15.139:0/1607771325 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558990739de0 con 0x5589909bae80 2023-10-08T13:30:09.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.293+0000 7fa22a59c700 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa21c099e60 tx=0x7fa21c099bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98833ee7bf234f0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa218ff9700 1 -- 172.21.15.139:0/1607771325 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c09e2b0 con 0x5589909bae80 2023-10-08T13:30:09.294 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa218ff9700 1 -- 172.21.15.139:0/1607771325 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa21c0a24f0 con 0x5589909bae80 2023-10-08T13:30:09.295 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa218ff9700 1 -- 172.21.15.139:0/1607771325 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004b90 con 0x5589909bae80 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 -- 172.21.15.139:0/1607771325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 msgr2=0x5589909bb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa21c099e60 tx=0x7fa21c099bb0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 -- 172.21.15.139:0/1607771325 shutdown_connections 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909c6650 0x5589909c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909bae80 0x5589909bb260 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1607771325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.294+0000 7fa23d085b80 1 -- 172.21.15.139:0/1607771325 >> 172.21.15.139:0/1607771325 conn(0x558990930260 msgr2=0x5589909b72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- 172.21.15.139:0/1607771325 shutdown_connections 2023-10-08T13:30:09.296 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- 172.21.15.139:0/1607771325 wait complete. 2023-10-08T13:30:09.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- start start 2023-10-08T13:30:09.297 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 Processor -- start 2023-10-08T13:30:09.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.300 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899090ee30 con 0x5589909c6650 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589908ab710 con 0x5589909bae80 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589908ab3b0 con 0x5589909bb7a0 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa23d085b80 10 client.0 _ll_register_callbacks cb 0x558990708800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.295+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42096/0 (socket says 172.21.15.139:42096) 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60612/0 (socket says 172.21.15.139:60612) 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 -- 172.21.15.139:0/3240399394 learned_addr learned my addr 172.21.15.139:0/3240399394 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa229d9b700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 -- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 msgr2=0x5589909c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.301 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 -- 172.21.15.139:0/3240399394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 msgr2=0x5589909c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 -- 172.21.15.139:0/3240399394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1a3890 con 0x5589909c6650 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22a59c700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa224007fd0 tx=0x7fa224003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16a1303f066fc45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400e040 con 0x5589909c6650 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa2240078b0 con 0x5589909c6650 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589908d6eb0 con 0x5589909c6650 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa22400bbf0 con 0x5589909c6650 2023-10-08T13:30:09.302 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa23d085b80 10 client.16581 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.296+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x558990722c60 con 0x5589909c6650 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589908d6eb0 con 0x5589909c6650 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fa224019070 con 0x5589909c6650 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 10 client.16581 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 20 client.16581 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5589909d6240 0x5589909d8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 4 client.16581 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:09.303 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.297+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558990907e10 con 0x5589909d6240 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.298+0000 7fa22a59c700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5589909d6240 0x5589909d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.298+0000 7fa22a59c700 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5589909d6240 0x5589909d8660 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca14a248f911f30 server_cookie=ae51b99fb59f069a in_seq=0 out_seq=0 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.298+0000 7fa211ffb700 10 client.16581 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa211ffb700 1 -- 172.21.15.139:0/3240399394 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558990907e10 con 0x5589909d6240 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa211ffb700 10 client.16581 handle_command_reply: tid=0 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 client.16581 shutdown 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 msgr2=0x5589909c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa224007fd0 tx=0x7fa224003c30 comp rx=0 tx=0).stop 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 shutdown_connections 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c3af0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.304 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5589909d6240 0x5589909d8660 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 --2- 172.21.15.139:0/3240399394 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa211ffb700 0 client.16581 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 >> 172.21.15.139:0/3240399394 conn(0x558990930260 msgr2=0x5589909b6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 shutdown_connections 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 1 -- 172.21.15.139:0/3240399394 wait complete. 2023-10-08T13:30:09.305 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.299+0000 7fa23d085b80 20 client.16581 trim_cache size 0 max 16384 2023-10-08T13:30:09.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 Processor -- start 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 -- start start 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bae80 0x5589909cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899078f920 con 0x5589909c6650 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589909d3850 con 0x5589909bb7a0 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa23d085b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589909b3b30 con 0x5589909bae80 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa229d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42104/0 (socket says 172.21.15.139:42104) 2023-10-08T13:30:09.322 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 -- 172.21.15.139:0/1739205317 learned_addr learned my addr 172.21.15.139:0/1739205317 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa229d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60622/0 (socket says 172.21.15.139:60622) 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22a59c700 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bae80 0x5589909cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 -- 172.21.15.139:0/1739205317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bae80 msgr2=0x5589909cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bae80 0x5589909cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 -- 172.21.15.139:0/1739205317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 msgr2=0x5589909c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa22ad9d700 1 -- 172.21.15.139:0/1739205317 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558990760250 con 0x5589909c6650 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.319+0000 7fa229d9b700 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.320+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa2240095d0 tx=0x7fa224009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169819e2dd36fd72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.320+0000 7fa2197fa700 1 -- 172.21.15.139:0/1739205317 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400e030 con 0x5589909c6650 2023-10-08T13:30:09.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.320+0000 7fa2197fa700 1 -- 172.21.15.139:0/1739205317 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa224021070 con 0x5589909c6650 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.320+0000 7fa2197fa700 1 -- 172.21.15.139:0/1739205317 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400be50 con 0x5589909c6650 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- 172.21.15.139:0/1739205317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 msgr2=0x5589909c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa2240095d0 tx=0x7fa224009450 comp rx=0 tx=0).stop 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- 172.21.15.139:0/1739205317 shutdown_connections 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909c31d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bae80 0x5589909cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- 172.21.15.139:0/1739205317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bb7a0 0x5589909c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- 172.21.15.139:0/1739205317 >> 172.21.15.139:0/1739205317 conn(0x558990930260 msgr2=0x5589909be6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- 172.21.15.139:0/1739205317 shutdown_connections 2023-10-08T13:30:09.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- 172.21.15.139:0/1739205317 wait complete. 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- start start 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 Processor -- start 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589909cbf70 con 0x5589909c6650 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589909cc0b0 con 0x5589909bae80 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.321+0000 7fa23d085b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589909cc270 con 0x5589909bb7a0 2023-10-08T13:30:09.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa23d085b80 10 client.0 _ll_register_callbacks cb 0x7fa224007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60626/0 (socket says 172.21.15.139:60626) 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 -- 172.21.15.139:0/867345578 learned_addr learned my addr 172.21.15.139:0/867345578 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa229d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 -- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 msgr2=0x5589909cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 -- 172.21.15.139:0/867345578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 msgr2=0x5589909cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 -- 172.21.15.139:0/867345578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa220017070 con 0x5589909bae80 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22ad9d700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa229d9b700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa22a59c700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c5b0 tx=0x7fa21c009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9ae027cf79a395 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.322+0000 7fa211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c060ea0 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa21c00cdf0 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa21c0a24f0 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa21c09e330 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 10 client.26042 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x558990722c60 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa21c0a24f0 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fa21c09a450 con 0x5589909bae80 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 10 client.26042 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:09.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 10 client.26042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 20 client.26042 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558990a2b330 0x558990a2d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 4 client.26042 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558990907b30 con 0x558990a2b330 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.323+0000 7fa229d9b700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558990a2b330 0x558990a2d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.324+0000 7fa211ffb700 10 client.26042 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.324+0000 7fa229d9b700 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558990a2b330 0x558990a2d750 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68fada42b634d2a6 server_cookie=b398250a44f1d9f2 in_seq=0 out_seq=0 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa211ffb700 1 -- 172.21.15.139:0/867345578 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558990907b30 con 0x558990a2b330 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa211ffb700 10 client.26042 handle_command_reply: tid=0 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 client.26042 shutdown 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 msgr2=0x5589909cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.331 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c5b0 tx=0x7fa21c009550 comp rx=0 tx=0).stop 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 shutdown_connections 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589909c6650 0x5589909cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558990a2b330 0x558990a2d750 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5589909bae80 0x5589909cd0e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa211ffb700 0 client.26042 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 --2- 172.21.15.139:0/867345578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589909bb7a0 0x5589909cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 >> 172.21.15.139:0/867345578 conn(0x558990930260 msgr2=0x5589909b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 shutdown_connections 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 1 -- 172.21.15.139:0/867345578 wait complete. 2023-10-08T13:30:09.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.326+0000 7fa23d085b80 20 client.26042 trim_cache size 0 max 16384 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:30:09.333 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:30:09.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 msgr2=0x7fa2140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 0x7fa2140a3ab0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa22c198120 tx=0x7fa220009260 comp rx=0 tx=0).stop 2023-10-08T13:30:09.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 msgr2=0x7fa22c19c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:09.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9c0 tx=0x7fa21c00ecd0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 shutdown_connections 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2140a15f0 0x7fa2140a3ab0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa22c106730 0x7fa22c1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa22c100720 0x7fa22c19c910 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 --2- 172.21.15.139:0/2160452136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa22c1010e0 0x7fa22c19ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 >> 172.21.15.139:0/2160452136 conn(0x7fa22c0fc230 msgr2=0x7fa22c0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 shutdown_connections 2023-10-08T13:30:09.335 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:09.327+0000 7fa230e9c700 1 -- 172.21.15.139:0/2160452136 wait complete. 2023-10-08T13:30:09.341 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:30:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:09 smithi155 ceph-mon[103467]: pgmap v380: 129 pgs: 129 active+clean; 53 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 341 op/s 2023-10-08T13:30:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:09 smithi139 ceph-mon[99506]: pgmap v380: 129 pgs: 129 active+clean; 53 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 341 op/s 2023-10-08T13:30:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:09 smithi187 ceph-mon[104336]: pgmap v380: 129 pgs: 129 active+clean; 53 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 341 op/s 2023-10-08T13:30:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:11 smithi187 ceph-mon[104336]: pgmap v381: 129 pgs: 129 active+clean; 55 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 392 op/s 2023-10-08T13:30:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:11 smithi155 ceph-mon[103467]: pgmap v381: 129 pgs: 129 active+clean; 55 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 392 op/s 2023-10-08T13:30:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:11 smithi139 ceph-mon[99506]: pgmap v381: 129 pgs: 129 active+clean; 55 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 392 op/s 2023-10-08T13:30:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 -- 172.21.15.139:0/2314944839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1003a0 msgr2=0x7f1d4c100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 --2- 172.21.15.139:0/2314944839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c100780 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009990 tx=0x7f1d3c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 -- 172.21.15.139:0/2314944839 shutdown_connections 2023-10-08T13:30:12.202 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 --2- 172.21.15.139:0/2314944839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1049b0 0x7f1d4c10c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 --2- 172.21.15.139:0/2314944839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c100780 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 --2- 172.21.15.139:0/2314944839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c100d50 0x7f1d4c104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.200+0000 7f1d522bd700 1 -- 172.21.15.139:0/2314944839 >> 172.21.15.139:0/2314944839 conn(0x7f1d4c074970 msgr2=0x7f1d4c074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.201+0000 7f1d522bd700 1 -- 172.21.15.139:0/2314944839 shutdown_connections 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.201+0000 7f1d522bd700 1 -- 172.21.15.139:0/2314944839 wait complete. 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.201+0000 7f1d522bd700 1 Processor -- start 2023-10-08T13:30:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.201+0000 7f1d522bd700 1 -- start start 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.201+0000 7f1d522bd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d522bd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c1049b0 0x7f1d4c197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d522bd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1984c0 0x7f1d4c1a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d522bd700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a3150 con 0x7f1d4c1984c0 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d522bd700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a32c0 con 0x7f1d4c1049b0 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d522bd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1a3480 con 0x7f1d4c1003a0 2023-10-08T13:30:12.205 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41836/0 (socket says 172.21.15.139:41836) 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 -- 172.21.15.139:0/3440793851 learned_addr learned my addr 172.21.15.139:0/3440793851 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d5085a700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1984c0 0x7f1d4c1a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c1049b0 0x7f1d4c197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 -- 172.21.15.139:0/3440793851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c1049b0 msgr2=0x7f1d4c197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c1049b0 0x7f1d4c197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 -- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1984c0 msgr2=0x7f1d4c1a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1984c0 0x7f1d4c1a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.206 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 -- 172.21.15.139:0/3440793851 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0095f0 con 0x7f1d4c1003a0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.202+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c004760 tx=0x7f1d3c004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.203+0000 7f1d497fa700 1 -- 172.21.15.139:0/3440793851 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c01d070 con 0x7f1d4c1003a0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.203+0000 7f1d497fa700 1 -- 172.21.15.139:0/3440793851 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3c022470 con 0x7f1d4c1003a0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.203+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c1a3700 con 0x7f1d4c1003a0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.203+0000 7f1d497fa700 1 -- 172.21.15.139:0/3440793851 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c017650 con 0x7f1d4c1003a0 2023-10-08T13:30:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.203+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c1a3b20 con 0x7f1d4c1003a0 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.205+0000 7f1d497fa700 1 -- 172.21.15.139:0/3440793851 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f1d3c0225e0 con 0x7f1d4c1003a0 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d497fa700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 0x7f1d340a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 0x7f1d340a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d497fa700 1 -- 172.21.15.139:0/3440793851 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1d3c0ce4f0 con 0x7f1d4c1003a0 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 0x7f1d340a3c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ff7c0 tx=0x7f1d40009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d5e4a6b80 1 Processor -- start 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.206+0000 7f1d5e4a6b80 1 -- start start 2023-10-08T13:30:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f74b400 con 0x55ee1f7e91a0 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f73cbc0 con 0x55ee1f7e8880 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f73a4e0 con 0x55ee1f7e30b0 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60648/0 (socket says 172.21.15.139:60648) 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.214 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1039807729 learned_addr learned my addr 172.21.15.139:0/1039807729 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d5085a700 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1039807729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 msgr2=0x55ee1f7e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1039807729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 msgr2=0x55ee1f7e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1039807729 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1f560d80 con 0x55ee1f7e8880 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0a2f90 tx=0x7f1d3c09ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff137330af9536f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d327fc700 1 -- 172.21.15.139:0/1039807729 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c09f120 con 0x55ee1f7e8880 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d327fc700 1 -- 172.21.15.139:0/1039807729 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3c09b8c0 con 0x55ee1f7e8880 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.207+0000 7f1d327fc700 1 -- 172.21.15.139:0/1039807729 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c09b420 con 0x55ee1f7e8880 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1039807729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 msgr2=0x55ee1f7e8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0a2f90 tx=0x7f1d3c09ad00 comp rx=0 tx=0).stop 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1039807729 shutdown_connections 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e8c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1039807729 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1039807729 >> 172.21.15.139:0/1039807729 conn(0x55ee1f757200 msgr2=0x55ee1f7ddb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1039807729 shutdown_connections 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.208+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1039807729 wait complete. 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 -- start start 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 Processor -- start 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f735dd0 con 0x55ee1f7e8880 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f6d26b0 con 0x55ee1f7e91a0 2023-10-08T13:30:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f6d2350 con 0x55ee1f7e30b0 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5e4a6b80 10 client.0 _ll_register_callbacks cb 0x55ee1f52f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42136/0 (socket says 172.21.15.139:42136) 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41850/0 (socket says 172.21.15.139:41850) 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3394570677 learned_addr learned my addr 172.21.15.139:0/3394570677 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.209+0000 7f1d5085a700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 msgr2=0x55ee1f7ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3394570677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 msgr2=0x55ee1f7ecc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ecc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3394570677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40017070 con 0x55ee1f7e8880 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001d8f0 tx=0x7f1d400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca4bdbcb4b805ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40022070 con 0x55ee1f7e8880 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1d40004240 con 0x55ee1f7e8880 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1f6fde50 con 0x55ee1f7e8880 2023-10-08T13:30:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d40004400 con 0x55ee1f7e8880 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d5e4a6b80 10 client.16599 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f1d4c1a3b20 con 0x55ee1f7e8880 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.210+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee1f6fde50 con 0x55ee1f7e8880 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f1d4001c740 con 0x55ee1f7e8880 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 10 client.16599 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 20 client.16599 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f7fca40 0x55ee1f7fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 4 client.16599 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee1f72edb0 con 0x55ee1f7fca40 2023-10-08T13:30:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f7fca40 0x55ee1f7fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d2b7fe700 10 client.16599 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.211+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f7fca40 0x55ee1f7fee60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=504338b01971cbcd server_cookie=29ee791f26ea8e45 in_seq=0 out_seq=0 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3394570677 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee1f72edb0 con 0x55ee1f7fca40 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d2b7fe700 10 client.16599 handle_command_reply: tid=0 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 client.16599 shutdown 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 msgr2=0x55ee1f7ec530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1d4001d8f0 tx=0x7f1d400047c0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 shutdown_connections 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f7fca40 0x55ee1f7fee60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ecc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d2b7fe700 0 client.16599 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3394570677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7ec530 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.212+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 >> 172.21.15.139:0/3394570677 conn(0x55ee1f757200 msgr2=0x55ee1f7dd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.213+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 shutdown_connections 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.213+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3394570677 wait complete. 2023-10-08T13:30:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.213+0000 7f1d5e4a6b80 20 client.16599 trim_cache size 0 max 16384 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.228+0000 7f1d5e4a6b80 1 Processor -- start 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 -- start start 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f5b68c0 con 0x55ee1f7e8880 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f7ea600 con 0x55ee1f7e91a0 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f7ed2d0 con 0x55ee1f7e30b0 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42144/0 (socket says 172.21.15.139:42144) 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/1807281662 learned_addr learned my addr 172.21.15.139:0/1807281662 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d5085a700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1807281662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 msgr2=0x55ee1f7ddcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ddcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1807281662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 msgr2=0x55ee1f7dd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4bfff700 1 -- 172.21.15.139:0/1807281662 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1f549c00 con 0x55ee1f7e30b0 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.229+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e7cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c09b380 tx=0x7f1d3c09e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=908adfc8d8aaeae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d32ffd700 1 -- 172.21.15.139:0/1807281662 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0b9070 con 0x55ee1f7e30b0 2023-10-08T13:30:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d32ffd700 1 -- 172.21.15.139:0/1807281662 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3c09f310 con 0x55ee1f7e30b0 2023-10-08T13:30:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d32ffd700 1 -- 172.21.15.139:0/1807281662 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0b91d0 con 0x55ee1f7e30b0 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1807281662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 msgr2=0x55ee1f7e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e7cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c09b380 tx=0x7f1d3c09e040 comp rx=0 tx=0).stop 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1807281662 shutdown_connections 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7ddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e7cf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/1807281662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7dd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1807281662 >> 172.21.15.139:0/1807281662 conn(0x55ee1f757200 msgr2=0x55ee1f7e75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.230+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1807281662 shutdown_connections 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/1807281662 wait complete. 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 -- start start 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 Processor -- start 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f7e6060 con 0x55ee1f7e8880 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f7e61d0 con 0x55ee1f7e91a0 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1f7e48d0 con 0x55ee1f7e30b0 2023-10-08T13:30:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d5e4a6b80 10 client.0 _ll_register_callbacks cb 0x55ee1f52f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d4b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42148/0 (socket says 172.21.15.139:42148) 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3677001479 learned_addr learned my addr 172.21.15.139:0/3677001479 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.231+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d5085a700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 msgr2=0x55ee1f7e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3677001479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 msgr2=0x55ee1f7e4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 -- 172.21.15.139:0/3677001479 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c1a3b20 con 0x55ee1f7e8880 2023-10-08T13:30:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d5085a700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d4b7fe700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1d40016040 tx=0x7f1d400044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e199f03cfc86a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40022070 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1d4001c620 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1f7e3b20 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d4001c7e0 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d5e4a6b80 10 client.16605 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.232+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55ee1f560d80 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee1f7e3b20 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f1d40034760 con 0x55ee1f7e8880 2023-10-08T13:30:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 10 client.16605 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 10 client.16605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 20 client.16605 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f8514c0 0x55ee1f8538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 4 client.16605 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f1d3c09b8c0 con 0x55ee1f8514c0 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f8514c0 0x55ee1f8538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d2b7fe700 10 client.16605 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.233+0000 7f1d4bfff700 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f8514c0 0x55ee1f8538e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2b6af7b649e54d4 server_cookie=3a15328722fcb08c in_seq=0 out_seq=0 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.253+0000 7f1d2b7fe700 1 -- 172.21.15.139:0/3677001479 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f1d3c09b8c0 con 0x55ee1f8514c0 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.253+0000 7f1d2b7fe700 10 client.16605 handle_command_reply: tid=0 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.253+0000 7f1d5e4a6b80 1 client.16605 shutdown 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 msgr2=0x55ee1f7e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1d40016040 tx=0x7f1d400044e0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 shutdown_connections 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55ee1f8514c0 0x55ee1f8538e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee1f7e91a0 0x55ee1f7e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d2b7fe700 0 client.16605 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee1f7e30b0 0x55ee1f7e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 --2- 172.21.15.139:0/3677001479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee1f7e8880 0x55ee1f7e5950 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 >> 172.21.15.139:0/3677001479 conn(0x55ee1f757200 msgr2=0x55ee1f7e9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.254+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 shutdown_connections 2023-10-08T13:30:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d5e4a6b80 1 -- 172.21.15.139:0/3677001479 wait complete. 2023-10-08T13:30:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d5e4a6b80 20 client.16605 trim_cache size 0 max 16384 2023-10-08T13:30:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:30:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:30:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:30:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 msgr2=0x7f1d340a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 0x7f1d340a3c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0ff7c0 tx=0x7f1d40009260 comp rx=0 tx=0).stop 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 msgr2=0x7f1d4c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c004760 tx=0x7f1d3c004790 comp rx=0 tx=0).stop 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 shutdown_connections 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f1d340a1740 0x7f1d340a3c00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d4c1984c0 0x7f1d4c1a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d4c1003a0 0x7f1d4c197a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 --2- 172.21.15.139:0/3440793851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d4c1049b0 0x7f1d4c197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 >> 172.21.15.139:0/3440793851 conn(0x7f1d4c074970 msgr2=0x7f1d4c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 shutdown_connections 2023-10-08T13:30:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:12.255+0000 7f1d522bd700 1 -- 172.21.15.139:0/3440793851 wait complete. 2023-10-08T13:30:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:13 smithi155 ceph-mon[103467]: pgmap v382: 129 pgs: 129 active+clean; 56 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 438 op/s 2023-10-08T13:30:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:13 smithi139 ceph-mon[99506]: pgmap v382: 129 pgs: 129 active+clean; 56 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 438 op/s 2023-10-08T13:30:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:13 smithi187 ceph-mon[104336]: pgmap v382: 129 pgs: 129 active+clean; 56 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 438 op/s 2023-10-08T13:30:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:15 smithi155 ceph-mon[103467]: pgmap v383: 129 pgs: 129 active+clean; 57 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 313 op/s 2023-10-08T13:30:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:15 smithi139 ceph-mon[99506]: pgmap v383: 129 pgs: 129 active+clean; 57 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 313 op/s 2023-10-08T13:30:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:15 smithi187 ceph-mon[104336]: pgmap v383: 129 pgs: 129 active+clean; 57 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 313 op/s 2023-10-08T13:30:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:17 smithi155 ceph-mon[103467]: pgmap v384: 129 pgs: 129 active+clean; 54 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 449 op/s 2023-10-08T13:30:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:17 smithi139 ceph-mon[99506]: pgmap v384: 129 pgs: 129 active+clean; 54 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 449 op/s 2023-10-08T13:30:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:17 smithi187 ceph-mon[104336]: pgmap v384: 129 pgs: 129 active+clean; 54 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 449 op/s 2023-10-08T13:30:18.395 INFO:tasks.workunit.client.0.smithi139.stdout:30000 trunc from 0xf3838 to 0x7d16c 2023-10-08T13:30:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:19 smithi155 ceph-mon[103467]: pgmap v385: 129 pgs: 129 active+clean; 54 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2023-10-08T13:30:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:19 smithi139 ceph-mon[99506]: pgmap v385: 129 pgs: 129 active+clean; 54 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2023-10-08T13:30:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:19 smithi187 ceph-mon[104336]: pgmap v385: 129 pgs: 129 active+clean; 54 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 299 op/s 2023-10-08T13:30:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:21 smithi187 ceph-mon[104336]: pgmap v386: 129 pgs: 129 active+clean; 56 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 339 op/s 2023-10-08T13:30:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:21 smithi155 ceph-mon[103467]: pgmap v386: 129 pgs: 129 active+clean; 56 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 339 op/s 2023-10-08T13:30:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:21 smithi139 ceph-mon[99506]: pgmap v386: 129 pgs: 129 active+clean; 56 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 339 op/s 2023-10-08T13:30:24.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:23 smithi155 ceph-mon[103467]: pgmap v387: 129 pgs: 129 active+clean; 57 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 384 op/s 2023-10-08T13:30:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:23 smithi139 ceph-mon[99506]: pgmap v387: 129 pgs: 129 active+clean; 57 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 384 op/s 2023-10-08T13:30:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:23 smithi187 ceph-mon[104336]: pgmap v387: 129 pgs: 129 active+clean; 57 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 384 op/s 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.379+0000 7f8aea157700 1 -- 172.21.15.139:0/3018203217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 msgr2=0x7f8ae4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.379+0000 7f8aea157700 1 --2- 172.21.15.139:0/3018203217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae4105a50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009990 tx=0x7f8ad4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 -- 172.21.15.139:0/3018203217 shutdown_connections 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 --2- 172.21.15.139:0/3018203217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4100290 0x7f8ae410c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 --2- 172.21.15.139:0/3018203217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae4105a50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 --2- 172.21.15.139:0/3018203217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae40ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 -- 172.21.15.139:0/3018203217 >> 172.21.15.139:0/3018203217 conn(0x7f8ae40764c0 msgr2=0x7f8ae40768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 -- 172.21.15.139:0/3018203217 shutdown_connections 2023-10-08T13:30:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 -- 172.21.15.139:0/3018203217 wait complete. 2023-10-08T13:30:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 Processor -- start 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.380+0000 7f8aea157700 1 -- start start 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 0x7f8ae419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4195e60 con 0x7f8ae4105670 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4195fd0 con 0x7f8ae4100290 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8aea157700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4196190 con 0x7f8ae40ff8d0 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 0x7f8ae419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42164/0 (socket says 172.21.15.139:42164) 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41876/0 (socket says 172.21.15.139:41876) 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 0x7f8ae419bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60682/0 (socket says 172.21.15.139:60682) 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 -- 172.21.15.139:0/3597717083 learned_addr learned my addr 172.21.15.139:0/3597717083 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 -- 172.21.15.139:0/3597717083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 msgr2=0x7f8ae419b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae419b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 -- 172.21.15.139:0/3597717083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 msgr2=0x7f8ae419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 0x7f8ae419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 -- 172.21.15.139:0/3597717083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009c40 con 0x7f8ae4105670 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.381+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00d100 tx=0x7f8adc00d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.382+0000 7f8ae0ff9700 1 -- 172.21.15.139:0/3597717083 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc003a00 con 0x7f8ae4105670 2023-10-08T13:30:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.382+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad40095f0 con 0x7f8ae4105670 2023-10-08T13:30:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.382+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae4069050 con 0x7f8ae4105670 2023-10-08T13:30:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.382+0000 7f8ae0ff9700 1 -- 172.21.15.139:0/3597717083 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8adc00ded0 con 0x7f8ae4105670 2023-10-08T13:30:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.382+0000 7f8ae0ff9700 1 -- 172.21.15.139:0/3597717083 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0047a0 con 0x7f8ae4105670 2023-10-08T13:30:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.384+0000 7f8ae0ff9700 1 -- 172.21.15.139:0/3597717083 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8adc004bd0 con 0x7f8ae4105670 2023-10-08T13:30:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.384+0000 7f8ae0ff9700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 0x7f8acc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.385+0000 7f8ae0ff9700 1 -- 172.21.15.139:0/3597717083 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8adc0ccce0 con 0x7f8ae4105670 2023-10-08T13:30:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.385+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 0x7f8acc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.385+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 0x7f8acc0a3ab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400b2e0 tx=0x7f8ad4005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.385+0000 7f8af6340b80 1 Processor -- start 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.385+0000 7f8af6340b80 1 -- start start 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d241a0 0x5646c0d1db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d1e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c86400 con 0x5646c0d23880 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c77bc0 con 0x5646c0d241a0 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8af6340b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c754e0 con 0x5646c0d1e0b0 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.392 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42168/0 (socket says 172.21.15.139:42168) 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 -- 172.21.15.139:0/2120474109 learned_addr learned my addr 172.21.15.139:0/2120474109 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d241a0 0x5646c0d1db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d1e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 -- 172.21.15.139:0/2120474109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 msgr2=0x5646c0d1e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d1e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 -- 172.21.15.139:0/2120474109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d241a0 msgr2=0x5646c0d1db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d241a0 0x5646c0d1db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 -- 172.21.15.139:0/2120474109 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c0a9bd80 con 0x5646c0d23880 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8ad401c880 tx=0x7f8ad4024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ff871f8804e618 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ac9ffb700 1 -- 172.21.15.139:0/2120474109 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad402f070 con 0x5646c0d23880 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ac9ffb700 1 -- 172.21.15.139:0/2120474109 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ad4022040 con 0x5646c0d23880 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.386+0000 7f8ac9ffb700 1 -- 172.21.15.139:0/2120474109 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4004960 con 0x5646c0d23880 2023-10-08T13:30:25.393 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- 172.21.15.139:0/2120474109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 msgr2=0x5646c0d23c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8ad401c880 tx=0x7f8ad4024000 comp rx=0 tx=0).stop 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- 172.21.15.139:0/2120474109 shutdown_connections 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d1e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d23c60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 --2- 172.21.15.139:0/2120474109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d241a0 0x5646c0d1db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- 172.21.15.139:0/2120474109 >> 172.21.15.139:0/2120474109 conn(0x5646c0c92200 msgr2=0x5646c0d18b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- 172.21.15.139:0/2120474109 shutdown_connections 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- 172.21.15.139:0/2120474109 wait complete. 2023-10-08T13:30:25.394 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.387+0000 7f8af6340b80 1 -- start start 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 Processor -- start 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 0x5646c0d27c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c70dd0 con 0x5646c0d241a0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c0d6b0 con 0x5646c0d23880 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c0d350 con 0x5646c0d1e0b0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8af6340b80 10 client.0 _ll_register_callbacks cb 0x5646c0a6a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae3fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 0x5646c0d27c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.395 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60696/0 (socket says 172.21.15.139:60696) 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:41890/0 (socket says 172.21.15.139:41890) 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.388+0000 7f8ae2ffd700 1 -- 172.21.15.139:0/1725587025 learned_addr learned my addr 172.21.15.139:0/1725587025 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 -- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 msgr2=0x5646c0d2a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 -- 172.21.15.139:0/1725587025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 msgr2=0x5646c0d27c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 0x5646c0d27c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 -- 172.21.15.139:0/1725587025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae410cda0 con 0x5646c0d23880 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 0x5646c0d27c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8012840 tx=0x7f8ad8012b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4023807c3503e03b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:30:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8017070 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646c0c38e50 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8ad8004830 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ad8004a30 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8af6340b80 10 client.26072 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5646c0a84c00 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.389+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646c0c38e50 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8ad801c620 con 0x5646c0d23880 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 10 client.26072 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 10 client.26072 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 20 client.26072 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d37e80 0x5646c0d3a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 4 client.26072 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646c0c69db0 con 0x5646c0d37e80 2023-10-08T13:30:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d37e80 0x5646c0d3a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d37e80 0x5646c0d3a2a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=821ba5b241ca4c74 server_cookie=35624a56ba74bc35 in_seq=0 out_seq=0 2023-10-08T13:30:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.390+0000 7f8ac2ffd700 10 client.26072 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1725587025 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5646c0c69db0 con 0x5646c0d37e80 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8ac2ffd700 10 client.26072 handle_command_reply: tid=0 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 client.26072 shutdown 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 msgr2=0x5646c0d27550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8012840 tx=0x7f8ad8012b50 comp rx=0 tx=0).stop 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 shutdown_connections 2023-10-08T13:30:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d241a0 0x5646c0d27c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d1e0b0 0x5646c0d2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d37e80 0x5646c0d3a2a0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1725587025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d27550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8ac2ffd700 0 client.26072 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 >> 172.21.15.139:0/1725587025 conn(0x5646c0c92200 msgr2=0x5646c0d18010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 shutdown_connections 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.391+0000 7f8af6340b80 1 -- 172.21.15.139:0/1725587025 wait complete. 2023-10-08T13:30:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.392+0000 7f8af6340b80 20 client.26072 trim_cache size 0 max 16384 2023-10-08T13:30:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 Processor -- start 2023-10-08T13:30:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 -- start start 2023-10-08T13:30:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.409 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d18790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0af18c0 con 0x5646c0d23880 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0c38e50 con 0x5646c0d1e0b0 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.407+0000 7f8af6340b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0d15830 con 0x5646c0d241a0 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60702/0 (socket says 172.21.15.139:60702) 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42184/0 (socket says 172.21.15.139:42184) 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 -- 172.21.15.139:0/3349425092 learned_addr learned my addr 172.21.15.139:0/3349425092 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d18790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 -- 172.21.15.139:0/3349425092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 msgr2=0x5646c0d18790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d18790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.410 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 -- 172.21.15.139:0/3349425092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 msgr2=0x5646c0d2ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 -- 172.21.15.139:0/3349425092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c0ac21f0 con 0x5646c0d1e0b0 2023-10-08T13:30:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:25.411 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.408+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ad401cfd0 tx=0x7f8ad4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97408b99c01bd78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.410+0000 7f8aca7fc700 1 -- 172.21.15.139:0/3349425092 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad402f040 con 0x5646c0d1e0b0 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.410+0000 7f8aca7fc700 1 -- 172.21.15.139:0/3349425092 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ad4004680 con 0x5646c0d1e0b0 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.410+0000 7f8aca7fc700 1 -- 172.21.15.139:0/3349425092 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4041440 con 0x5646c0d1e0b0 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.410+0000 7f8af6340b80 1 -- 172.21.15.139:0/3349425092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 msgr2=0x5646c0d27c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.410+0000 7f8af6340b80 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ad401cfd0 tx=0x7f8ad4009310 comp rx=0 tx=0).stop 2023-10-08T13:30:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 -- 172.21.15.139:0/3349425092 shutdown_connections 2023-10-08T13:30:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d18790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d1e0b0 0x5646c0d27c30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 --2- 172.21.15.139:0/3349425092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d23880 0x5646c0d2ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 -- 172.21.15.139:0/3349425092 >> 172.21.15.139:0/3349425092 conn(0x5646c0c92200 msgr2=0x5646c0d1e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 -- 172.21.15.139:0/3349425092 shutdown_connections 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 -- 172.21.15.139:0/3349425092 wait complete. 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 -- start start 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.411+0000 7f8af6340b80 1 Processor -- start 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d2cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d2d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0d19020 con 0x5646c0d1e0b0 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0d2d680 con 0x5646c0d23880 2023-10-08T13:30:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c0d2d840 con 0x5646c0d241a0 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8af6340b80 10 client.0 _ll_register_callbacks cb 0x7f8ad8009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42188/0 (socket says 172.21.15.139:42188) 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 -- 172.21.15.139:0/1640562046 learned_addr learned my addr 172.21.15.139:0/1640562046 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d2cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae3fff700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d2d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 -- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 msgr2=0x5646c0d2d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d2d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 -- 172.21.15.139:0/1640562046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 msgr2=0x5646c0d2cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:25.419 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d2cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 -- 172.21.15.139:0/1640562046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646c0a84c00 con 0x5646c0d1e0b0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d2cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ae37fe700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4006010 tx=0x7f8ad4004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408318cf3b98619b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.412+0000 7f8ac2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad404e070 con 0x5646c0d1e0b0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8ad4041c70 con 0x5646c0d1e0b0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ad4022040 con 0x5646c0d1e0b0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ad402f040 con 0x5646c0d1e0b0 2023-10-08T13:30:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 10 client.16623 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5646c0a9bd80 con 0x5646c0d1e0b0 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ad4022040 con 0x5646c0d1e0b0 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8ad4051020 con 0x5646c0d1e0b0 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 10 client.16623 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 20 client.16623 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d8bca0 0x5646c0d8e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 4 client.16623 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5646c0c69ad0 con 0x5646c0d8bca0 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.413+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d8bca0 0x5646c0d8e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.414+0000 7f8ac2ffd700 10 client.16623 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.414+0000 7f8ae2ffd700 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d8bca0 0x5646c0d8e0c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e07b004f54ba3c3b server_cookie=d78276f08e96e091 in_seq=0 out_seq=0 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.433+0000 7f8ac2ffd700 1 -- 172.21.15.139:0/1640562046 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5646c0c69ad0 con 0x5646c0d8bca0 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.433+0000 7f8ac2ffd700 10 client.16623 handle_command_reply: tid=0 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.433+0000 7f8af6340b80 1 client.16623 shutdown 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 msgr2=0x5646c0d18960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4006010 tx=0x7f8ad4004870 comp rx=0 tx=0).stop 2023-10-08T13:30:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 shutdown_connections 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5646c0d241a0 0x5646c0d2d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5646c0d1e0b0 0x5646c0d18960 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5646c0d8bca0 0x5646c0d8e0c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 --2- 172.21.15.139:0/1640562046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646c0d23880 0x5646c0d2cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8ac2ffd700 0 client.16623 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 >> 172.21.15.139:0/1640562046 conn(0x5646c0c92200 msgr2=0x5646c0d25de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 shutdown_connections 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 1 -- 172.21.15.139:0/1640562046 wait complete. 2023-10-08T13:30:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8af6340b80 20 client.16623 trim_cache size 0 max 16384 2023-10-08T13:30:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:30:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:30:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:30:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 msgr2=0x7f8acc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 0x7f8acc0a3ab0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400b2e0 tx=0x7f8ad4005960 comp rx=0 tx=0).stop 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 msgr2=0x7f8ae41957f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.434+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00d100 tx=0x7f8adc00d410 comp rx=0 tx=0).stop 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 shutdown_connections 2023-10-08T13:30:25.438 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8acc0a15f0 0x7f8acc0a3ab0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ae4105670 0x7f8ae41957f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae40ff8d0 0x7f8ae419b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 --2- 172.21.15.139:0/3597717083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4100290 0x7f8ae419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 >> 172.21.15.139:0/3597717083 conn(0x7f8ae40764c0 msgr2=0x7f8ae40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 shutdown_connections 2023-10-08T13:30:25.439 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:25.435+0000 7f8aea157700 1 -- 172.21.15.139:0/3597717083 wait complete. 2023-10-08T13:30:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:25 smithi155 ceph-mon[103467]: pgmap v388: 129 pgs: 129 active+clean; 57 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 284 op/s 2023-10-08T13:30:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:25 smithi139 ceph-mon[99506]: pgmap v388: 129 pgs: 129 active+clean; 57 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 284 op/s 2023-10-08T13:30:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:25 smithi187 ceph-mon[104336]: pgmap v388: 129 pgs: 129 active+clean; 57 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 284 op/s 2023-10-08T13:30:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:27 smithi155 ceph-mon[103467]: pgmap v389: 129 pgs: 129 active+clean; 59 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 413 op/s 2023-10-08T13:30:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:27 smithi139 ceph-mon[99506]: pgmap v389: 129 pgs: 129 active+clean; 59 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 413 op/s 2023-10-08T13:30:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:27 smithi187 ceph-mon[104336]: pgmap v389: 129 pgs: 129 active+clean; 59 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 413 op/s 2023-10-08T13:30:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:29 smithi155 ceph-mon[103467]: pgmap v390: 129 pgs: 129 active+clean; 59 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:29 smithi139 ceph-mon[99506]: pgmap v390: 129 pgs: 129 active+clean; 59 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:29 smithi187 ceph-mon[104336]: pgmap v390: 129 pgs: 129 active+clean; 59 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:31 smithi187 ceph-mon[104336]: pgmap v391: 129 pgs: 129 active+clean; 55 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:31 smithi155 ceph-mon[103467]: pgmap v391: 129 pgs: 129 active+clean; 55 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:31 smithi139 ceph-mon[99506]: pgmap v391: 129 pgs: 129 active+clean; 55 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 278 op/s 2023-10-08T13:30:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:33 smithi155 ceph-mon[103467]: pgmap v392: 129 pgs: 129 active+clean; 56 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2023-10-08T13:30:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:33 smithi139 ceph-mon[99506]: pgmap v392: 129 pgs: 129 active+clean; 56 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2023-10-08T13:30:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:33 smithi187 ceph-mon[104336]: pgmap v392: 129 pgs: 129 active+clean; 56 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 367 op/s 2023-10-08T13:30:35.802 INFO:tasks.workunit.client.0.smithi139.stdout:40000 copy from 0x5dfcb to 0x607bc, (0x27f1 bytes) at 0xf5933 2023-10-08T13:30:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:35 smithi155 ceph-mon[103467]: pgmap v393: 129 pgs: 129 active+clean; 57 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 292 op/s 2023-10-08T13:30:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:35 smithi139 ceph-mon[99506]: pgmap v393: 129 pgs: 129 active+clean; 57 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 292 op/s 2023-10-08T13:30:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:35 smithi187 ceph-mon[104336]: pgmap v393: 129 pgs: 129 active+clean; 57 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 292 op/s 2023-10-08T13:30:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:37 smithi155 ceph-mon[103467]: pgmap v394: 129 pgs: 129 active+clean; 57 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2023-10-08T13:30:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:37 smithi139 ceph-mon[99506]: pgmap v394: 129 pgs: 129 active+clean; 57 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2023-10-08T13:30:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:37 smithi187 ceph-mon[104336]: pgmap v394: 129 pgs: 129 active+clean; 57 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 391 op/s 2023-10-08T13:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 -- 172.21.15.139:0/196538687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2644105690 msgr2=0x7f2644105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 --2- 172.21.15.139:0/196538687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2644105690 0x7f2644105a70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2634009990 tx=0x7f2634009ca0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 -- 172.21.15.139:0/196538687 shutdown_connections 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 --2- 172.21.15.139:0/196538687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 0x7f264410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 --2- 172.21.15.139:0/196538687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2644105690 0x7f2644105a70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 --2- 172.21.15.139:0/196538687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26440ff5f0 0x7f26440ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 -- 172.21.15.139:0/196538687 >> 172.21.15.139:0/196538687 conn(0x7f26440fb0c0 msgr2=0x7f26440fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 -- 172.21.15.139:0/196538687 shutdown_connections 2023-10-08T13:30:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.558+0000 7f2648998700 1 -- 172.21.15.139:0/196538687 wait complete. 2023-10-08T13:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 Processor -- start 2023-10-08T13:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 -- start start 2023-10-08T13:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 0x7f26441017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2644105690 0x7f2644101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26441a4ea0 con 0x7f26440ff5f0 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26441a5010 con 0x7f26440fffb0 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2648998700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26441a51d0 con 0x7f2644105690 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f264259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f264259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42202/0 (socket says 172.21.15.139:42202) 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f264259c700 1 -- 172.21.15.139:0/3013377284 learned_addr learned my addr 172.21.15.139:0/3013377284 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2642d9d700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2644105690 0x7f2644101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.559+0000 7f2641d9b700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 0x7f26441017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 -- 172.21.15.139:0/3013377284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2644105690 msgr2=0x7f2644101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2644105690 0x7f2644101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 -- 172.21.15.139:0/3013377284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 msgr2=0x7f26441017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 0x7f26441017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 -- 172.21.15.139:0/3013377284 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340095f0 con 0x7f26440ff5f0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f264259c700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2634000c00 tx=0x7f2634004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f26337fe700 1 -- 172.21.15.139:0/3013377284 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263401d070 con 0x7f26440ff5f0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26441a5450 con 0x7f26440ff5f0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f26337fe700 1 -- 172.21.15.139:0/3013377284 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2634021410 con 0x7f26440ff5f0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f26337fe700 1 -- 172.21.15.139:0/3013377284 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634017650 con 0x7f26440ff5f0 2023-10-08T13:30:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.560+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26441a5930 con 0x7f26440ff5f0 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.562+0000 7f26337fe700 1 -- 172.21.15.139:0/3013377284 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f2634021580 con 0x7f26440ff5f0 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.563+0000 7f26337fe700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 0x7f262c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.563+0000 7f2641d9b700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 0x7f262c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.563+0000 7f26337fe700 1 -- 172.21.15.139:0/3013377284 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f26340ce610 con 0x7f26440ff5f0 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.563+0000 7f2641d9b700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 0x7f262c0a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f26441029c0 tx=0x7f2638009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 Processor -- start 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 -- start start 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd47c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd42510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901ccaa400 con 0x55901cd481a0 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cc9bbc0 con 0x55901cd420b0 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.564+0000 7f2654b81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cc994e0 con 0x55901cd47880 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f264259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd47c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42212/0 (socket says 172.21.15.139:42212) 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 -- 172.21.15.139:0/998113564 learned_addr learned my addr 172.21.15.139:0/998113564 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2642d9d700 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd42510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 -- 172.21.15.139:0/998113564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 msgr2=0x55901cd47c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd47c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 -- 172.21.15.139:0/998113564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 msgr2=0x55901cd42510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd42510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 -- 172.21.15.139:0/998113564 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55901cabfd80 con 0x55901cd481a0 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f264259c700 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd47c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2641d9b700 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2638011d50 tx=0x7f2638014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0d559a82ac426b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2630ff9700 1 -- 172.21.15.139:0/998113564 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800eb20 con 0x55901cd481a0 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2630ff9700 1 -- 172.21.15.139:0/998113564 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2638021070 con 0x55901cd481a0 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.565+0000 7f2630ff9700 1 -- 172.21.15.139:0/998113564 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263801d670 con 0x55901cd481a0 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 -- 172.21.15.139:0/998113564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 msgr2=0x55901cd41b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2638011d50 tx=0x7f2638014000 comp rx=0 tx=0).stop 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 -- 172.21.15.139:0/998113564 shutdown_connections 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd42510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd47c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 --2- 172.21.15.139:0/998113564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd41b70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 -- 172.21.15.139:0/998113564 >> 172.21.15.139:0/998113564 conn(0x55901ccb6200 msgr2=0x55901cd3cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 -- 172.21.15.139:0/998113564 shutdown_connections 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.566+0000 7f2654b81b80 1 -- 172.21.15.139:0/998113564 wait complete. 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 -- start start 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 Processor -- start 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd47880 0x55901cd4ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd4bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cc94dd0 con 0x55901cd420b0 2023-10-08T13:30:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cc316b0 con 0x55901cd47880 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cc31350 con 0x55901cd481a0 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2654b81b80 10 client.0 _ll_register_callbacks cb 0x55901ca8e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42216/0 (socket says 172.21.15.139:42216) 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 -- 172.21.15.139:0/1148857395 learned_addr learned my addr 172.21.15.139:0/1148857395 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2642d9d700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd4bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f2641d9b700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd47880 0x55901cd4ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 -- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 msgr2=0x55901cd4bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd4bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 -- 172.21.15.139:0/1148857395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd47880 msgr2=0x55901cd4ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd47880 0x55901cd4ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.567+0000 7f264259c700 1 -- 172.21.15.139:0/1148857395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26441a5930 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f264259c700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2634021c10 tx=0x7f26340977a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2635e1689defa1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340b1020 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f263409ba40 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55901cc5ce50 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f263409b340 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 10 client.16635 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f2638017070 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55901cc5ce50 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f26340b8020 con 0x55901cd420b0 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 10 client.16635 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 20 client.16635 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cd5ba80 0x55901cd5dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 4 client.16635 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.568+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55901cc8ddb0 con 0x55901cd5ba80 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.569+0000 7f2641d9b700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cd5ba80 0x55901cd5dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.569+0000 7f2629ffb700 10 client.16635 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.569+0000 7f2641d9b700 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cd5ba80 0x55901cd5dea0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d942d20bfecfc79 server_cookie=51d960dae5676adc in_seq=0 out_seq=0 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2629ffb700 1 -- 172.21.15.139:0/1148857395 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55901cc8ddb0 con 0x55901cd5ba80 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2629ffb700 10 client.16635 handle_command_reply: tid=0 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 client.16635 shutdown 2023-10-08T13:30:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 msgr2=0x55901cd4b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2634021c10 tx=0x7f26340977a0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 shutdown_connections 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd4bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd420b0 0x55901cd4b550 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cd5ba80 0x55901cd5dea0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 --2- 172.21.15.139:0/1148857395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd47880 0x55901cd4ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2629ffb700 0 client.16635 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 >> 172.21.15.139:0/1148857395 conn(0x55901ccb6200 msgr2=0x55901cd3c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 shutdown_connections 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 1 -- 172.21.15.139:0/1148857395 wait complete. 2023-10-08T13:30:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.570+0000 7f2654b81b80 20 client.16635 trim_cache size 0 max 16384 2023-10-08T13:30:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 Processor -- start 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 -- start start 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 0x55901cd52be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd3c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cb158c0 con 0x55901cd47880 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cd372b0 con 0x55901cd420b0 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.587+0000 7f2654b81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cd4e070 con 0x55901cd481a0 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f2641d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 0x55901cd52be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60744/0 (socket says 172.21.15.139:60744) 2023-10-08T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 -- 172.21.15.139:0/3803283144 learned_addr learned my addr 172.21.15.139:0/3803283144 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f2642d9d700 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd3c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 -- 172.21.15.139:0/3803283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 msgr2=0x55901cd3c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd3c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 -- 172.21.15.139:0/3803283144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 msgr2=0x55901cd52be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 0x55901cd52be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 -- 172.21.15.139:0/3803283144 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55901caa8c00 con 0x55901cd420b0 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f2641d9b700 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 0x55901cd52be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f264259c700 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2634097db0 tx=0x7f2634009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d0f544b1ebfb9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f26317fa700 1 -- 172.21.15.139:0/3803283144 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340b1070 con 0x55901cd420b0 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f26317fa700 1 -- 172.21.15.139:0/3803283144 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f263409ba40 con 0x55901cd420b0 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.588+0000 7f26317fa700 1 -- 172.21.15.139:0/3803283144 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263409b3b0 con 0x55901cd420b0 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 -- 172.21.15.139:0/3803283144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 msgr2=0x55901cd41b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.595 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2634097db0 tx=0x7f2634009ca0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 -- 172.21.15.139:0/3803283144 shutdown_connections 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd481a0 0x55901cd3c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd41b70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 --2- 172.21.15.139:0/3803283144 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd47880 0x55901cd52be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 -- 172.21.15.139:0/3803283144 >> 172.21.15.139:0/3803283144 conn(0x55901ccb6200 msgr2=0x55901cd42490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 -- 172.21.15.139:0/3803283144 shutdown_connections 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.589+0000 7f2654b81b80 1 -- 172.21.15.139:0/3803283144 wait complete. 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 -- start start 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 Processor -- start 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd44a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.596 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd43390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cd45080 con 0x55901cd481a0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cd451f0 con 0x55901cd420b0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55901cd43920 con 0x55901cd47880 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2654b81b80 10 client.0 _ll_register_callbacks cb 0x7f2634097680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60750/0 (socket says 172.21.15.139:60750) 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 -- 172.21.15.139:0/4285902158 learned_addr learned my addr 172.21.15.139:0/4285902158 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2641d9b700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd44a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f2642d9d700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd43390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 -- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 msgr2=0x55901cd44a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd44a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.597 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 -- 172.21.15.139:0/4285902158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 msgr2=0x55901cd43390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd43390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.590+0000 7f264259c700 1 -- 172.21.15.139:0/4285902158 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263802a040 con 0x55901cd420b0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f264259c700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26340ce8f0 tx=0x7f263409bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d76d2f8324e373fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26340b1070 con 0x55901cd420b0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f263409f490 con 0x55901cd420b0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2638021070 con 0x55901cd420b0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26340a3640 con 0x55901cd420b0 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2654b81b80 10 client.26096 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:38.598 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f2638017070 con 0x55901cd420b0 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2638021070 con 0x55901cd420b0 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f26340b8070 con 0x55901cd420b0 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2654b81b80 10 client.26096 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.591+0000 7f2654b81b80 10 client.26096 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2654b81b80 20 client.26096 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cdb01f0 0x55901cdb2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2654b81b80 4 client.26096 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55901cc8dad0 con 0x55901cdb01f0 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2641d9b700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cdb01f0 0x55901cdb2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2629ffb700 10 client.26096 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.592+0000 7f2641d9b700 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cdb01f0 0x55901cdb2610 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f79d393f07c19956 server_cookie=8a2b1345fb52bd81 in_seq=0 out_seq=0 2023-10-08T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2629ffb700 1 -- 172.21.15.139:0/4285902158 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55901cc8dad0 con 0x55901cdb01f0 2023-10-08T13:30:38.615 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2629ffb700 10 client.26096 handle_command_reply: tid=0 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 client.26096 shutdown 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 msgr2=0x55901cd444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26340ce8f0 tx=0x7f263409bbb0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 shutdown_connections 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55901cd481a0 0x55901cd43390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55901cdb01f0 0x55901cdb2610 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55901cd420b0 0x55901cd444f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 --2- 172.21.15.139:0/4285902158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55901cd47880 0x55901cd44a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2629ffb700 0 client.26096 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 >> 172.21.15.139:0/4285902158 conn(0x55901ccb6200 msgr2=0x55901cd49d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 shutdown_connections 2023-10-08T13:30:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 1 -- 172.21.15.139:0/4285902158 wait complete. 2023-10-08T13:30:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.614+0000 7f2654b81b80 20 client.26096 trim_cache size 0 max 16384 2023-10-08T13:30:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:30:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:30:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:30:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 msgr2=0x7f262c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 0x7f262c0a3ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f26441029c0 tx=0x7f2638009260 comp rx=0 tx=0).stop 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 msgr2=0x7f2644101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2634000c00 tx=0x7f2634004730 comp rx=0 tx=0).stop 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 shutdown_connections 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f262c0a15f0 0x7f262c0a3ab0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2644105690 0x7f2644101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f26440ff5f0 0x7f2644101290 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 --2- 172.21.15.139:0/3013377284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26440fffb0 0x7f26441017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 >> 172.21.15.139:0/3013377284 conn(0x7f26440fb0c0 msgr2=0x7f26440fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 shutdown_connections 2023-10-08T13:30:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:38.615+0000 7f2648998700 1 -- 172.21.15.139:0/3013377284 wait complete. 2023-10-08T13:30:39.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:30:39.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 -- 172.21.15.139:0/844590685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88440fffe0 msgr2=0x7f884410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.483 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 --2- 172.21.15.139:0/844590685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88440fffe0 0x7f884410c4e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f883c009f90 tx=0x7f883c00b330 comp rx=0 tx=0).stop 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 -- 172.21.15.139:0/844590685 shutdown_connections 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 --2- 172.21.15.139:0/844590685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88440fffe0 0x7f884410c4e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 --2- 172.21.15.139:0/844590685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88441056b0 0x7f8844105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 --2- 172.21.15.139:0/844590685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f88440ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 -- 172.21.15.139:0/844590685 >> 172.21.15.139:0/844590685 conn(0x7f8844076780 msgr2=0x7f8844076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 -- 172.21.15.139:0/844590685 shutdown_connections 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.482+0000 7f884adc2700 1 -- 172.21.15.139:0/844590685 wait complete. 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 Processor -- start 2023-10-08T13:30:39.484 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 -- start start 2023-10-08T13:30:39.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 0x7f884419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88441056b0 0x7f8844196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.486 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844196fa0 con 0x7f88441056b0 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844197110 con 0x7f88440ff620 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884adc2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88441972d0 con 0x7f88440fffe0 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60764/0 (socket says 172.21.15.139:60764) 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f884935f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88441056b0 0x7f8844196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 -- 172.21.15.139:0/2900585280 learned_addr learned my addr 172.21.15.139:0/2900585280 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8843fff700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 0x7f884419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 -- 172.21.15.139:0/2900585280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 msgr2=0x7f884419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 0x7f884419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.487 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 -- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88441056b0 msgr2=0x7f8844196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88441056b0 0x7f8844196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.483+0000 7f8848b5e700 1 -- 172.21.15.139:0/2900585280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009c40 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f883800e970 tx=0x7f883800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f8841ffb700 1 -- 172.21.15.139:0/2900585280 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800cbd0 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88441975b0 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f8841ffb700 1 -- 172.21.15.139:0/2900585280 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f883800eec0 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f8841ffb700 1 -- 172.21.15.139:0/2900585280 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838003cc0 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.484+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88441a3800 con 0x7f88440ff620 2023-10-08T13:30:39.488 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.485+0000 7f8843fff700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 0x7f884419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:30:39.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.486+0000 7f8841ffb700 1 -- 172.21.15.139:0/2900585280 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f883800cd30 con 0x7f88440ff620 2023-10-08T13:30:39.490 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.487+0000 7f8841ffb700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 0x7f88340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.487+0000 7f8841ffb700 1 -- 172.21.15.139:0/2900585280 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8838014070 con 0x7f88440ff620 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.487+0000 7f8843fff700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 0x7f88340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.487+0000 7f8843fff700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 0x7f88340a3b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8844197b00 tx=0x7f8830009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.488+0000 7f8856fabb80 1 Processor -- start 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.488+0000 7f8856fabb80 1 -- start start 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.488+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf174e80 0x5624bf175260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.488+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf180650 0x5624bf182a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8856fabb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf0de460 con 0x5624bf1757a0 2023-10-08T13:30:39.491 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8856fabb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf0cfc20 con 0x5624bf180650 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8856fabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf0cd540 con 0x5624bf174e80 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42254/0 (socket says 172.21.15.139:42254) 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 -- 172.21.15.139:0/1361725657 learned_addr learned my addr 172.21.15.139:0/1361725657 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8848b5e700 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf174e80 0x5624bf175260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f884935f700 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf180650 0x5624bf182a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 -- 172.21.15.139:0/1361725657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf174e80 msgr2=0x5624bf175260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf174e80 0x5624bf175260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 -- 172.21.15.139:0/1361725657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf180650 msgr2=0x5624bf182a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf180650 0x5624bf182a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.492 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 -- 172.21.15.139:0/1361725657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624beef3de0 con 0x5624bf1757a0 2023-10-08T13:30:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f8843fff700 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8830011f50 tx=0x7f8830014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fba0d51c099e66f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f882effd700 1 -- 172.21.15.139:0/1361725657 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830009ea0 con 0x5624bf1757a0 2023-10-08T13:30:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f882effd700 1 -- 172.21.15.139:0/1361725657 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8830016070 con 0x5624bf1757a0 2023-10-08T13:30:39.493 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.489+0000 7f882effd700 1 -- 172.21.15.139:0/1361725657 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883001d610 con 0x5624bf1757a0 2023-10-08T13:30:39.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 -- 172.21.15.139:0/1361725657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 msgr2=0x5624bf180110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8830011f50 tx=0x7f8830014000 comp rx=0 tx=0).stop 2023-10-08T13:30:39.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 -- 172.21.15.139:0/1361725657 shutdown_connections 2023-10-08T13:30:39.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf180650 0x5624bf182a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.497 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf174e80 0x5624bf175260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1361725657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf180110 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 -- 172.21.15.139:0/1361725657 >> 172.21.15.139:0/1361725657 conn(0x5624bf0ea260 msgr2=0x5624bf1712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 -- 172.21.15.139:0/1361725657 shutdown_connections 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.490+0000 7f8856fabb80 1 -- 172.21.15.139:0/1361725657 wait complete. 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 -- start start 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 Processor -- start 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf17da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf0c8e30 con 0x5624bf1757a0 2023-10-08T13:30:39.498 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf065710 con 0x5624bf174e80 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf0653b0 con 0x5624bf180650 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8856fabb80 10 client.0 _ll_register_callbacks cb 0x5624beec2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.491+0000 7f8843fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42262/0 (socket says 172.21.15.139:42262) 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60778/0 (socket says 172.21.15.139:60778) 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 -- 172.21.15.139:0/2668624427 learned_addr learned my addr 172.21.15.139:0/2668624427 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f884935f700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf17da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 -- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 msgr2=0x5624bf17da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf17da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.499 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 -- 172.21.15.139:0/2668624427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 msgr2=0x5624bf180060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 -- 172.21.15.139:0/2668624427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830011c30 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8843fff700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f883001f6d0 tx=0x7f883001fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1d7c1ef70c8c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8823fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883002d070 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f8830018070 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624bf090eb0 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f883001f8f0 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8856fabb80 10 client.16653 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.492+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5624beedcc60 con 0x5624bf1757a0 2023-10-08T13:30:39.500 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5624bf090eb0 con 0x5624bf1757a0 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8830004ad0 con 0x5624bf1757a0 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 10 client.16653 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 20 client.16653 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf190100 0x5624bf192520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 4 client.16653 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624bf0c1e10 con 0x5624bf190100 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf190100 0x5624bf192520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8823fff700 10 client.16653 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.493+0000 7f8848b5e700 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf190100 0x5624bf192520 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3409340dc0798d9 server_cookie=9169cdeaacf6e5fc in_seq=0 out_seq=0 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8823fff700 1 -- 172.21.15.139:0/2668624427 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624bf0c1e10 con 0x5624bf190100 2023-10-08T13:30:39.501 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8823fff700 10 client.16653 handle_command_reply: tid=0 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 client.16653 shutdown 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 msgr2=0x5624bf17d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f883001f6d0 tx=0x7f883001fb00 comp rx=0 tx=0).stop 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 shutdown_connections 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf17da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf190100 0x5624bf192520 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf180060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8823fff700 0 client.16653 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 --2- 172.21.15.139:0/2668624427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf17d3f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 >> 172.21.15.139:0/2668624427 conn(0x5624bf0ea260 msgr2=0x5624bf170ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 shutdown_connections 2023-10-08T13:30:39.502 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.494+0000 7f8856fabb80 1 -- 172.21.15.139:0/2668624427 wait complete. 2023-10-08T13:30:39.503 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.495+0000 7f8856fabb80 20 client.16653 trim_cache size 0 max 16384 2023-10-08T13:30:39.515 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.513+0000 7f8856fabb80 1 Processor -- start 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.513+0000 7f8856fabb80 1 -- start start 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.513+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.513+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf1757a0 0x5624bf1871a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.513+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf170cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8856fabb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bef49920 con 0x5624bf174e80 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8856fabb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf1760d0 con 0x5624bf1757a0 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8856fabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf16b5a0 con 0x5624bf180650 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42266/0 (socket says 172.21.15.139:42266) 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 -- 172.21.15.139:0/1437122652 learned_addr learned my addr 172.21.15.139:0/1437122652 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:39.516 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8843fff700 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf1757a0 0x5624bf1871a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f884935f700 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf170cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 -- 172.21.15.139:0/1437122652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 msgr2=0x5624bf170cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf170cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 -- 172.21.15.139:0/1437122652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf1757a0 msgr2=0x5624bf1871a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf1757a0 0x5624bf1871a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 -- 172.21.15.139:0/1437122652 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bef1a250 con 0x5624bf174e80 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f8848b5e700 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f88380cb090 tx=0x7f8838003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb98984f3028944 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f882f7fe700 1 -- 172.21.15.139:0/1437122652 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883809a320 con 0x5624bf174e80 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f882f7fe700 1 -- 172.21.15.139:0/1437122652 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f883809e470 con 0x5624bf174e80 2023-10-08T13:30:39.517 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.514+0000 7f882f7fe700 1 -- 172.21.15.139:0/1437122652 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380cd2c0 con 0x5624bf174e80 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 -- 172.21.15.139:0/1437122652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 msgr2=0x5624bf17da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f88380cb090 tx=0x7f8838003680 comp rx=0 tx=0).stop 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 -- 172.21.15.139:0/1437122652 shutdown_connections 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf170cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf174e80 0x5624bf17da00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.521 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 --2- 172.21.15.139:0/1437122652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf1757a0 0x5624bf1871a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 -- 172.21.15.139:0/1437122652 >> 172.21.15.139:0/1437122652 conn(0x5624bf0ea260 msgr2=0x5624bf1704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 -- 172.21.15.139:0/1437122652 shutdown_connections 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.515+0000 7f8856fabb80 1 -- 172.21.15.139:0/1437122652 wait complete. 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 -- start start 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 Processor -- start 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf185730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf1dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf1dd470 con 0x5624bf1757a0 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf1dd5e0 con 0x5624bf174e80 2023-10-08T13:30:39.522 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bf1dd7a0 con 0x5624bf180650 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8856fabb80 10 client.0 _ll_register_callbacks cb 0x7f88300091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8848b5e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60792/0 (socket says 172.21.15.139:60792) 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8848b5e700 1 -- 172.21.15.139:0/3742280791 learned_addr learned my addr 172.21.15.139:0/3742280791 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f884935f700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf1dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.516+0000 7f8843fff700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf185730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 -- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 msgr2=0x5624bf1dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf1dcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 -- 172.21.15.139:0/3742280791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 msgr2=0x5624bf185730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf185730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.523 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 -- 172.21.15.139:0/3742280791 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88441a3800 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8848b5e700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f883800c5b0 tx=0x7f8838009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37c58de636f05a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8823fff700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883801fe20 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8830016070 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f88380986c0 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88380cd2c0 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8856fabb80 10 client.26114 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x5624beef22b0 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.517+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8830016070 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f88380998a0 con 0x5624bf174e80 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 10 client.26114 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 10 client.26114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 20 client.26114 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf1e4e60 0x5624bf1e7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 4 client.26114 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5624bf0c1b30 con 0x5624bf1e4e60 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8843fff700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf1e4e60 0x5624bf1e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8823fff700 10 client.26114 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.518+0000 7f8843fff700 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf1e4e60 0x5624bf1e7280 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=195cfba0e9a47b35 server_cookie=69f66539b707640e in_seq=0 out_seq=0 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8823fff700 1 -- 172.21.15.139:0/3742280791 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5624bf0c1b30 con 0x5624bf1e4e60 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8823fff700 10 client.26114 handle_command_reply: tid=0 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 client.26114 shutdown 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 msgr2=0x5624bf1851f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f883800c5b0 tx=0x7f8838009860 comp rx=0 tx=0).stop 2023-10-08T13:30:39.525 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 shutdown_connections 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5624bf180650 0x5624bf1dcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5624bf1e4e60 0x5624bf1e7280 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624bf174e80 0x5624bf1851f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 --2- 172.21.15.139:0/3742280791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5624bf1757a0 0x5624bf185730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8823fff700 0 client.26114 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 >> 172.21.15.139:0/3742280791 conn(0x5624bf0ea260 msgr2=0x5624bf17bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 shutdown_connections 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 1 -- 172.21.15.139:0/3742280791 wait complete. 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.519+0000 7f8856fabb80 20 client.26114 trim_cache size 0 max 16384 2023-10-08T13:30:39.526 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:30:39.527 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:30:39.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 msgr2=0x7f88340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 0x7f88340a3b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8844197b00 tx=0x7f8830009310 comp rx=0 tx=0).stop 2023-10-08T13:30:39.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 msgr2=0x7f884419c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:39.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f883800e970 tx=0x7f883800ec80 comp rx=0 tx=0).stop 2023-10-08T13:30:39.528 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 shutdown_connections 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f88340a1670 0x7f88340a3b30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88441056b0 0x7f8844196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88440ff620 0x7f884419c810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 --2- 172.21.15.139:0/2900585280 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88440fffe0 0x7f884419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 >> 172.21.15.139:0/2900585280 conn(0x7f8844076780 msgr2=0x7f88440fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 shutdown_connections 2023-10-08T13:30:39.529 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:30:39.520+0000 7f884adc2700 1 -- 172.21.15.139:0/2900585280 wait complete. 2023-10-08T13:30:39.534 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:30:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:39 smithi155 ceph-mon[103467]: pgmap v395: 129 pgs: 129 active+clean; 57 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 260 op/s 2023-10-08T13:30:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:39 smithi139 ceph-mon[99506]: pgmap v395: 129 pgs: 129 active+clean; 57 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 260 op/s 2023-10-08T13:30:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:39 smithi187 ceph-mon[104336]: pgmap v395: 129 pgs: 129 active+clean; 57 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 260 op/s 2023-10-08T13:30:41.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:41 smithi187 ceph-mon[104336]: pgmap v396: 129 pgs: 129 active+clean; 59 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-10-08T13:30:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:41 smithi155 ceph-mon[103467]: pgmap v396: 129 pgs: 129 active+clean; 59 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-10-08T13:30:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:41 smithi139 ceph-mon[99506]: pgmap v396: 129 pgs: 129 active+clean; 59 MiB data, 985 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2023-10-08T13:30:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:43 smithi155 ceph-mon[103467]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2023-10-08T13:30:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:43 smithi139 ceph-mon[99506]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2023-10-08T13:30:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:43 smithi187 ceph-mon[104336]: pgmap v397: 129 pgs: 129 active+clean; 55 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 390 op/s 2023-10-08T13:30:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:45 smithi155 ceph-mon[103467]: pgmap v398: 129 pgs: 129 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2023-10-08T13:30:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:45 smithi139 ceph-mon[99506]: pgmap v398: 129 pgs: 129 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2023-10-08T13:30:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:45 smithi187 ceph-mon[104336]: pgmap v398: 129 pgs: 129 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 305 op/s 2023-10-08T13:30:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:47 smithi155 ceph-mon[103467]: pgmap v399: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-10-08T13:30:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:47 smithi139 ceph-mon[99506]: pgmap v399: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-10-08T13:30:48.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:47 smithi187 ceph-mon[104336]: pgmap v399: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 387 op/s 2023-10-08T13:30:49.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:48 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:30:49.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:48 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:30:49.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:48 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:30:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:49 smithi155 ceph-mon[103467]: pgmap v400: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 288 op/s 2023-10-08T13:30:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:30:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:30:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:30:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:49 smithi139 ceph-mon[99506]: pgmap v400: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 288 op/s 2023-10-08T13:30:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:30:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:30:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:30:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:49 smithi187 ceph-mon[104336]: pgmap v400: 129 pgs: 129 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 288 op/s 2023-10-08T13:30:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:30:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:30:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:30:51.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:51 smithi187 ceph-mon[104336]: pgmap v401: 129 pgs: 129 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2023-10-08T13:30:51.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 -- 172.21.15.139:0/2285566191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6090105670 msgr2=0x7f6090105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 --2- 172.21.15.139:0/2285566191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6090105670 0x7f6090105a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6084009990 tx=0x7f6084009ca0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 -- 172.21.15.139:0/2285566191 shutdown_connections 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 --2- 172.21.15.139:0/2285566191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090100290 0x7f609010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 --2- 172.21.15.139:0/2285566191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6090105670 0x7f6090105a50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 --2- 172.21.15.139:0/2285566191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60900ff8d0 0x7f60900ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 -- 172.21.15.139:0/2285566191 >> 172.21.15.139:0/2285566191 conn(0x7f60900764c0 msgr2=0x7f60900768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 -- 172.21.15.139:0/2285566191 shutdown_connections 2023-10-08T13:30:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.743+0000 7f6096a6f700 1 -- 172.21.15.139:0/2285566191 wait complete. 2023-10-08T13:30:51.747 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 Processor -- start 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 -- start start 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6090100290 0x7f609019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090105670 0x7f60901957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090195e20 con 0x7f60900ff8d0 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090195f90 con 0x7f6090105670 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f6096a6f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090196150 con 0x7f6090100290 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f609480b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f609480b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42284/0 (socket says 172.21.15.139:42284) 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f609480b700 1 -- 172.21.15.139:0/1224399283 learned_addr learned my addr 172.21.15.139:0/1224399283 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:51.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f608ffff700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6090100290 0x7f609019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.744+0000 7f609500c700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090105670 0x7f60901957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 -- 172.21.15.139:0/1224399283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6090100290 msgr2=0x7f609019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6090100290 0x7f609019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 -- 172.21.15.139:0/1224399283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090105670 msgr2=0x7f60901957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090105670 0x7f60901957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 -- 172.21.15.139:0/1224399283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60840095f0 con 0x7f60900ff8d0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f609480b700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6084000c00 tx=0x7f6084004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f608dffb700 1 -- 172.21.15.139:0/1224399283 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608401d070 con 0x7f60900ff8d0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f608dffb700 1 -- 172.21.15.139:0/1224399283 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6084022470 con 0x7f60900ff8d0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f608dffb700 1 -- 172.21.15.139:0/1224399283 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6084017650 con 0x7f60900ff8d0 2023-10-08T13:30:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60901963d0 con 0x7f60900ff8d0 2023-10-08T13:30:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.745+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60901a2670 con 0x7f60900ff8d0 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.748+0000 7f608dffb700 1 -- 172.21.15.139:0/1224399283 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f60840225e0 con 0x7f60900ff8d0 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.748+0000 7f608dffb700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 0x7f60800a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.748+0000 7f608dffb700 1 -- 172.21.15.139:0/1224399283 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f60840ce530 con 0x7f60900ff8d0 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f608ffff700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 0x7f60800a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 Processor -- start 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 -- start start 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f608ffff700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 0x7f60800a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6090196bd0 tx=0x7f607c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c91f400 con 0x55979c9bbd80 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c910bc0 con 0x55979c9b7770 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c90e4e0 con 0x55979c9bb9a0 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f608ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f609480b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f609480b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42008/0 (socket says 172.21.15.139:42008) 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f609480b700 1 -- 172.21.15.139:0/427223524 learned_addr learned my addr 172.21.15.139:0/427223524 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f608ffff700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42294/0 (socket says 172.21.15.139:42294) 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.749+0000 7f609500c700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 -- 172.21.15.139:0/427223524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 msgr2=0x55979c9cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 -- 172.21.15.139:0/427223524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 msgr2=0x55979c9b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 -- 172.21.15.139:0/427223524 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55979c734d80 con 0x55979c9bb9a0 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609500c700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f609480b700 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6084022890 tx=0x7f608409ae90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c571107b6e215137 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f607affd700 1 -- 172.21.15.139:0/427223524 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608409b260 con 0x55979c9bb9a0 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f607affd700 1 -- 172.21.15.139:0/427223524 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608409f3b0 con 0x55979c9bb9a0 2023-10-08T13:30:51.754 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.750+0000 7f607affd700 1 -- 172.21.15.139:0/427223524 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608409b4c0 con 0x55979c9bb9a0 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- 172.21.15.139:0/427223524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 msgr2=0x55979c9b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6084022890 tx=0x7f608409ae90 comp rx=0 tx=0).stop 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- 172.21.15.139:0/427223524 shutdown_connections 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9b6ca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/427223524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- 172.21.15.139:0/427223524 >> 172.21.15.139:0/427223524 conn(0x55979c92b200 msgr2=0x55979c9b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- 172.21.15.139:0/427223524 shutdown_connections 2023-10-08T13:30:51.755 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- 172.21.15.139:0/427223524 wait complete. 2023-10-08T13:30:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 -- start start 2023-10-08T13:30:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.751+0000 7f60a2c58b80 1 Processor -- start 2023-10-08T13:30:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.758 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bbd80 0x55979c9c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c909dd0 con 0x55979c9b7770 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c8a66b0 con 0x55979c9bb9a0 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c8a6350 con 0x55979c9bbd80 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f60a2c58b80 10 client.0 _ll_register_callbacks cb 0x55979c7037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f609480b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f609480b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42298/0 (socket says 172.21.15.139:42298) 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f609480b700 1 -- 172.21.15.139:0/3604440335 learned_addr learned my addr 172.21.15.139:0/3604440335 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f609500c700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bbd80 0x55979c9c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 -- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bbd80 msgr2=0x55979c9c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bbd80 0x55979c9c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.759 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 -- 172.21.15.139:0/3604440335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 msgr2=0x55979c9cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f608ffff700 1 -- 172.21.15.139:0/3604440335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6088011230 con 0x55979c9bb9a0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.752+0000 7f609480b700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f608ffff700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9c8cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55979c9b2840 tx=0x7f607c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48b96531e49b9f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607c022070 con 0x55979c9bb9a0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f607c0044f0 con 0x55979c9bb9a0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55979c8d1e50 con 0x55979c9bb9a0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f607c003d40 con 0x55979c9bb9a0 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f60a2c58b80 10 client.26126 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:51.760 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f6084095e70 con 0x55979c9bb9a0 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55979c8d1e50 con 0x55979c9bb9a0 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.753+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f607c01c530 con 0x55979c9bb9a0 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 10 client.26126 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 10 client.26126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 20 client.26126 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979c9d92f0 0x55979c9db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 4 client.26126 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:30:51.761 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55979c902db0 con 0x55979c9d92f0 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f609480b700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979c9d92f0 0x55979c9db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f606ffff700 10 client.26126 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.754+0000 7f609480b700 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979c9d92f0 0x55979c9db710 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a09fc54830a6d0 server_cookie=bd4f924670dffd7 in_seq=0 out_seq=0 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f606ffff700 1 -- 172.21.15.139:0/3604440335 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55979c902db0 con 0x55979c9d92f0 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f606ffff700 10 client.26126 handle_command_reply: tid=0 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 client.26126 shutdown 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 msgr2=0x55979c9c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9c8cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55979c9b2840 tx=0x7f607c0047c0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 shutdown_connections 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bbd80 0x55979c9c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9b7770 0x55979c9cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.762 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979c9d92f0 0x55979c9db710 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/3604440335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9c8cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f606ffff700 0 client.26126 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.755+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 >> 172.21.15.139:0/3604440335 conn(0x55979c92b200 msgr2=0x55979c9b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.756+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 shutdown_connections 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.756+0000 7f60a2c58b80 1 -- 172.21.15.139:0/3604440335 wait complete. 2023-10-08T13:30:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.756+0000 7f60a2c58b80 20 client.26126 trim_cache size 0 max 16384 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.771+0000 7f60a2c58b80 1 Processor -- start 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.771+0000 7f60a2c58b80 1 -- start start 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c78a8c0 con 0x55979c9bbd80 2023-10-08T13:30:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c9b7b50 con 0x55979c9b7770 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c9b3350 con 0x55979c9bb9a0 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609480b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42310/0 (socket says 172.21.15.139:42310) 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 -- 172.21.15.139:0/749020738 learned_addr learned my addr 172.21.15.139:0/749020738 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609480b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60826/0 (socket says 172.21.15.139:60826) 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f608ffff700 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 -- 172.21.15.139:0/749020738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 msgr2=0x55979c9d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 -- 172.21.15.139:0/749020738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 msgr2=0x55979c9d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 -- 172.21.15.139:0/749020738 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55979c71dc00 con 0x55979c9bbd80 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609480b700 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f609500c700 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6088003c20 tx=0x7f6088009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e27af346658ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.772+0000 7f607b7fe700 1 -- 172.21.15.139:0/749020738 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800e040 con 0x55979c9bbd80 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f607b7fe700 1 -- 172.21.15.139:0/749020738 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608800f040 con 0x55979c9bbd80 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f607b7fe700 1 -- 172.21.15.139:0/749020738 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608801f430 con 0x55979c9bbd80 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 -- 172.21.15.139:0/749020738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 msgr2=0x55979c9b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6088003c20 tx=0x7f6088009920 comp rx=0 tx=0).stop 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 -- 172.21.15.139:0/749020738 shutdown_connections 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979c9b1790 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9b7770 0x55979c9d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/749020738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9bb9a0 0x55979c9d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 -- 172.21.15.139:0/749020738 >> 172.21.15.139:0/749020738 conn(0x55979c92b200 msgr2=0x55979c9bab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 -- 172.21.15.139:0/749020738 shutdown_connections 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.773+0000 7f60a2c58b80 1 -- 172.21.15.139:0/749020738 wait complete. 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 -- start start 2023-10-08T13:30:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 Processor -- start 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979ca2c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979c9cf010 con 0x55979c9bbd80 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979ca2c660 con 0x55979c9bb9a0 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55979ca2c820 con 0x55979c9b7770 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f60a2c58b80 10 client.0 _ll_register_callbacks cb 0x55979c7037a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f609480b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f609480b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42028/0 (socket says 172.21.15.139:42028) 2023-10-08T13:30:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f609480b700 1 -- 172.21.15.139:0/45122565 learned_addr learned my addr 172.21.15.139:0/45122565 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f609500c700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979ca2c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.774+0000 7f608ffff700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 -- 172.21.15.139:0/45122565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 msgr2=0x55979c9ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 -- 172.21.15.139:0/45122565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 msgr2=0x55979ca2c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979ca2c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 -- 172.21.15.139:0/45122565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60840b2040 con 0x55979c9b7770 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609500c700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979ca2c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f609480b700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f608409af60 tx=0x7f6084009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1932ac9fb6fc21c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f606ffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:30:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608409b260 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f60840b9030 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f608409f3b0 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6084099600 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f60a2c58b80 10 client.26125 fetch_fsmap learned FSMap version 35 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.775+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7f6088009370 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608409f3b0 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f608409a750 con 0x55979c9b7770 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 10 client.26125 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 10 client.26125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 20 client.26125 populate_metadata read hostname 'smithi139' 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979ca2db00 0x55979ca2ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 4 client.26125 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:30:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55979c902ad0 con 0x55979ca2db00 2023-10-08T13:30:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f608ffff700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979ca2db00 0x55979ca2ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:30:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f606ffff700 10 client.26125 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.776+0000 7f608ffff700 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979ca2db00 0x55979ca2ff40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8427cf1492b8319 server_cookie=1a2c3c6ab3b4946e in_seq=0 out_seq=0 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.792+0000 7f606ffff700 1 -- 172.21.15.139:0/45122565 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55979c902ad0 con 0x55979ca2db00 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.792+0000 7f606ffff700 10 client.26125 handle_command_reply: tid=0 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.792+0000 7f60a2c58b80 1 client.26125 shutdown 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 msgr2=0x55979c9ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f608409af60 tx=0x7f6084009310 comp rx=0 tx=0).stop 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 shutdown_connections 2023-10-08T13:30:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55979c9bbd80 0x55979ca2c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55979c9b7770 0x55979c9ce380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55979ca2db00 0x55979ca2ff40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 --2- 172.21.15.139:0/45122565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55979c9bb9a0 0x55979c9ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f606ffff700 0 client.26125 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 >> 172.21.15.139:0/45122565 conn(0x55979c92b200 msgr2=0x55979c9c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 shutdown_connections 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 1 -- 172.21.15.139:0/45122565 wait complete. 2023-10-08T13:30:51.795 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f60a2c58b80 20 client.26125 trim_cache size 0 max 16384 2023-10-08T13:30:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:30:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:30:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:30:51.796 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 msgr2=0x7f60800a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.793+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 0x7f60800a3b30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6090196bd0 tx=0x7f607c009260 comp rx=0 tx=0).stop 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 msgr2=0x7f609019b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6084000c00 tx=0x7f6084004730 comp rx=0 tx=0).stop 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 shutdown_connections 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f60800a1670 0x7f60800a3b30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6090105670 0x7f60901957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.797 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60900ff8d0 0x7f609019b680 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 --2- 172.21.15.139:0/1224399283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6090100290 0x7f609019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:30:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 >> 172.21.15.139:0/1224399283 conn(0x7f60900764c0 msgr2=0x7f60900fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:30:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 shutdown_connections 2023-10-08T13:30:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:30:51.794+0000 7f6096a6f700 1 -- 172.21.15.139:0/1224399283 wait complete. 2023-10-08T13:30:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:51 smithi155 ceph-mon[103467]: pgmap v401: 129 pgs: 129 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2023-10-08T13:30:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:51 smithi139 ceph-mon[99506]: pgmap v401: 129 pgs: 129 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 289 op/s 2023-10-08T13:30:52.936 INFO:tasks.workunit.client.0.smithi139.stdout:50000 mapwrite 0xd9535 thru 0xdf124 (0x5bf0 bytes) 2023-10-08T13:30:52.942 INFO:tasks.workunit.client.0.smithi139.stdout:All 50000 operations completed A-OK! 2023-10-08T13:30:52.946 INFO:tasks.workunit.client.0.smithi139.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2023-10-08T13:30:52.946 INFO:tasks.workunit.client.0.smithi139.stdout:Seed set to 1 2023-10-08T13:30:53.065 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-08T13:30:53.065 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-08T13:30:53.068 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-08T13:30:53.068 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-08T13:30:53.068 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support clone range, disabling! 2023-10-08T13:30:53.072 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-08T13:30:53.074 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x5a0dfb 2023-10-08T13:30:53.086 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x5c415c 2023-10-08T13:30:53.086 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x9c27b4 2023-10-08T13:30:53.181 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x9d03f4 2023-10-08T13:30:53.299 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x9f6462 2023-10-08T13:30:53.436 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x9fa7e5 2023-10-08T13:30:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:53 smithi155 ceph-mon[103467]: pgmap v402: 129 pgs: 129 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 376 op/s 2023-10-08T13:30:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:53 smithi139 ceph-mon[99506]: pgmap v402: 129 pgs: 129 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 376 op/s 2023-10-08T13:30:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:53 smithi187 ceph-mon[104336]: pgmap v402: 129 pgs: 129 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 376 op/s 2023-10-08T13:30:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:55 smithi155 ceph-mon[103467]: pgmap v403: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 289 op/s 2023-10-08T13:30:56.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:55 smithi139 ceph-mon[99506]: pgmap v403: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 289 op/s 2023-10-08T13:30:56.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:55 smithi187 ceph-mon[104336]: pgmap v403: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 289 op/s 2023-10-08T13:30:56.924 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x9fd4ba 2023-10-08T13:30:57.632 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x9fe323 2023-10-08T13:30:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:57 smithi155 ceph-mon[103467]: pgmap v404: 129 pgs: 129 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 374 op/s 2023-10-08T13:30:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:57 smithi139 ceph-mon[99506]: pgmap v404: 129 pgs: 129 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 374 op/s 2023-10-08T13:30:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:57 smithi187 ceph-mon[104336]: pgmap v404: 129 pgs: 129 active+clean; 60 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.2 MiB/s wr, 374 op/s 2023-10-08T13:31:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:30:59 smithi155 ceph-mon[103467]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 337 op/s 2023-10-08T13:31:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:30:59 smithi139 ceph-mon[99506]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 337 op/s 2023-10-08T13:31:00.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:30:59 smithi187 ceph-mon[104336]: pgmap v405: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.8 MiB/s wr, 337 op/s 2023-10-08T13:31:00.520 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x9fec09 2023-10-08T13:31:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:01 smithi187 ceph-mon[104336]: pgmap v406: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.5 MiB/s wr, 449 op/s 2023-10-08T13:31:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:01 smithi155 ceph-mon[103467]: pgmap v406: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.5 MiB/s wr, 449 op/s 2023-10-08T13:31:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:01 smithi139 ceph-mon[99506]: pgmap v406: 129 pgs: 129 active+clean; 61 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.5 MiB/s wr, 449 op/s 2023-10-08T13:31:02.998 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x9ff6e7 2023-10-08T13:31:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:03 smithi155 ceph-mon[103467]: pgmap v407: 129 pgs: 129 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 492 op/s 2023-10-08T13:31:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:03 smithi139 ceph-mon[99506]: pgmap v407: 129 pgs: 129 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 492 op/s 2023-10-08T13:31:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:03 smithi187 ceph-mon[104336]: pgmap v407: 129 pgs: 129 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 2.7 MiB/s wr, 492 op/s 2023-10-08T13:31:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 -- 172.21.15.139:0/2885769018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a0100d50 msgr2=0x7f06a0104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 --2- 172.21.15.139:0/2885769018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a0100d50 0x7f06a0104280 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0694009990 tx=0x7f0694009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 -- 172.21.15.139:0/2885769018 shutdown_connections 2023-10-08T13:31:04.918 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 --2- 172.21.15.139:0/2885769018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01049b0 0x7f06a010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 --2- 172.21.15.139:0/2885769018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01003a0 0x7f06a0100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 --2- 172.21.15.139:0/2885769018 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a0100d50 0x7f06a0104280 secure :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0694009990 tx=0x7f0694009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.917+0000 7f06a5a20700 1 -- 172.21.15.139:0/2885769018 >> 172.21.15.139:0/2885769018 conn(0x7f06a0074970 msgr2=0x7f06a0074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.919+0000 7f06a5a20700 1 -- 172.21.15.139:0/2885769018 shutdown_connections 2023-10-08T13:31:04.919 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.919+0000 7f06a5a20700 1 -- 172.21.15.139:0/2885769018 wait complete. 2023-10-08T13:31:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.919+0000 7f06a5a20700 1 Processor -- start 2023-10-08T13:31:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 -- start start 2023-10-08T13:31:04.920 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01049b0 0x7f06a0199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a019d9d0 0x7f06a019de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a019e450 con 0x7f06a019d9d0 2023-10-08T13:31:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a019e5c0 con 0x7f06a01049b0 2023-10-08T13:31:04.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f06a5a20700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a019e780 con 0x7f06a01003a0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a019d9d0 0x7f06a019de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42042/0 (socket says 172.21.15.139:42042) 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 -- 172.21.15.139:0/675761772 learned_addr learned my addr 172.21.15.139:0/675761772 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069e7fc700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01049b0 0x7f06a0199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 -- 172.21.15.139:0/675761772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01049b0 msgr2=0x7f06a0199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01049b0 0x7f06a0199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 -- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a019d9d0 msgr2=0x7f06a019de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a019d9d0 0x7f06a019de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.920+0000 7f069effd700 1 -- 172.21.15.139:0/675761772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940095f0 con 0x7f06a01003a0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f069effd700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f069000e9a0 tx=0x7f069000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f06a4a1e700 1 -- 172.21.15.139:0/675761772 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690009790 con 0x7f06a01003a0 2023-10-08T13:31:04.924 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f06a4a1e700 1 -- 172.21.15.139:0/675761772 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069000cbd0 con 0x7f06a01003a0 2023-10-08T13:31:04.924 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a01a5ce0 con 0x7f06a01003a0 2023-10-08T13:31:04.924 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f06a4a1e700 1 -- 172.21.15.139:0/675761772 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690018680 con 0x7f06a01003a0 2023-10-08T13:31:04.924 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.921+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01a61c0 con 0x7f06a01003a0 2023-10-08T13:31:04.925 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.924+0000 7f06a4a1e700 1 -- 172.21.15.139:0/675761772 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f06900187e0 con 0x7f06a01003a0 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06a4a1e700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 0x7f06880a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069e7fc700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 0x7f06880a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06a4a1e700 1 -- 172.21.15.139:0/675761772 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0690014070 con 0x7f06a01003a0 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 Processor -- start 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 -- start start 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 0x558915817b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915818510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558915780400 con 0x5589158180b0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558915771bc0 con 0x55891581e1a0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891576f4e0 con 0x55891581d880 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069e7fc700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 0x7f06880a3b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06a019a640 tx=0x7f0694000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 0x558915817b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42050/0 (socket says 172.21.15.139:42050) 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 0x558915817b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60856/0 (socket says 172.21.15.139:60856) 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069effd700 1 -- 172.21.15.139:0/2748932361 learned_addr learned my addr 172.21.15.139:0/2748932361 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.925+0000 7f069f7fe700 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915818510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 -- 172.21.15.139:0/2748932361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 msgr2=0x558915817b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 0x558915817b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 -- 172.21.15.139:0/2748932361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 msgr2=0x558915818510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915818510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 -- 172.21.15.139:0/2748932361 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558915595d80 con 0x55891581d880 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f069effd700 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06900a2180 tx=0x7f0690099d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f88645e88f6701 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f0685ffb700 1 -- 172.21.15.139:0/2748932361 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069009e470 con 0x55891581d880 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f0685ffb700 1 -- 172.21.15.139:0/2748932361 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06900a26b0 con 0x55891581d880 2023-10-08T13:31:04.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.926+0000 7f0685ffb700 1 -- 172.21.15.139:0/2748932361 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900cd300 con 0x55891581d880 2023-10-08T13:31:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- 172.21.15.139:0/2748932361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 msgr2=0x55891581dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06900a2180 tx=0x7f0690099d00 comp rx=0 tx=0).stop 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- 172.21.15.139:0/2748932361 shutdown_connections 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915818510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581d880 0x55891581dc60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/2748932361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581e1a0 0x558915817b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- 172.21.15.139:0/2748932361 >> 172.21.15.139:0/2748932361 conn(0x55891578c200 msgr2=0x558915812b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- 172.21.15.139:0/2748932361 shutdown_connections 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- 172.21.15.139:0/2748932361 wait complete. 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.927+0000 7f06b1c09b80 1 -- start start 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 Processor -- start 2023-10-08T13:31:04.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x5589158241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915821490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891576add0 con 0x55891581e1a0 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589157076b0 con 0x55891581d880 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558915707350 con 0x5589158180b0 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f06b1c09b80 10 client.0 _ll_register_callbacks cb 0x5589155647a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x5589158241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42342/0 (socket says 172.21.15.139:42342) 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f069f7fe700 1 -- 172.21.15.139:0/1652929267 learned_addr learned my addr 172.21.15.139:0/1652929267 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:04.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.928+0000 7f069e7fc700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915821490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 -- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 msgr2=0x5589158241a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x5589158241a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 -- 172.21.15.139:0/1652929267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 msgr2=0x558915821490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915821490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 -- 172.21.15.139:0/1652929267 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01a61c0 con 0x55891581e1a0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069effd700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x5589158241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f069f7fe700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0698012e80 tx=0x7f0698014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c691d37605b47f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f067effd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069800e040 con 0x55891581e1a0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0698014b90 con 0x55891581e1a0 2023-10-08T13:31:04.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558915732e50 con 0x55891581e1a0 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0698014d90 con 0x55891581e1a0 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f06b1c09b80 10 client.16689 fetch_fsmap learned FSMap version 35 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.929+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55891557ec00 con 0x55891581e1a0 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558915732e50 con 0x55891581e1a0 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f069801c020 con 0x55891581e1a0 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 10 client.16689 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 20 client.16689 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:04.937 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558915831dd0 0x5589158341f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 4 client.16689 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558915763db0 con 0x558915831dd0 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f069effd700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558915831dd0 0x5589158341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f067effd700 10 client.16689 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.930+0000 7f069effd700 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558915831dd0 0x5589158341f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=196fe0bc9a580961 server_cookie=fcb6acff07585411 in_seq=0 out_seq=0 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.931+0000 7f067effd700 1 -- 172.21.15.139:0/1652929267 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558915763db0 con 0x558915831dd0 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.931+0000 7f067effd700 10 client.16689 handle_command_reply: tid=0 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.931+0000 7f06b1c09b80 1 client.16689 shutdown 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.931+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 msgr2=0x558915821bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.938 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.931+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0698012e80 tx=0x7f0698014600 comp rx=0 tx=0).stop 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 shutdown_connections 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915821bd0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x5589158241a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558915831dd0 0x5589158341f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1652929267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915821490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f067effd700 0 client.16689 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 >> 172.21.15.139:0/1652929267 conn(0x55891578c200 msgr2=0x558915812010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 shutdown_connections 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1652929267 wait complete. 2023-10-08T13:31:04.939 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.932+0000 7f06b1c09b80 20 client.16689 trim_cache size 0 max 16384 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 Processor -- start 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 -- start start 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915812790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915812cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589155eb8c0 con 0x55891581e1a0 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891580f830 con 0x55891581d880 2023-10-08T13:31:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558915814100 con 0x5589158180b0 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915812cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915812790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.948+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42064/0 (socket says 172.21.15.139:42064) 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915812790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60870/0 (socket says 172.21.15.139:60870) 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 -- 172.21.15.139:0/325939438 learned_addr learned my addr 172.21.15.139:0/325939438 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 -- 172.21.15.139:0/325939438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 msgr2=0x558915812790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915812790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 -- 172.21.15.139:0/325939438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 msgr2=0x558915812cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915812cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 -- 172.21.15.139:0/325939438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589155bc1f0 con 0x5589158180b0 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.949+0000 7f069effd700 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f069009a4e0 tx=0x7f069009a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28cbc8ed12ba08a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.950+0000 7f06867fc700 1 -- 172.21.15.139:0/325939438 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900984e0 con 0x5589158180b0 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.950+0000 7f06867fc700 1 -- 172.21.15.139:0/325939438 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f069000cd40 con 0x5589158180b0 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.950+0000 7f06867fc700 1 -- 172.21.15.139:0/325939438 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690099810 con 0x5589158180b0 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- 172.21.15.139:0/325939438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 msgr2=0x558915817b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.955 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f069009a4e0 tx=0x7f069009a180 comp rx=0 tx=0).stop 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- 172.21.15.139:0/325939438 shutdown_connections 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55891581e1a0 0x558915812cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5589158180b0 0x558915817b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/325939438 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x558915812790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- 172.21.15.139:0/325939438 >> 172.21.15.139:0/325939438 conn(0x55891578c200 msgr2=0x558915818490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- 172.21.15.139:0/325939438 shutdown_connections 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- 172.21.15.139:0/325939438 wait complete. 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.951+0000 7f06b1c09b80 1 -- start start 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 Processor -- start 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.956 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 0x558915819e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558915829200 con 0x5589158180b0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891581a350 con 0x55891581d880 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55891581a510 con 0x55891581e1a0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f06b1c09b80 10 client.0 _ll_register_callbacks cb 0x7f06980127b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 0x558915819e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069e7fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60874/0 (socket says 172.21.15.139:60874) 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42354/0 (socket says 172.21.15.139:42354) 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069e7fc700 1 -- 172.21.15.139:0/1048387971 learned_addr learned my addr 172.21.15.139:0/1048387971 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 0x558915819e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42074/0 (socket says 172.21.15.139:42074) 2023-10-08T13:31:04.957 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 -- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 msgr2=0x558915819e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 0x558915819e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 -- 172.21.15.139:0/1048387971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 msgr2=0x5589158198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069effd700 1 -- 172.21.15.139:0/1048387971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558915595d80 con 0x5589158180b0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.952+0000 7f069e7fc700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f069effd700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f069009a2b0 tx=0x7f069009aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed2692534a41acd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900984e0 con 0x5589158180b0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0690083650 con 0x5589158180b0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06900a26b0 con 0x5589158180b0 2023-10-08T13:31:04.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0690099810 con 0x5589158180b0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 10 client.16695 fetch_fsmap learned FSMap version 35 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x558915594250 con 0x5589158180b0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06900a6080 con 0x5589158180b0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 35) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f069009a580 con 0x5589158180b0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 10 client.16695 fetch_fsmap finished waiting for FSMap version 35 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 20 client.16695 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55891588ebe0 0x558915891000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 4 client.16695 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.953+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558915763ad0 con 0x55891588ebe0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.954+0000 7f069e7fc700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55891588ebe0 0x558915891000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:04.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.954+0000 7f067effd700 10 client.16695 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:04.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.954+0000 7f069e7fc700 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55891588ebe0 0x558915891000 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5b5e67cfb894e4d server_cookie=5042d2ffe54b56ed in_seq=0 out_seq=0 2023-10-08T13:31:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f067effd700 1 -- 172.21.15.139:0/1048387971 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558915763ad0 con 0x55891588ebe0 2023-10-08T13:31:04.980 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f067effd700 10 client.16695 handle_command_reply: tid=0 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 client.16695 shutdown 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 msgr2=0x558915819390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f069009a2b0 tx=0x7f069009aa40 comp rx=0 tx=0).stop 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 shutdown_connections 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55891581e1a0 0x558915819e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589158180b0 0x558915819390 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55891588ebe0 0x558915891000 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 --2- 172.21.15.139:0/1048387971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55891581d880 0x5589158198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 >> 172.21.15.139:0/1048387971 conn(0x55891578c200 msgr2=0x55891581fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.981 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.979+0000 7f067effd700 0 client.16695 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.980+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 shutdown_connections 2023-10-08T13:31:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.980+0000 7f06b1c09b80 1 -- 172.21.15.139:0/1048387971 wait complete. 2023-10-08T13:31:04.982 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.980+0000 7f06b1c09b80 20 client.16695 trim_cache size 0 max 16384 2023-10-08T13:31:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:31:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:31:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:31:04.985 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:31:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 msgr2=0x7f06880a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 0x7f06880a3b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f06a019a640 tx=0x7f0694000bc0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.986 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 msgr2=0x7f06a01990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f069000e9a0 tx=0x7f069000ecb0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 shutdown_connections 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f06880a1660 0x7f06880a3b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06a019d9d0 0x7f06a019de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06a01003a0 0x7f06a01990f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 --2- 172.21.15.139:0/675761772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06a01049b0 0x7f06a0199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 >> 172.21.15.139:0/675761772 conn(0x7f06a0074970 msgr2=0x7f06a00fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 shutdown_connections 2023-10-08T13:31:04.987 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:04.981+0000 7f06a5a20700 1 -- 172.21.15.139:0/675761772 wait complete. 2023-10-08T13:31:05.514 INFO:tasks.workunit.client.0.smithi139.stdout:10000 copy from 0x2ab252 to 0x2b6f08, (0xbcb6 bytes) at 0x1cd955 2023-10-08T13:31:05.596 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setuser ceph since I am not root 2023-10-08T13:31:05.596 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setgroup ceph since I am not root 2023-10-08T13:31:05.596 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mds[140612]: -- 172.21.15.155:0/2813402870 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b67e8b1e0 con 0x564b67e61000 2023-10-08T13:31:05.597 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: starting mds.e at 2023-10-08T13:31:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: pgmap v408: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.2 MiB/s wr, 423 op/s 2023-10-08T13:31:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: daemon mds.e restarted 2023-10-08T13:31:06.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:31:06.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6834/3686588084,v1:172.21.15.155:6835/3686588084] up:boot 2023-10-08T13:31:06.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:06.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:05 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:31:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: pgmap v408: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.2 MiB/s wr, 423 op/s 2023-10-08T13:31:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: daemon mds.e restarted 2023-10-08T13:31:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:31:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6834/3686588084,v1:172.21.15.155:6835/3686588084] up:boot 2023-10-08T13:31:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:05 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:31:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: pgmap v408: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 2.2 MiB/s wr, 423 op/s 2023-10-08T13:31:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: daemon mds.e restarted 2023-10-08T13:31:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T13:31:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6834/3686588084,v1:172.21.15.155:6835/3686588084] up:boot 2023-10-08T13:31:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:06.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:05 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:31:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:07 smithi155 ceph-mon[103467]: pgmap v410: 129 pgs: 129 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 556 op/s 2023-10-08T13:31:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:07 smithi139 ceph-mon[99506]: pgmap v410: 129 pgs: 129 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 556 op/s 2023-10-08T13:31:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:07 smithi187 ceph-mon[104336]: pgmap v410: 129 pgs: 129 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.9 MiB/s wr, 556 op/s 2023-10-08T13:31:09.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:31:09.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 -- 172.21.15.139:0/3848466725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670105650 msgr2=0x7f5670105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 --2- 172.21.15.139:0/3848466725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670105650 0x7f5670105a30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5660009990 tx=0x7f5660009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 -- 172.21.15.139:0/3848466725 shutdown_connections 2023-10-08T13:31:09.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 --2- 172.21.15.139:0/3848466725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5670100000 0x7f567010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.677 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 --2- 172.21.15.139:0/3848466725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670105650 0x7f5670105a30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 --2- 172.21.15.139:0/3848466725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56700ff640 0x7f56700ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 -- 172.21.15.139:0/3848466725 >> 172.21.15.139:0/3848466725 conn(0x7f56700767c0 msgr2=0x7f5670076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 -- 172.21.15.139:0/3848466725 shutdown_connections 2023-10-08T13:31:09.678 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.676+0000 7f5675234700 1 -- 172.21.15.139:0/3848466725 wait complete. 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 Processor -- start 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 -- start start 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56700ff640 0x7f567019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5670105650 0x7f56701969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670197030 con 0x7f5670100000 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56701971a0 con 0x7f5670105650 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f5675234700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670197360 con 0x7f56700ff640 2023-10-08T13:31:09.680 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56700ff640 0x7f567019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42370/0 (socket says 172.21.15.139:42370) 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5670105650 0x7f56701969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566e59c700 1 -- 172.21.15.139:0/3507324997 learned_addr learned my addr 172.21.15.139:0/3507324997 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566e59c700 1 -- 172.21.15.139:0/3507324997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56700ff640 msgr2=0x7f567019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.677+0000 7f566e59c700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56700ff640 0x7f567019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f566e59c700 1 -- 172.21.15.139:0/3507324997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5670105650 msgr2=0x7f56701969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f566e59c700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5670105650 0x7f56701969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f566e59c700 1 -- 172.21.15.139:0/3507324997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009520 con 0x7f5670100000 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f566e59c700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f566400eb30 tx=0x7f566400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f5657fff700 1 -- 172.21.15.139:0/3507324997 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664009880 con 0x7f5670100000 2023-10-08T13:31:09.681 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5668009c40 con 0x7f5670100000 2023-10-08T13:31:09.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f5657fff700 1 -- 172.21.15.139:0/3507324997 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56640044e0 con 0x7f5670100000 2023-10-08T13:31:09.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f5657fff700 1 -- 172.21.15.139:0/3507324997 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664003d80 con 0x7f5670100000 2023-10-08T13:31:09.682 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.678+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56600095f0 con 0x7f5670100000 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.681+0000 7f5657fff700 1 -- 172.21.15.139:0/3507324997 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5664003ee0 con 0x7f5670100000 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 Processor -- start 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 -- start start 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f5657fff700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 0x7f56580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b50260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827ab9460 con 0x555827b507a0 2023-10-08T13:31:09.684 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827aaac20 con 0x555827b5b650 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f568141db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827aa8540 con 0x555827b4fe80 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f5657fff700 1 -- 172.21.15.139:0/3507324997 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5664014070 con 0x7f5670100000 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566f59e700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 0x7f56580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566f59e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42380/0 (socket says 172.21.15.139:42380) 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 -- 172.21.15.139:0/4247050764 learned_addr learned my addr 172.21.15.139:0/4247050764 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566ed9d700 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b50260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 -- 172.21.15.139:0/4247050764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 msgr2=0x555827b50260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b50260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 -- 172.21.15.139:0/4247050764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 msgr2=0x555827b5da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.685 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b5da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566e59c700 1 -- 172.21.15.139:0/4247050764 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558278cede0 con 0x555827b507a0 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.682+0000 7f566f59e700 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b5da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.683+0000 7f566f59e700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 0x7f56580a3b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5668009fd0 tx=0x7f566800f5a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.683+0000 7f566e59c700 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5664096fa0 tx=0x7f566409a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b011a0736a363dae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.683+0000 7f56557fa700 1 -- 172.21.15.139:0/4247050764 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566409ac30 con 0x555827b507a0 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.683+0000 7f56557fa700 1 -- 172.21.15.139:0/4247050764 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f566409a530 con 0x555827b507a0 2023-10-08T13:31:09.686 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.683+0000 7f56557fa700 1 -- 172.21.15.139:0/4247050764 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640caf20 con 0x555827b507a0 2023-10-08T13:31:09.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- 172.21.15.139:0/4247050764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 msgr2=0x555827b5b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5664096fa0 tx=0x7f566409a140 comp rx=0 tx=0).stop 2023-10-08T13:31:09.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- 172.21.15.139:0/4247050764 shutdown_connections 2023-10-08T13:31:09.689 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b5da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b50260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 --2- 172.21.15.139:0/4247050764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b5b110 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- 172.21.15.139:0/4247050764 >> 172.21.15.139:0/4247050764 conn(0x555827ac5260 msgr2=0x555827b4c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- 172.21.15.139:0/4247050764 shutdown_connections 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- 172.21.15.139:0/4247050764 wait complete. 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 -- start start 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.684+0000 7f568141db80 1 Processor -- start 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b507a0 0x555827b582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b5b650 0x555827b58920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827aa3e30 con 0x555827b4fe80 2023-10-08T13:31:09.690 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827a40710 con 0x555827b507a0 2023-10-08T13:31:09.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827a403b0 con 0x555827b5b650 2023-10-08T13:31:09.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f568141db80 10 client.0 _ll_register_callbacks cb 0x55582789d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:09.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.691 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42382/0 (socket says 172.21.15.139:42382) 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 -- 172.21.15.139:0/346275031 learned_addr learned my addr 172.21.15.139:0/346275031 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566e59c700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b507a0 0x555827b582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 -- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b5b650 msgr2=0x555827b58920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b5b650 0x555827b58920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 -- 172.21.15.139:0/346275031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b507a0 msgr2=0x555827b582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.694 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b507a0 0x555827b582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.685+0000 7f566ed9d700 1 -- 172.21.15.139:0/346275031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566801ac10 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f566ed9d700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5660009990 tx=0x7f5660005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2204a852377b43e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566001d070 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f5660004500 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555827a6beb0 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56600046c0 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f568141db80 10 client.16710 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7f56600095f0 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555827a6beb0 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.686+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f566000f9f0 con 0x555827b4fe80 2023-10-08T13:31:09.695 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 10 client.16710 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 20 client.16710 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827b6b2b0 0x555827b6d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 4 client.16710 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.687+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555827a9ce10 con 0x555827b6b2b0 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.688+0000 7f566e59c700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827b6b2b0 0x555827b6d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.688+0000 7f5652ff5700 10 client.16710 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:09.696 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.688+0000 7f566e59c700 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827b6b2b0 0x555827b6d6d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e137ae9498722d94 server_cookie=17d7edf26330ca4 in_seq=0 out_seq=0 2023-10-08T13:31:09.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f5652ff5700 1 -- 172.21.15.139:0/346275031 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555827a9ce10 con 0x555827b6b2b0 2023-10-08T13:31:09.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f5652ff5700 10 client.16710 handle_command_reply: tid=0 2023-10-08T13:31:09.697 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 client.16710 shutdown 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 msgr2=0x555827b5b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5660009990 tx=0x7f5660005800 comp rx=0 tx=0).stop 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 shutdown_connections 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b5b650 0x555827b58920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b4fe80 0x555827b5b000 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827b6b2b0 0x555827b6d6d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 --2- 172.21.15.139:0/346275031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b507a0 0x555827b582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f5652ff5700 0 client.16710 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 >> 172.21.15.139:0/346275031 conn(0x555827ac5260 msgr2=0x555827b4bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 shutdown_connections 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 1 -- 172.21.15.139:0/346275031 wait complete. 2023-10-08T13:31:09.698 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.689+0000 7f568141db80 20 client.16710 trim_cache size 0 max 16384 2023-10-08T13:31:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.708+0000 7f568141db80 1 Processor -- start 2023-10-08T13:31:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.708+0000 7f568141db80 1 -- start start 2023-10-08T13:31:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 0x555827b52db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.710 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b507a0 0x555827b62140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827924920 con 0x555827b5b650 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827b48ae0 con 0x555827b4fe80 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f568141db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827b59670 con 0x555827b507a0 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 0x555827b52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42392/0 (socket says 172.21.15.139:42392) 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566ed9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 0x555827b52db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60910/0 (socket says 172.21.15.139:60910) 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 -- 172.21.15.139:0/3363823161 learned_addr learned my addr 172.21.15.139:0/3363823161 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 -- 172.21.15.139:0/3363823161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b507a0 msgr2=0x555827b62140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b507a0 0x555827b62140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.711 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 -- 172.21.15.139:0/3363823161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 msgr2=0x555827b52db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 0x555827b52db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 -- 172.21.15.139:0/3363823161 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558278b7c60 con 0x555827b5b650 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f566f59e700 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5668009690 tx=0x7f566801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dae040b8060641a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f5655ffb700 1 -- 172.21.15.139:0/3363823161 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800e040 con 0x555827b5b650 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f5655ffb700 1 -- 172.21.15.139:0/3363823161 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f566800f040 con 0x555827b5b650 2023-10-08T13:31:09.712 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.709+0000 7f5655ffb700 1 -- 172.21.15.139:0/3363823161 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668008750 con 0x555827b5b650 2023-10-08T13:31:09.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 -- 172.21.15.139:0/3363823161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 msgr2=0x555827b4bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5668009690 tx=0x7f566801d000 comp rx=0 tx=0).stop 2023-10-08T13:31:09.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 -- 172.21.15.139:0/3363823161 shutdown_connections 2023-10-08T13:31:09.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b5b650 0x555827b4bcb0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.716 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b4fe80 0x555827b52db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 --2- 172.21.15.139:0/3363823161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b507a0 0x555827b62140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 -- 172.21.15.139:0/3363823161 >> 172.21.15.139:0/3363823161 conn(0x555827ac5260 msgr2=0x555827b53610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 -- 172.21.15.139:0/3363823161 shutdown_connections 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.710+0000 7f568141db80 1 -- 172.21.15.139:0/3363823161 wait complete. 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 -- start start 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 Processor -- start 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b60820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827bbf0d0 con 0x555827b507a0 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827bbf240 con 0x555827b5b650 2023-10-08T13:31:09.717 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555827bbf400 con 0x555827b4fe80 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f568141db80 10 client.0 _ll_register_callbacks cb 0x7f5660005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42398/0 (socket says 172.21.15.139:42398) 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 -- 172.21.15.139:0/2282477886 learned_addr learned my addr 172.21.15.139:0/2282477886 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566ed9d700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b60820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566f59e700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 -- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 msgr2=0x555827b60820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b60820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 -- 172.21.15.139:0/2282477886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 msgr2=0x555827b612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 -- 172.21.15.139:0/2282477886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566800f870 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f566e59c700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5664096a30 tx=0x7f56640969a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffc5f3e43b2e2ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.711+0000 7f5652ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640a28c0 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f566400cdd0 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f566409a530 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566409e680 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 10 client.16716 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x5558278f5250 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f566409a530 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f5664061070 con 0x555827b507a0 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 10 client.16716 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:09.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 20 client.16716 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827bc0a90 0x555827bc2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 4 client.16716 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555827a9cb30 con 0x555827bc0a90 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.712+0000 7f566ed9d700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827bc0a90 0x555827bc2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f5652ff5700 10 client.16716 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f566ed9d700 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827bc0a90 0x555827bc2eb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5de3030fce317987 server_cookie=97837805126da767 in_seq=0 out_seq=0 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f5652ff5700 1 -- 172.21.15.139:0/2282477886 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555827a9cb30 con 0x555827bc0a90 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f5652ff5700 10 client.16716 handle_command_reply: tid=0 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 client.16716 shutdown 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 msgr2=0x555827b60d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5664096a30 tx=0x7f56640969a0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 shutdown_connections 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x555827bc0a90 0x555827bc2eb0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555827b5b650 0x555827b612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f5652ff5700 0 client.16716 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555827b4fe80 0x555827b60820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 --2- 172.21.15.139:0/2282477886 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555827b507a0 0x555827b60d60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 >> 172.21.15.139:0/2282477886 conn(0x555827ac5260 msgr2=0x555827b56b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 shutdown_connections 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 1 -- 172.21.15.139:0/2282477886 wait complete. 2023-10-08T13:31:09.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.713+0000 7f568141db80 20 client.16716 trim_cache size 0 max 16384 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:31:09.722 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 msgr2=0x7f56580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 0x7f56580a3b30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5668009fd0 tx=0x7f566800f5a0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 msgr2=0x7f567019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f566400eb30 tx=0x7f566400ee40 comp rx=0 tx=0).stop 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 shutdown_connections 2023-10-08T13:31:09.723 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f56580a1670 0x7f56580a3b30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5670105650 0x7f56701969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56700ff640 0x7f567019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 --2- 172.21.15.139:0/3507324997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5670100000 0x7f567019cde0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 >> 172.21.15.139:0/3507324997 conn(0x7f56700767c0 msgr2=0x7f56701034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 shutdown_connections 2023-10-08T13:31:09.724 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:09.714+0000 7f5675234700 1 -- 172.21.15.139:0/3507324997 wait complete. 2023-10-08T13:31:09.728 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:31:09.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:09 smithi139 ceph-mon[99506]: pgmap v411: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.8 MiB/s wr, 547 op/s 2023-10-08T13:31:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:09 smithi155 ceph-mon[103467]: pgmap v411: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.8 MiB/s wr, 547 op/s 2023-10-08T13:31:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:09 smithi187 ceph-mon[104336]: pgmap v411: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.8 MiB/s wr, 547 op/s 2023-10-08T13:31:11.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:11 smithi187 ceph-mon[104336]: pgmap v412: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 480 op/s 2023-10-08T13:31:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:11 smithi155 ceph-mon[103467]: pgmap v412: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 480 op/s 2023-10-08T13:31:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:11 smithi139 ceph-mon[99506]: pgmap v412: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 480 op/s 2023-10-08T13:31:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:13 smithi155 ceph-mon[103467]: pgmap v413: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.6 MiB/s wr, 522 op/s 2023-10-08T13:31:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:13 smithi139 ceph-mon[99506]: pgmap v413: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.6 MiB/s wr, 522 op/s 2023-10-08T13:31:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:13 smithi187 ceph-mon[104336]: pgmap v413: 129 pgs: 129 active+clean; 70 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.6 MiB/s wr, 522 op/s 2023-10-08T13:31:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:15 smithi155 ceph-mon[103467]: pgmap v414: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 519 op/s 2023-10-08T13:31:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:15 smithi139 ceph-mon[99506]: pgmap v414: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 519 op/s 2023-10-08T13:31:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:15 smithi187 ceph-mon[104336]: pgmap v414: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.5 MiB/s wr, 519 op/s 2023-10-08T13:31:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:17 smithi155 ceph-mon[103467]: pgmap v415: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 -- 172.21.15.139:0/1710765964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c1045b0 msgr2=0x7f102c104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 --2- 172.21.15.139:0/1710765964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c1045b0 0x7f102c104990 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1028009990 tx=0x7f1028009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 -- 172.21.15.139:0/1710765964 shutdown_connections 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 --2- 172.21.15.139:0/1710765964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c100730 0x7f102c10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 --2- 172.21.15.139:0/1710765964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c1045b0 0x7f102c104990 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 --2- 172.21.15.139:0/1710765964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0ffd70 0x7f102c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.112+0000 7f1033894700 1 -- 172.21.15.139:0/1710765964 >> 172.21.15.139:0/1710765964 conn(0x7f102c075bf0 msgr2=0x7f102c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- 172.21.15.139:0/1710765964 shutdown_connections 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- 172.21.15.139:0/1710765964 wait complete. 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 Processor -- start 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- start start 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 0x7f102c195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 0x7f102c196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1a4fa0 con 0x7f102c0ffd70 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1a5110 con 0x7f102c1045b0 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.113+0000 7f1033894700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c1a52d0 con 0x7f102c100730 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42410/0 (socket says 172.21.15.139:42410) 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 -- 172.21.15.139:0/3972935168 learned_addr learned my addr 172.21.15.139:0/3972935168 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031e31700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 0x7f102c196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1030e2f700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 0x7f102c195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 -- 172.21.15.139:0/3972935168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 msgr2=0x7f102c195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 0x7f102c195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 -- 172.21.15.139:0/3972935168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 msgr2=0x7f102c196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 0x7f102c196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 -- 172.21.15.139:0/3972935168 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280095f0 con 0x7f102c0ffd70 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1030e2f700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 0x7f102c195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031e31700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 0x7f102c196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:31:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1031630700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1028003ac0 tx=0x7f10280037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f10227fc700 1 -- 172.21.15.139:0/3972935168 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102801d070 con 0x7f102c0ffd70 2023-10-08T13:31:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f10227fc700 1 -- 172.21.15.139:0/3972935168 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1028003e00 con 0x7f102c0ffd70 2023-10-08T13:31:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c1a5550 con 0x7f102c0ffd70 2023-10-08T13:31:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f10227fc700 1 -- 172.21.15.139:0/3972935168 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102800fe60 con 0x7f102c0ffd70 2023-10-08T13:31:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.114+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c1a59f0 con 0x7f102c0ffd70 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.116+0000 7f10227fc700 1 -- 172.21.15.139:0/3972935168 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f102800f560 con 0x7f102c0ffd70 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.117+0000 7f10227fc700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 0x7f10180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.117+0000 7f1030e2f700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 0x7f10180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.117+0000 7f10227fc700 1 -- 172.21.15.139:0/3972935168 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10280ce660 con 0x7f102c0ffd70 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.117+0000 7f1030e2f700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 0x7f10180a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f101c006fd0 tx=0x7f101c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 Processor -- start 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 -- start start 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d74290b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74291510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d741f9400 con 0x564d74296880 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d741eabc0 con 0x564d742971a0 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.118+0000 7f103fa7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d741e84e0 con 0x564d742910b0 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1030e2f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d74290b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42418/0 (socket says 172.21.15.139:42418) 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031e31700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74291510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 -- 172.21.15.139:0/2743716674 learned_addr learned my addr 172.21.15.139:0/2743716674 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 -- 172.21.15.139:0/2743716674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 msgr2=0x564d74291510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74291510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 -- 172.21.15.139:0/2743716674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 msgr2=0x564d74290b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d74290b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 -- 172.21.15.139:0/2743716674 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d7400ed80 con 0x564d74296880 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f1031630700 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1028097e00 tx=0x7f1028005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4af323c6191987 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f10177fe700 1 -- 172.21.15.139:0/2743716674 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102809ba90 con 0x564d74296880 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f10177fe700 1 -- 172.21.15.139:0/2743716674 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1028020e30 con 0x564d74296880 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.119+0000 7f10177fe700 1 -- 172.21.15.139:0/2743716674 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028097aa0 con 0x564d74296880 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 -- 172.21.15.139:0/2743716674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 msgr2=0x564d74296c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1028097e00 tx=0x7f1028005050 comp rx=0 tx=0).stop 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 -- 172.21.15.139:0/2743716674 shutdown_connections 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74291510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d74296c60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 --2- 172.21.15.139:0/2743716674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d74290b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 -- 172.21.15.139:0/2743716674 >> 172.21.15.139:0/2743716674 conn(0x564d74205200 msgr2=0x564d7428bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 -- 172.21.15.139:0/2743716674 shutdown_connections 2023-10-08T13:31:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.120+0000 7f103fa7db80 1 -- 172.21.15.139:0/2743716674 wait complete. 2023-10-08T13:31:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 -- start start 2023-10-08T13:31:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 Processor -- start 2023-10-08T13:31:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 0x564d7429a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d742971a0 0x564d7429ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d741e3dd0 con 0x564d742971a0 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d741806b0 con 0x564d74296880 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d74180350 con 0x564d742910b0 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f103fa7db80 10 client.0 _ll_register_callbacks cb 0x564d73fdd7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f1031630700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f1031630700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42140/0 (socket says 172.21.15.139:42140) 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f1031630700 1 -- 172.21.15.139:0/435593397 learned_addr learned my addr 172.21.15.139:0/435593397 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:18.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.121+0000 7f1030e2f700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 0x564d7429a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031e31700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d742971a0 0x564d7429ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 -- 172.21.15.139:0/435593397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 msgr2=0x564d7429a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 0x564d7429a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 -- 172.21.15.139:0/435593397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d742971a0 msgr2=0x564d7429ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d742971a0 0x564d7429ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 -- 172.21.15.139:0/435593397 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c1a59f0 con 0x564d742910b0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1030e2f700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 0x564d7429a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1031630700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1028003a90 tx=0x7f1028009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5d14605457b154 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1014ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.122+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102809ba90 con 0x564d742910b0 2023-10-08T13:31:18.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10280b3030 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d741abe50 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102809f4e0 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 10 client.26164 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564d73ff7c00 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564d741abe50 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f102809a880 con 0x564d742910b0 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 10 client.26164 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 20 client.26164 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d742aa4a0 0x564d742ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 4 client.26164 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:18.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d741dcdb0 con 0x564d742aa4a0 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.123+0000 7f1030e2f700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d742aa4a0 0x564d742ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.124+0000 7f1014ff9700 10 client.26164 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.124+0000 7f1030e2f700 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d742aa4a0 0x564d742ac8c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbfe5cdc2129fc1 server_cookie=b3a5f9c55ccd090e in_seq=0 out_seq=0 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f1014ff9700 1 -- 172.21.15.139:0/435593397 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d741dcdb0 con 0x564d742aa4a0 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f1014ff9700 10 client.26164 handle_command_reply: tid=0 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 client.26164 shutdown 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 msgr2=0x564d7429d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1028003a90 tx=0x7f1028009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 shutdown_connections 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d742971a0 0x564d7429ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d7429d170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d742aa4a0 0x564d742ac8c0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 --2- 172.21.15.139:0/435593397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d74296880 0x564d7429a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f1014ff9700 0 client.26164 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 >> 172.21.15.139:0/435593397 conn(0x564d74205200 msgr2=0x564d7428b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 shutdown_connections 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 1 -- 172.21.15.139:0/435593397 wait complete. 2023-10-08T13:31:18.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.125+0000 7f103fa7db80 20 client.26164 trim_cache size 0 max 16384 2023-10-08T13:31:18.145 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 Processor -- start 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 -- start start 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74290b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d740648c0 con 0x564d74296880 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7429a850 con 0x564d742971a0 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f103fa7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7429b450 con 0x564d742910b0 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1030e2f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.147 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60956/0 (socket says 172.21.15.139:60956) 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1030e2f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42434/0 (socket says 172.21.15.139:42434) 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 -- 172.21.15.139:0/3858978219 learned_addr learned my addr 172.21.15.139:0/3858978219 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031630700 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74290b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 -- 172.21.15.139:0/3858978219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 msgr2=0x564d74290b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74290b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 -- 172.21.15.139:0/3858978219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 msgr2=0x564d742a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.145+0000 7f1031e31700 1 -- 172.21.15.139:0/3858978219 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d740351f0 con 0x564d742971a0 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.146+0000 7f1031e31700 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f102400b760 tx=0x7f102400e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c49488a2d68a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.146+0000 7f1017fff700 1 -- 172.21.15.139:0/3858978219 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024013070 con 0x564d742971a0 2023-10-08T13:31:18.148 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.146+0000 7f1017fff700 1 -- 172.21.15.139:0/3858978219 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1024014040 con 0x564d742971a0 2023-10-08T13:31:18.149 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.146+0000 7f1017fff700 1 -- 172.21.15.139:0/3858978219 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024018c50 con 0x564d742971a0 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- 172.21.15.139:0/3858978219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 msgr2=0x564d742914d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f102400b760 tx=0x7f102400e040 comp rx=0 tx=0).stop 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- 172.21.15.139:0/3858978219 shutdown_connections 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742914d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d74290b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 --2- 172.21.15.139:0/3858978219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- 172.21.15.139:0/3858978219 >> 172.21.15.139:0/3858978219 conn(0x564d74205200 msgr2=0x564d742b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- 172.21.15.139:0/3858978219 shutdown_connections 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- 172.21.15.139:0/3858978219 wait complete. 2023-10-08T13:31:18.152 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 -- start start 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.147+0000 7f103fa7db80 1 Processor -- start 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742f9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d742f97d0 con 0x564d74296880 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d742f9940 con 0x564d742971a0 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d742f9b00 con 0x564d742910b0 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f103fa7db80 10 client.0 _ll_register_callbacks cb 0x7f102c069a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1030e2f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42154/0 (socket says 172.21.15.139:42154) 2023-10-08T13:31:18.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1030e2f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42440/0 (socket says 172.21.15.139:42440) 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 -- 172.21.15.139:0/798995432 learned_addr learned my addr 172.21.15.139:0/798995432 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031e31700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 -- 172.21.15.139:0/798995432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 msgr2=0x564d742f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 -- 172.21.15.139:0/798995432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 msgr2=0x564d742a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 -- 172.21.15.139:0/798995432 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102400b410 con 0x564d742910b0 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031e31700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1031630700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10280a32f0 tx=0x7f102809b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbeeb790faf310e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.148+0000 7f1014ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:31:18.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102809f4e0 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f10280b3040 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1028020e30 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10280a3370 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 10 client.26170 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x564d7400d250 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1028020e30 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f1028097180 con 0x564d742910b0 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 10 client.26170 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 10 client.26170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 20 client.26170 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d7430fdf0 0x564d743121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:18.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 4 client.26170 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:31:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.149+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564d741dcad0 con 0x564d7430fdf0 2023-10-08T13:31:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.150+0000 7f1030e2f700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d7430fdf0 0x564d743121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.150+0000 7f1014ff9700 10 client.26170 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:18.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.150+0000 7f1030e2f700 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d7430fdf0 0x564d743121e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa6bb75062178ff server_cookie=551f569ba461f95c in_seq=0 out_seq=0 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f1014ff9700 1 -- 172.21.15.139:0/798995432 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564d741dcad0 con 0x564d7430fdf0 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f1014ff9700 10 client.26170 handle_command_reply: tid=0 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 client.26170 shutdown 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 msgr2=0x564d742a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10280a32f0 tx=0x7f102809b820 comp rx=0 tx=0).stop 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 shutdown_connections 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x564d7430fdf0 0x564d743121e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564d742971a0 0x564d742f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f1014ff9700 0 client.26170 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564d742910b0 0x564d742a0d10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.169+0000 7f103fa7db80 1 --2- 172.21.15.139:0/798995432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564d74296880 0x564d742a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 >> 172.21.15.139:0/798995432 conn(0x564d74205200 msgr2=0x564d74291490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 shutdown_connections 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f103fa7db80 1 -- 172.21.15.139:0/798995432 wait complete. 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f103fa7db80 20 client.26170 trim_cache size 0 max 16384 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:31:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:31:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:31:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 msgr2=0x7f10180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 0x7f10180a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f101c006fd0 tx=0x7f101c008040 comp rx=0 tx=0).stop 2023-10-08T13:31:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 msgr2=0x7f102c195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.170+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1028003ac0 tx=0x7f10280037c0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 shutdown_connections 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f10180a15f0 0x7f10180a3ab0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f102c1045b0 0x7f102c196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f102c0ffd70 0x7f102c195800 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 --2- 172.21.15.139:0/3972935168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c100730 0x7f102c195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 >> 172.21.15.139:0/3972935168 conn(0x7f102c075bf0 msgr2=0x7f102c102340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 shutdown_connections 2023-10-08T13:31:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:18.171+0000 7f1033894700 1 -- 172.21.15.139:0/3972935168 wait complete. 2023-10-08T13:31:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:17 smithi139 ceph-mon[99506]: pgmap v415: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2023-10-08T13:31:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:17 smithi187 ceph-mon[104336]: pgmap v415: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2023-10-08T13:31:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:19 smithi155 ceph-mon[103467]: pgmap v416: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:19 smithi139 ceph-mon[99506]: pgmap v416: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:19 smithi187 ceph-mon[104336]: pgmap v416: 129 pgs: 129 active+clean; 68 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:21.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:21 smithi187 ceph-mon[104336]: pgmap v417: 129 pgs: 129 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2023-10-08T13:31:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:21 smithi155 ceph-mon[103467]: pgmap v417: 129 pgs: 129 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2023-10-08T13:31:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:21 smithi139 ceph-mon[99506]: pgmap v417: 129 pgs: 129 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2023-10-08T13:31:24.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:23 smithi155 ceph-mon[103467]: pgmap v418: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 2.3 MiB/s wr, 466 op/s 2023-10-08T13:31:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:23 smithi139 ceph-mon[99506]: pgmap v418: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 2.3 MiB/s wr, 466 op/s 2023-10-08T13:31:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:23 smithi187 ceph-mon[104336]: pgmap v418: 129 pgs: 129 active+clean; 67 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 2.3 MiB/s wr, 466 op/s 2023-10-08T13:31:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:25 smithi155 ceph-mon[103467]: pgmap v419: 129 pgs: 129 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2023-10-08T13:31:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:25 smithi139 ceph-mon[99506]: pgmap v419: 129 pgs: 129 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2023-10-08T13:31:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:25 smithi187 ceph-mon[104336]: pgmap v419: 129 pgs: 129 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2023-10-08T13:31:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:27 smithi155 ceph-mon[103467]: pgmap v420: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 557 op/s 2023-10-08T13:31:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:27 smithi139 ceph-mon[99506]: pgmap v420: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 557 op/s 2023-10-08T13:31:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:27 smithi187 ceph-mon[104336]: pgmap v420: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 2.8 MiB/s wr, 557 op/s 2023-10-08T13:31:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:29 smithi155 ceph-mon[103467]: pgmap v421: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.6 MiB/s wr, 504 op/s 2023-10-08T13:31:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:29 smithi139 ceph-mon[99506]: pgmap v421: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.6 MiB/s wr, 504 op/s 2023-10-08T13:31:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:29 smithi187 ceph-mon[104336]: pgmap v421: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 2.6 MiB/s wr, 504 op/s 2023-10-08T13:31:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 -- 172.21.15.139:0/3193801801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500ff620 msgr2=0x7f145010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 --2- 172.21.15.139:0/3193801801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500ff620 0x7f145010d570 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f144800b0a0 tx=0x7f144800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 -- 172.21.15.139:0/3193801801 shutdown_connections 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 --2- 172.21.15.139:0/3193801801 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500ff620 0x7f145010d570 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 --2- 172.21.15.139:0/3193801801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 --2- 172.21.15.139:0/3193801801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500fec60 0x7f14500ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 -- 172.21.15.139:0/3193801801 >> 172.21.15.139:0/3193801801 conn(0x7f1450075bf0 msgr2=0x7f14500fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 -- 172.21.15.139:0/3193801801 shutdown_connections 2023-10-08T13:31:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.302+0000 7f1455c9b700 1 -- 172.21.15.139:0/3193801801 wait complete. 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 Processor -- start 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 -- start start 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 0x7f145019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 0x7f145019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14501970b0 con 0x7f14500fec60 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450197220 con 0x7f1450106760 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.303+0000 7f1455c9b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14501973e0 con 0x7f14500ff620 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 0x7f145019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 0x7f145019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 0x7f145019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42172/0 (socket says 172.21.15.139:42172) 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144effd700 1 -- 172.21.15.139:0/2764907429 learned_addr learned my addr 172.21.15.139:0/2764907429 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 -- 172.21.15.139:0/2764907429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 msgr2=0x7f145019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 0x7f145019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 -- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 msgr2=0x7f145019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 0x7f145019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 -- 172.21.15.139:0/2764907429 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009d00 con 0x7f1450106760 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 0x7f145019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144ffff700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450196a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f144800b0a0 tx=0x7f14480078e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144cff9700 1 -- 172.21.15.139:0/2764907429 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800e040 con 0x7f1450106760 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144cff9700 1 -- 172.21.15.139:0/2764907429 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f144801d470 con 0x7f1450106760 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1450197660 con 0x7f1450106760 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.304+0000 7f144cff9700 1 -- 172.21.15.139:0/2764907429 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448005260 con 0x7f1450106760 2023-10-08T13:31:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.305+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14501a3910 con 0x7f1450106760 2023-10-08T13:31:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.307+0000 7f144cff9700 1 -- 172.21.15.139:0/2764907429 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f144801d5e0 con 0x7f1450106760 2023-10-08T13:31:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.307+0000 7f144cff9700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 0x7f14380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.308+0000 7f144cff9700 1 -- 172.21.15.139:0/2764907429 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f14480ce540 con 0x7f1450106760 2023-10-08T13:31:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.308+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 0x7f14380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.308+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 0x7f14380a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1444011490 tx=0x7f1444009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 Processor -- start 2023-10-08T13:31:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 -- start start 2023-10-08T13:31:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 0x5578079bbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079bc0b0 0x5578079bc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x557807924400 con 0x5578079c1880 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x557807915bc0 con 0x5578079bc0b0 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f1461e84b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079134e0 con 0x5578079c21a0 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 0x5578079bbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42462/0 (socket says 172.21.15.139:42462) 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144f7fe700 1 -- 172.21.15.139:0/2899193965 learned_addr learned my addr 172.21.15.139:0/2899193965 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 0x5578079bbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42180/0 (socket says 172.21.15.139:42180) 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.309+0000 7f144ffff700 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079bc0b0 0x5578079bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 -- 172.21.15.139:0/2899193965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 msgr2=0x5578079bbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 0x5578079bbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 -- 172.21.15.139:0/2899193965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079bc0b0 msgr2=0x5578079bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079bc0b0 0x5578079bc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 -- 172.21.15.139:0/2899193965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557807739d80 con 0x5578079c1880 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f14440043c0 tx=0x7f1444014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d04c174925f8cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f1435ffb700 1 -- 172.21.15.139:0/2899193965 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444003d10 con 0x5578079c1880 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f1435ffb700 1 -- 172.21.15.139:0/2899193965 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1444003e70 con 0x5578079c1880 2023-10-08T13:31:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.310+0000 7f1435ffb700 1 -- 172.21.15.139:0/2899193965 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400e6a0 con 0x5578079c1880 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- 172.21.15.139:0/2899193965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 msgr2=0x5578079c1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f14440043c0 tx=0x7f1444014000 comp rx=0 tx=0).stop 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- 172.21.15.139:0/2899193965 shutdown_connections 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079bc0b0 0x5578079bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079c1c60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2899193965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079c21a0 0x5578079bbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- 172.21.15.139:0/2899193965 >> 172.21.15.139:0/2899193965 conn(0x557807930200 msgr2=0x5578079b6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- 172.21.15.139:0/2899193965 shutdown_connections 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- 172.21.15.139:0/2899193965 wait complete. 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 -- start start 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.311+0000 7f1461e84b80 1 Processor -- start 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c21a0 0x5578079c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780790edd0 con 0x5578079c21a0 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578078ab6b0 con 0x5578079c1880 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578078ab350 con 0x5578079bc0b0 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f1461e84b80 10 client.0 _ll_register_callbacks cb 0x5578077087a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c21a0 0x5578079c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:60990/0 (socket says 172.21.15.139:60990) 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 -- 172.21.15.139:0/969044211 learned_addr learned my addr 172.21.15.139:0/969044211 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 -- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 msgr2=0x5578079c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 -- 172.21.15.139:0/969044211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c21a0 msgr2=0x5578079c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c21a0 0x5578079c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 -- 172.21.15.139:0/969044211 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1444017070 con 0x5578079c1880 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f144effd700 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1440011720 tx=0x7f1440011a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2faf88409ba1686 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.312+0000 7f142effd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:31:31.319 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440016070 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578078d6e50 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1440004240 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1440004400 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 10 client.26198 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557807722c00 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5578078d6e50 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f144001b720 con 0x5578079c1880 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 10 client.26198 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 10 client.26198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 20 client.26198 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578079d5f10 0x5578079d8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.320 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 4 client.26198 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557807907db0 con 0x5578079d5f10 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.313+0000 7f144f7fe700 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578079d5f10 0x5578079d8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.315+0000 7f142effd700 10 client.26198 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.315+0000 7f144f7fe700 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578079d5f10 0x5578079d8330 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b695ef0100a761c4 server_cookie=30aa6436c289d21e in_seq=0 out_seq=0 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.315+0000 7f142effd700 1 -- 172.21.15.139:0/969044211 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557807907db0 con 0x5578079d5f10 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.315+0000 7f142effd700 10 client.26198 handle_command_reply: tid=0 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.315+0000 7f1461e84b80 1 client.26198 shutdown 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 msgr2=0x5578079c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1440011720 tx=0x7f1440011a30 comp rx=0 tx=0).stop 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 shutdown_connections 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c21a0 0x5578079c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5578079d5f10 0x5578079d8330 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 --2- 172.21.15.139:0/969044211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c1880 0x5578079c5b30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f142effd700 0 client.26198 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 >> 172.21.15.139:0/969044211 conn(0x557807930200 msgr2=0x5578079b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 shutdown_connections 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 1 -- 172.21.15.139:0/969044211 wait complete. 2023-10-08T13:31:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.316+0000 7f1461e84b80 20 client.26198 trim_cache size 0 max 16384 2023-10-08T13:31:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 Processor -- start 2023-10-08T13:31:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 -- start start 2023-10-08T13:31:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55780778f8c0 con 0x5578079c1880 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079bcce0 con 0x5578079c21a0 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f1461e84b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079b7b00 con 0x5578079bc0b0 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42476/0 (socket says 172.21.15.139:42476) 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 -- 172.21.15.139:0/1113000922 learned_addr learned my addr 172.21.15.139:0/1113000922 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144f7fe700 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144ffff700 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 -- 172.21.15.139:0/1113000922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 msgr2=0x5578079b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 -- 172.21.15.139:0/1113000922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 msgr2=0x5578079c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.334+0000 7f144effd700 1 -- 172.21.15.139:0/1113000922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578077601f0 con 0x5578079c1880 2023-10-08T13:31:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.335+0000 7f144effd700 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f144001bbd0 tx=0x7f1440005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380b9fa4260e0fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.335+0000 7f14367fc700 1 -- 172.21.15.139:0/1113000922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440016040 con 0x5578079c1880 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.335+0000 7f14367fc700 1 -- 172.21.15.139:0/1113000922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f144001b420 con 0x5578079c1880 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.335+0000 7f14367fc700 1 -- 172.21.15.139:0/1113000922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440003b80 con 0x5578079c1880 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- 172.21.15.139:0/1113000922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 msgr2=0x5578079b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f144001bbd0 tx=0x7f1440005910 comp rx=0 tx=0).stop 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- 172.21.15.139:0/1113000922 shutdown_connections 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 --2- 172.21.15.139:0/1113000922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079b6cd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- 172.21.15.139:0/1113000922 >> 172.21.15.139:0/1113000922 conn(0x557807930200 msgr2=0x5578079c3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- 172.21.15.139:0/1113000922 shutdown_connections 2023-10-08T13:31:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- 172.21.15.139:0/1113000922 wait complete. 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.336+0000 7f1461e84b80 1 -- start start 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 Processor -- start 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079cd1f0 con 0x5578079c1880 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079cb700 con 0x5578079c21a0 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578079cb870 con 0x5578079bc0b0 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f1461e84b80 10 client.0 _ll_register_callbacks cb 0x7f144000bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f144effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f144effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42482/0 (socket says 172.21.15.139:42482) 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f144effd700 1 -- 172.21.15.139:0/2694090856 learned_addr learned my addr 172.21.15.139:0/2694090856 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.337+0000 7f144ffff700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 -- 172.21.15.139:0/2694090856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 msgr2=0x5578079cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 -- 172.21.15.139:0/2694090856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 msgr2=0x5578079cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 -- 172.21.15.139:0/2694090856 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557807722c00 con 0x5578079bc0b0 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144effd700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f144f7fe700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079cc8e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1444005920 tx=0x7f14440092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe619eecfcc3e23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.338+0000 7f142effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:31:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444036070 con 0x5578079bc0b0 2023-10-08T13:31:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1444003cb0 con 0x5578079bc0b0 2023-10-08T13:31:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1444003e70 con 0x5578079bc0b0 2023-10-08T13:31:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f144402b040 con 0x5578079bc0b0 2023-10-08T13:31:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f1461e84b80 10 client.26188 fetch_fsmap learned FSMap version 36 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.339+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x557807738250 con 0x5578079bc0b0 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1444003e70 con 0x5578079bc0b0 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 36) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f1444039030 con 0x5578079bc0b0 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 10 client.26188 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 10 client.26188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 20 client.26188 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557807a2aff0 0x557807a2d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 4 client.26188 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557807907ad0 con 0x557807a2aff0 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.340+0000 7f144effd700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557807a2aff0 0x557807a2d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.341+0000 7f142effd700 10 client.26188 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.341+0000 7f144effd700 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557807a2aff0 0x557807a2d410 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e639f70637e480 server_cookie=acd058a8119a5704 in_seq=0 out_seq=0 2023-10-08T13:31:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f142effd700 1 -- 172.21.15.139:0/2694090856 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557807907ad0 con 0x557807a2aff0 2023-10-08T13:31:31.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f142effd700 10 client.26188 handle_command_reply: tid=0 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 client.26188 shutdown 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 msgr2=0x5578079cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079cc8e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1444005920 tx=0x7f14440092d0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 shutdown_connections 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x557807a2aff0 0x557807a2d410 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578079c21a0 0x5578079cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f142effd700 0 client.26188 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578079bc0b0 0x5578079cc8e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 --2- 172.21.15.139:0/2694090856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5578079c1880 0x5578079cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 >> 172.21.15.139:0/2694090856 conn(0x557807930200 msgr2=0x5578079c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 shutdown_connections 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.363+0000 7f1461e84b80 1 -- 172.21.15.139:0/2694090856 wait complete. 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1461e84b80 20 client.26188 trim_cache size 0 max 16384 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:31:31.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 msgr2=0x7f14380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 0x7f14380a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1444011490 tx=0x7f1444009260 comp rx=0 tx=0).stop 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 msgr2=0x7f1450196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450196a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f144800b0a0 tx=0x7f14480078e0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 shutdown_connections 2023-10-08T13:31:31.367 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f14380a1670 0x7f14380a3b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1450106760 0x7f1450196a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f14500fec60 0x7f145019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 --2- 172.21.15.139:0/2764907429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14500ff620 0x7f145019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 >> 172.21.15.139:0/2764907429 conn(0x7f1450075bf0 msgr2=0x7f14500fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 shutdown_connections 2023-10-08T13:31:31.368 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:31.364+0000 7f1455c9b700 1 -- 172.21.15.139:0/2764907429 wait complete. 2023-10-08T13:31:31.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:31 smithi187 ceph-mon[104336]: pgmap v422: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.6 MiB/s wr, 508 op/s 2023-10-08T13:31:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:31 smithi155 ceph-mon[103467]: pgmap v422: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.6 MiB/s wr, 508 op/s 2023-10-08T13:31:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:31 smithi139 ceph-mon[99506]: pgmap v422: 129 pgs: 129 active+clean; 71 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 2.6 MiB/s wr, 508 op/s 2023-10-08T13:31:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:33 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:33.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:33 smithi187 ceph-mon[104336]: pgmap v423: 129 pgs: 129 active+clean; 74 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.4 MiB/s wr, 463 op/s 2023-10-08T13:31:33.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:33 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:33.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:33 smithi155 ceph-mon[103467]: pgmap v423: 129 pgs: 129 active+clean; 74 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.4 MiB/s wr, 463 op/s 2023-10-08T13:31:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:33 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:31:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:33 smithi139 ceph-mon[99506]: pgmap v423: 129 pgs: 129 active+clean; 74 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 2.4 MiB/s wr, 463 op/s 2023-10-08T13:31:36.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:35 smithi155 ceph-mon[103467]: pgmap v424: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.4 MiB/s wr, 489 op/s 2023-10-08T13:31:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:35 smithi139 ceph-mon[99506]: pgmap v424: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.4 MiB/s wr, 489 op/s 2023-10-08T13:31:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:35 smithi187 ceph-mon[104336]: pgmap v424: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 2.4 MiB/s wr, 489 op/s 2023-10-08T13:31:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:37 smithi155 ceph-mon[103467]: pgmap v425: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.6 MiB/s wr, 530 op/s 2023-10-08T13:31:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:37 smithi139 ceph-mon[99506]: pgmap v425: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.6 MiB/s wr, 530 op/s 2023-10-08T13:31:38.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:37 smithi187 ceph-mon[104336]: pgmap v425: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.6 MiB/s wr, 530 op/s 2023-10-08T13:31:39.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- 172.21.15.139:0/4213831341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0689f0 msgr2=0x7fbbec068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 --2- 172.21.15.139:0/4213831341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0689f0 0x7fbbec068e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009990 tx=0x7fbbdc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- 172.21.15.139:0/4213831341 shutdown_connections 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 --2- 172.21.15.139:0/4213831341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0693b0 0x7fbbec10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 --2- 172.21.15.139:0/4213831341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.872 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 --2- 172.21.15.139:0/4213831341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0689f0 0x7fbbec068e70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- 172.21.15.139:0/4213831341 >> 172.21.15.139:0/4213831341 conn(0x7fbbec0767c0 msgr2=0x7fbbec076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- 172.21.15.139:0/4213831341 shutdown_connections 2023-10-08T13:31:39.873 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- 172.21.15.139:0/4213831341 wait complete. 2023-10-08T13:31:39.874 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 Processor -- start 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.871+0000 7fbbf3982700 1 -- start start 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0689f0 0x7fbbec0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0693b0 0x7fbbec0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1a50e0 con 0x7fbbec106780 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1a5250 con 0x7fbbec0689f0 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf3982700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1a5410 con 0x7fbbec0693b0 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf171e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0689f0 0x7fbbec0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42498/0 (socket says 172.21.15.139:42498) 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0693b0 0x7fbbec0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1723563242 learned_addr learned my addr 172.21.15.139:0/1723563242 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1723563242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0693b0 msgr2=0x7fbbec0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0693b0 0x7fbbec0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1723563242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0689f0 msgr2=0x7fbbec0ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0689f0 0x7fbbec0ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1723563242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0095f0 con 0x7fbbec106780 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.872+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400b780 tx=0x7fbbe400ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.873+0000 7fbbe27fc700 1 -- 172.21.15.139:0/1723563242 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4011820 con 0x7fbbec106780 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.873+0000 7fbbe27fc700 1 -- 172.21.15.139:0/1723563242 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbe400d040 con 0x7fbbec106780 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.873+0000 7fbbe27fc700 1 -- 172.21.15.139:0/1723563242 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4010de0 con 0x7fbbec106780 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.873+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec1a56f0 con 0x7fbbec106780 2023-10-08T13:31:39.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.873+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec1a5bb0 con 0x7fbbec106780 2023-10-08T13:31:39.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.876+0000 7fbbe27fc700 1 -- 172.21.15.139:0/1723563242 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fbbe401a400 con 0x7fbbec106780 2023-10-08T13:31:39.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.876+0000 7fbbe27fc700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 0x7fbbd80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 0x7fbbd80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbe27fc700 1 -- 172.21.15.139:0/1723563242 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbbe40cd200 con 0x7fbbec106780 2023-10-08T13:31:39.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 Processor -- start 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 0x7fbbd80a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009a10 tx=0x7fbbe8009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 -- start start 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cca260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456c33460 con 0x558456cca7a0 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456c24c20 con 0x558456cd5650 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.877+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456c22540 con 0x558456cc9e80 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.880 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf171e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32792/0 (socket says 172.21.15.139:32792) 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1353488812 learned_addr learned my addr 172.21.15.139:0/1353488812 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42506/0 (socket says 172.21.15.139:42506) 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1353488812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 msgr2=0x558456cca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1353488812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 msgr2=0x558456cd5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1353488812 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558456a48de0 con 0x558456cd5650 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009a20 tx=0x7fbbe4099a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e95c167b942e38f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbd77fe700 1 -- 172.21.15.139:0/1353488812 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4099ea0 con 0x558456cd5650 2023-10-08T13:31:39.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.878+0000 7fbbd77fe700 1 -- 172.21.15.139:0/1353488812 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbe409dff0 con 0x558456cd5650 2023-10-08T13:31:39.882 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbd77fe700 1 -- 172.21.15.139:0/1353488812 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4010520 con 0x558456cd5650 2023-10-08T13:31:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1353488812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 msgr2=0x558456cd7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.885 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009a20 tx=0x7fbbe4099a60 comp rx=0 tx=0).stop 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1353488812 shutdown_connections 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd7a40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1353488812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1353488812 >> 172.21.15.139:0/1353488812 conn(0x558456c3f260 msgr2=0x558456cc62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1353488812 shutdown_connections 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.879+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1353488812 wait complete. 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 -- start start 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 Processor -- start 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cd5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.886 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456c1de30 con 0x558456cca7a0 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456bba710 con 0x558456cd5650 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456bba3b0 con 0x558456cc9e80 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbffb6bb80 10 client.0 _ll_register_callbacks cb 0x558456a17800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.880+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42510/0 (socket says 172.21.15.139:42510) 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/2792068572 learned_addr learned my addr 172.21.15.139:0/2792068572 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 msgr2=0x558456cd5090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cd5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/2792068572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 msgr2=0x558456cd2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.887 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/2792068572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe800e6c0 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009990 tx=0x7fbbdc003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb5919e5601eb12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc01d070 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbbdc0050c0 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558456be5eb0 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbdc005280 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.881+0000 7fbbffb6bb80 10 client.16761 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fbbec1a5bb0 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558456be5eb0 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fbbdc00fc90 con 0x558456cca7a0 2023-10-08T13:31:39.888 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 10 client.16761 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 20 client.16761 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456ce52e0 0x558456ce7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 4 client.16761 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558456c16e10 con 0x558456ce52e0 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbf171e700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456ce52e0 0x558456ce7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbd4ff9700 10 client.16761 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.882+0000 7fbbf171e700 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456ce52e0 0x558456ce7700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a752d575c12f8d49 server_cookie=9db6f784b78f08c4 in_seq=0 out_seq=0 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/2792068572 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558456c16e10 con 0x558456ce52e0 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbd4ff9700 10 client.16761 handle_command_reply: tid=0 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 client.16761 shutdown 2023-10-08T13:31:39.889 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 msgr2=0x558456cd23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009990 tx=0x7fbbdc003860 comp rx=0 tx=0).stop 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 shutdown_connections 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456ce52e0 0x558456ce7700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cd2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cd5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/2792068572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cca7a0 0x558456cd23d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbd4ff9700 0 client.16761 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 >> 172.21.15.139:0/2792068572 conn(0x558456c3f260 msgr2=0x558456cc5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 shutdown_connections 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.883+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/2792068572 wait complete. 2023-10-08T13:31:39.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.884+0000 7fbbffb6bb80 20 client.16761 trim_cache size 0 max 16384 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 Processor -- start 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 -- start start 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cdc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456a9e920 con 0x558456cec060 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456cca4b0 con 0x558456cd5650 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456cdc6e0 con 0x558456cc9e80 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.904 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42520/0 (socket says 172.21.15.139:42520) 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/4110852883 learned_addr learned my addr 172.21.15.139:0/4110852883 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf171e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cdc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/4110852883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 msgr2=0x558456cccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/4110852883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 msgr2=0x558456cdc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cdc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.902+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/4110852883 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558456a31c60 con 0x558456cec060 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.903+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40cac10 tx=0x7fbbe4010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddca04f47d1d56c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.903+0000 7fbbd7fff700 1 -- 172.21.15.139:0/4110852883 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4099ea0 con 0x558456cec060 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.903+0000 7fbbd7fff700 1 -- 172.21.15.139:0/4110852883 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbe40a2230 con 0x558456cec060 2023-10-08T13:31:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.903+0000 7fbbd7fff700 1 -- 172.21.15.139:0/4110852883 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4017d40 con 0x558456cec060 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/4110852883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 msgr2=0x558456ccd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40cac10 tx=0x7fbbe4010f80 comp rx=0 tx=0).stop 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/4110852883 shutdown_connections 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456ccd750 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/4110852883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cdc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/4110852883 >> 172.21.15.139:0/4110852883 conn(0x558456c3f260 msgr2=0x558456ce08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.910 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/4110852883 shutdown_connections 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/4110852883 wait complete. 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 -- start start 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.904+0000 7fbbffb6bb80 1 Processor -- start 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cdc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cda590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456cdb2a0 con 0x558456cec060 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456cdb3e0 con 0x558456cd5650 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558456d39120 con 0x558456cc9e80 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbffb6bb80 10 client.0 _ll_register_callbacks cb 0x558456a17800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.911 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf1f1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42526/0 (socket says 172.21.15.139:42526) 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cda590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf1f1f700 1 -- 172.21.15.139:0/1764193035 learned_addr learned my addr 172.21.15.139:0/1764193035 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cdc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 msgr2=0x558456cdc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cdc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/1764193035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 msgr2=0x558456cdabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 -- 172.21.15.139:0/1764193035 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558456a48de0 con 0x558456cd5650 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cdc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf1f1f700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbf0f1d700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cda590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x558456cd3460 tx=0x7fbbdc018bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4ed32cc8d920afa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:39.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.905+0000 7fbbd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc01d070 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbe409dff0 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fbbdc000e40 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbdc009ee0 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 10 client.26216 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558456a6f250 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbbe409dff0 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fbbdc02b070 con 0x558456cd5650 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 10 client.26216 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 10 client.26216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 20 client.26216 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456d3a5f0 0x558456d3ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 4 client.26216 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558456c16b30 con 0x558456d3a5f0 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.906+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456d3a5f0 0x558456d3ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbd4ff9700 10 client.26216 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbf171e700 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456d3a5f0 0x558456d3ca10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4dd39bf5c822482 server_cookie=d9033c71e2e13e0b in_seq=0 out_seq=0 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbd4ff9700 1 -- 172.21.15.139:0/1764193035 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558456c16b30 con 0x558456d3a5f0 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbd4ff9700 10 client.26216 handle_command_reply: tid=0 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 client.26216 shutdown 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 msgr2=0x558456cda590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cda590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x558456cd3460 tx=0x7fbbdc018bf0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 shutdown_connections 2023-10-08T13:31:39.914 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558456cec060 0x558456cdabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558456cc9e80 0x558456cdc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558456d3a5f0 0x558456d3ca10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 --2- 172.21.15.139:0/1764193035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558456cd5650 0x558456cda590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 >> 172.21.15.139:0/1764193035 conn(0x558456c3f260 msgr2=0x558456ccd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbd4ff9700 0 client.26216 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 shutdown_connections 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 1 -- 172.21.15.139:0/1764193035 wait complete. 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.907+0000 7fbbffb6bb80 20 client.26216 trim_cache size 0 max 16384 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:31:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:31:39.916 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 msgr2=0x7fbbd80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 0x7fbbd80a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009a10 tx=0x7fbbe8009190 comp rx=0 tx=0).stop 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 msgr2=0x7fbbec100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400b780 tx=0x7fbbe400ba90 comp rx=0 tx=0).stop 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 shutdown_connections 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbbd80a15f0 0x7fbbd80a3ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbbec106780 0x7fbbec100130 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbec0689f0 0x7fbbec0ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 --2- 172.21.15.139:0/1723563242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec0693b0 0x7fbbec0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:39.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 >> 172.21.15.139:0/1723563242 conn(0x7fbbec0767c0 msgr2=0x7fbbec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:39.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 shutdown_connections 2023-10-08T13:31:39.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:31:39.908+0000 7fbbf3982700 1 -- 172.21.15.139:0/1723563242 wait complete. 2023-10-08T13:31:39.924 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:31:40.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:39 smithi155 ceph-mon[103467]: pgmap v426: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.3 MiB/s wr, 440 op/s 2023-10-08T13:31:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:39 smithi139 ceph-mon[99506]: pgmap v426: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.3 MiB/s wr, 440 op/s 2023-10-08T13:31:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:39 smithi187 ceph-mon[104336]: pgmap v426: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.3 MiB/s wr, 440 op/s 2023-10-08T13:31:41.727 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:41 smithi187 ceph-mon[104336]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 436 op/s 2023-10-08T13:31:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:41 smithi155 ceph-mon[103467]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 436 op/s 2023-10-08T13:31:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:41 smithi139 ceph-mon[99506]: pgmap v427: 129 pgs: 129 active+clean; 71 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 2.3 MiB/s wr, 436 op/s 2023-10-08T13:31:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:43 smithi155 ceph-mon[103467]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:31:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:43 smithi139 ceph-mon[99506]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:31:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:43 smithi187 ceph-mon[104336]: pgmap v428: 129 pgs: 129 active+clean; 72 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 -- 172.21.15.139:0/1510179515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d8105670 msgr2=0x7fe1d8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/1510179515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d8105670 0x7fe1d8105a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009990 tx=0x7fe1c8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 -- 172.21.15.139:0/1510179515 shutdown_connections 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/1510179515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/1510179515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d8105670 0x7fe1d8105a50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/1510179515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d80ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 -- 172.21.15.139:0/1510179515 >> 172.21.15.139:0/1510179515 conn(0x7fe1d80764c0 msgr2=0x7fe1d80768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 -- 172.21.15.139:0/1510179515 shutdown_connections 2023-10-08T13:31:44.493 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.491+0000 7fe1ddf91700 1 -- 172.21.15.139:0/1510179515 wait complete. 2023-10-08T13:31:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 Processor -- start 2023-10-08T13:31:44.494 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 -- start start 2023-10-08T13:31:44.495 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8105670 0x7fe1d8196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8196f80 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d81970f0 con 0x7fe1d8100290 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1ddf91700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d81972b0 con 0x7fe1d8105670 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42536/0 (socket says 172.21.15.139:42536) 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1d77fe700 1 -- 172.21.15.139:0/2680722507 learned_addr learned my addr 172.21.15.139:0/2680722507 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.492+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8105670 0x7fe1d8196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.496 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 -- 172.21.15.139:0/2680722507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8105670 msgr2=0x7fe1d8196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8105670 0x7fe1d8196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 -- 172.21.15.139:0/2680722507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 msgr2=0x7fe1d819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 -- 172.21.15.139:0/2680722507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80095f0 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000c00 tx=0x7fe1c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d4ff9700 1 -- 172.21.15.139:0/2680722507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c801d070 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8197530 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d4ff9700 1 -- 172.21.15.139:0/2680722507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1c8022470 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1d4ff9700 1 -- 172.21.15.139:0/2680722507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8017650 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.493+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d81a3790 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.495+0000 7fe1d4ff9700 1 -- 172.21.15.139:0/2680722507 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fe1c80225e0 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.496+0000 7fe1d4ff9700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 0x7fe1c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.496+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 0x7fe1c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.496+0000 7fe1d4ff9700 1 -- 172.21.15.139:0/2680722507 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe1c80ce560 con 0x7fe1d80ff8d0 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.496+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 0x7fe1c00a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8197a90 tx=0x7fe1cc009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 Processor -- start 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 -- start start 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 0x55f16bf45920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 0x55f16bf46280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bea5400 con 0x55f16bf41170 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16be96bc0 con 0x55f16bf41a90 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16be944e0 con 0x55f16bf45e60 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.497+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42544/0 (socket says 172.21.15.139:42544) 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d77fe700 1 -- 172.21.15.139:0/909949146 learned_addr learned my addr 172.21.15.139:0/909949146 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 0x55f16bf46280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 0x55f16bf45920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 -- 172.21.15.139:0/909949146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 msgr2=0x55f16bf45920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 0x55f16bf45920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 -- 172.21.15.139:0/909949146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 msgr2=0x55f16bf41550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 -- 172.21.15.139:0/909949146 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f16bcbad80 con 0x55f16bf45e60 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 0x55f16bf45920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 0x55f16bf46280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0011550 tx=0x7fe1d0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca8ac0bd8ceae2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1bdffb700 1 -- 172.21.15.139:0/909949146 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x55f16bf45e60 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1bdffb700 1 -- 172.21.15.139:0/909949146 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d000f040 con 0x55f16bf45e60 2023-10-08T13:31:44.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.498+0000 7fe1bdffb700 1 -- 172.21.15.139:0/909949146 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004290 con 0x55f16bf45e60 2023-10-08T13:31:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/909949146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 msgr2=0x55f16bf46280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 0x55f16bf46280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0011550 tx=0x7fe1d0009920 comp rx=0 tx=0).stop 2023-10-08T13:31:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/909949146 shutdown_connections 2023-10-08T13:31:44.506 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf45e60 0x55f16bf46280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf41550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/909949146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41a90 0x55f16bf45920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/909949146 >> 172.21.15.139:0/909949146 conn(0x55f16beb1200 msgr2=0x55f16bf37b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/909949146 shutdown_connections 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.499+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/909949146 wait complete. 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 -- start start 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 Processor -- start 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41a90 0x55f16bf4a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16be8fdd0 con 0x55f16bf41a90 2023-10-08T13:31:44.507 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16be2c6b0 con 0x55f16bf45e60 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16be2c350 con 0x55f16bf41170 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1ea17ab80 10 client.0 _ll_register_callbacks cb 0x55f16bc897a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42266/0 (socket says 172.21.15.139:42266) 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.500+0000 7fe1d77fe700 1 -- 172.21.15.139:0/810909939 learned_addr learned my addr 172.21.15.139:0/810909939 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41a90 0x55f16bf4a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 -- 172.21.15.139:0/810909939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 msgr2=0x55f16bf4ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 -- 172.21.15.139:0/810909939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41a90 msgr2=0x55f16bf4a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.508 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41a90 0x55f16bf4a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 -- 172.21.15.139:0/810909939 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d81a3790 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8097d00 tx=0x7fe1c809abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89e980705a3b0b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c80b2070 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe1c809b290 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.501+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f16be57e50 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1c8095ea0 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 10 client.26215 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7fe1cc017070 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f16be57e50 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe1c80b9390 con 0x55f16bf41170 2023-10-08T13:31:44.509 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 10 client.26215 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 10 client.26215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 20 client.26215 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bf5abd0 0x55f16bf5cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 4 client.26215 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f16be88db0 con 0x55f16bf5abd0 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.502+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bf5abd0 0x55f16bf5cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.503+0000 7fe1b6ffd700 10 client.26215 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.503+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bf5abd0 0x55f16bf5cff0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d279ed053ba51fb server_cookie=9d6909e1406dacb1 in_seq=0 out_seq=0 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.503+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/810909939 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f16be88db0 con 0x55f16bf5abd0 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.503+0000 7fe1b6ffd700 10 client.26215 handle_command_reply: tid=0 2023-10-08T13:31:44.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.503+0000 7fe1ea17ab80 1 client.26215 shutdown 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 msgr2=0x55f16bf4d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8097d00 tx=0x7fe1c809abf0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 shutdown_connections 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bf5abd0 0x55f16bf5cff0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41170 0x55f16bf4d570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/810909939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41a90 0x55f16bf4a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1b6ffd700 0 client.26215 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 >> 172.21.15.139:0/810909939 conn(0x55f16beb1200 msgr2=0x55f16bf37010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 shutdown_connections 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/810909939 wait complete. 2023-10-08T13:31:44.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.504+0000 7fe1ea17ab80 20 client.26215 trim_cache size 0 max 16384 2023-10-08T13:31:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 Processor -- start 2023-10-08T13:31:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 -- start start 2023-10-08T13:31:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 0x55f16bf39100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf46930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bd108c0 con 0x55f16bf45e60 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bf48e40 con 0x55f16bf41170 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bf44a80 con 0x55f16bf41a90 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1d7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1d7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42562/0 (socket says 172.21.15.139:42562) 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2042736122 learned_addr learned my addr 172.21.15.139:0/2042736122 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1d6ffd700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf46930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.520+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 0x55f16bf39100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2042736122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 msgr2=0x55f16bf46930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf46930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2042736122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 msgr2=0x55f16bf39100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 0x55f16bf39100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2042736122 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0011230 con 0x55f16bf45e60 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 0x55f16bf39100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0011550 tx=0x7fe1d0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe954d88fdd95be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1be7fc700 1 -- 172.21.15.139:0/2042736122 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x55f16bf45e60 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1be7fc700 1 -- 172.21.15.139:0/2042736122 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d0011e50 con 0x55f16bf45e60 2023-10-08T13:31:44.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.521+0000 7fe1be7fc700 1 -- 172.21.15.139:0/2042736122 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0007e80 con 0x55f16bf45e60 2023-10-08T13:31:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2042736122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 msgr2=0x55f16bf37790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.527 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0011550 tx=0x7fe1d0009b30 comp rx=0 tx=0).stop 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2042736122 shutdown_connections 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf45e60 0x55f16bf37790 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf41170 0x55f16bf39100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2042736122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf46930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2042736122 >> 172.21.15.139:0/2042736122 conn(0x55f16beb1200 msgr2=0x55f16bf61950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2042736122 shutdown_connections 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2042736122 wait complete. 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.522+0000 7fe1ea17ab80 1 -- start start 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 Processor -- start 2023-10-08T13:31:44.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf51f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bf4e6e0 con 0x55f16bf41170 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bf4e850 con 0x55f16bf45e60 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f16bf4ea10 con 0x55f16bf41a90 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1ea17ab80 10 client.0 _ll_register_callbacks cb 0x7fe1c809b0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf51f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42564/0 (socket says 172.21.15.139:42564) 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1d7fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.523+0000 7fe1d77fe700 1 -- 172.21.15.139:0/2864754892 learned_addr learned my addr 172.21.15.139:0/2864754892 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 msgr2=0x55f16bf51f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf51f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2864754892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 msgr2=0x55f16bf51a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 -- 172.21.15.139:0/2864754892 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f16bcbad80 con 0x55f16bf45e60 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1d7fff700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4e000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009b00 tx=0x7fe1d0007c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42950fc5862a2c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000e040 con 0x55f16bf45e60 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1d000f040 con 0x55f16bf45e60 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fe1d0003c00 con 0x55f16bf45e60 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d0003dc0 con 0x55f16bf45e60 2023-10-08T13:31:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1ea17ab80 10 client.26234 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55f16bca3c00 con 0x55f16bf45e60 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.524+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d000f040 con 0x55f16bf45e60 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fe1d001b020 con 0x55f16bf45e60 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 10 client.26234 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 10 client.26234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 20 client.26234 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bfaf740 0x55f16bfb1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 4 client.26234 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f16be88ad0 con 0x55f16bfaf740 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bfaf740 0x55f16bfb1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1b6ffd700 10 client.26234 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.525+0000 7fe1d77fe700 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bfaf740 0x55f16bfb1b30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b9995fab24ec50 server_cookie=aa52e740a84f960b in_seq=0 out_seq=0 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.547+0000 7fe1b6ffd700 1 -- 172.21.15.139:0/2864754892 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f16be88ad0 con 0x55f16bfaf740 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.547+0000 7fe1b6ffd700 10 client.26234 handle_command_reply: tid=0 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.547+0000 7fe1ea17ab80 1 client.26234 shutdown 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 msgr2=0x55f16bf4e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4e000 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009b00 tx=0x7fe1d0007c10 comp rx=0 tx=0).stop 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 shutdown_connections 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55f16bfaf740 0x55f16bfb1b30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f16bf45e60 0x55f16bf4e000 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1b6ffd700 0 client.26234 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f16bf41170 0x55f16bf51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 --2- 172.21.15.139:0/2864754892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f16bf41a90 0x55f16bf51f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 >> 172.21.15.139:0/2864754892 conn(0x55f16beb1200 msgr2=0x55f16bf43f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 shutdown_connections 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 1 -- 172.21.15.139:0/2864754892 wait complete. 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.548+0000 7fe1ea17ab80 20 client.26234 trim_cache size 0 max 16384 2023-10-08T13:31:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:31:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:31:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:31:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:31:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 msgr2=0x7fe1c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 0x7fe1c00a3ab0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8197a90 tx=0x7fe1cc009260 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 msgr2=0x7fe1d819c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000c00 tx=0x7fe1c8004730 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 shutdown_connections 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fe1c00a15f0 0x7fe1c00a3ab0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1d8105670 0x7fe1d8196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1d80ff8d0 0x7fe1d819c7a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 --2- 172.21.15.139:0/2680722507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1d8100290 0x7fe1d819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 >> 172.21.15.139:0/2680722507 conn(0x7fe1d80764c0 msgr2=0x7fe1d80691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 shutdown_connections 2023-10-08T13:31:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:44.549+0000 7fe1ddf91700 1 -- 172.21.15.139:0/2680722507 wait complete. 2023-10-08T13:31:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:45 smithi155 ceph-mon[103467]: pgmap v429: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 442 op/s 2023-10-08T13:31:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:45 smithi139 ceph-mon[99506]: pgmap v429: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 442 op/s 2023-10-08T13:31:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:45 smithi187 ceph-mon[104336]: pgmap v429: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 2.3 MiB/s wr, 442 op/s 2023-10-08T13:31:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:47 smithi155 ceph-mon[103467]: pgmap v430: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.5 MiB/s wr, 468 op/s 2023-10-08T13:31:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:47 smithi139 ceph-mon[99506]: pgmap v430: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.5 MiB/s wr, 468 op/s 2023-10-08T13:31:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:47 smithi187 ceph-mon[104336]: pgmap v430: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 2.5 MiB/s wr, 468 op/s 2023-10-08T13:31:49.222 INFO:tasks.workunit.client.0.smithi139.stdout:40000 copy from 0x19d87f to 0x1a73ec, (0x9b6d bytes) at 0x9241fd 2023-10-08T13:31:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:49 smithi155 ceph-mon[103467]: pgmap v431: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 433 op/s 2023-10-08T13:31:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:49 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:31:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:49 smithi139 ceph-mon[99506]: pgmap v431: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 433 op/s 2023-10-08T13:31:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:49 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:31:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:49 smithi187 ceph-mon[104336]: pgmap v431: 129 pgs: 129 active+clean; 70 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 2.3 MiB/s wr, 433 op/s 2023-10-08T13:31:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:49 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:31:51.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:31:51.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:31:51.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:31:51.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:31:51.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:31:51.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:31:51.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:31:51.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:31:51.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:31:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:51 smithi155 ceph-mon[103467]: pgmap v432: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:51 smithi139 ceph-mon[99506]: pgmap v432: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:51 smithi187 ceph-mon[104336]: pgmap v432: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 2.2 MiB/s wr, 430 op/s 2023-10-08T13:31:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:53 smithi155 ceph-mon[103467]: pgmap v433: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 402 op/s 2023-10-08T13:31:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:53 smithi139 ceph-mon[99506]: pgmap v433: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 402 op/s 2023-10-08T13:31:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:53 smithi187 ceph-mon[104336]: pgmap v433: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 2.0 MiB/s wr, 402 op/s 2023-10-08T13:31:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:55 smithi155 ceph-mon[103467]: pgmap v434: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.0 MiB/s wr, 404 op/s 2023-10-08T13:31:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:55 smithi139 ceph-mon[99506]: pgmap v434: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.0 MiB/s wr, 404 op/s 2023-10-08T13:31:56.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:55 smithi187 ceph-mon[104336]: pgmap v434: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.0 MiB/s wr, 404 op/s 2023-10-08T13:31:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/3614442146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 msgr2=0x7fc3d81049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/3614442146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d81049c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009990 tx=0x7fc3c8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/3614442146 shutdown_connections 2023-10-08T13:31:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/3614442146 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80fff90 0x7fc3d810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/3614442146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d81049c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/3614442146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d80ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.679+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/3614442146 >> 172.21.15.139:0/3614442146 conn(0x7fc3d8076790 msgr2=0x7fc3d8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.680+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/3614442146 shutdown_connections 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.680+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/3614442146 wait complete. 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.680+0000 7fc3dd4e2700 1 Processor -- start 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 -- start start 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d80fff90 0x7fc3d806d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80728a0 con 0x7fc3d81045e0 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d806da80 con 0x7fc3d80fff90 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3dd4e2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d806dc40 con 0x7fc3d80ff5d0 2023-10-08T13:31:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42294/0 (socket says 172.21.15.139:42294) 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/464658474 learned_addr learned my addr 172.21.15.139:0/464658474 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 -- 172.21.15.139:0/464658474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 msgr2=0x7fc3d8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 -- 172.21.15.139:0/464658474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d80fff90 msgr2=0x7fc3d806d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d80fff90 0x7fc3d806d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.681+0000 7fc3d77fe700 1 -- 172.21.15.139:0/464658474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80095f0 con 0x7fc3d81045e0 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:57.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d806d540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000be20 tx=0x7fc3d0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3bffff700 1 -- 172.21.15.139:0/464658474 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000cc10 con 0x7fc3d81045e0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d81abca0 con 0x7fc3d81045e0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3bffff700 1 -- 172.21.15.139:0/464658474 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3d000cd70 con 0x7fc3d81045e0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3bffff700 1 -- 172.21.15.139:0/464658474 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00126c0 con 0x7fc3d81045e0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.682+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d81ac0c0 con 0x7fc3d81045e0 2023-10-08T13:31:57.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.684+0000 7fc3bffff700 1 -- 172.21.15.139:0/464658474 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc3d00128e0 con 0x7fc3d81045e0 2023-10-08T13:31:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.685+0000 7fc3bffff700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 0x7fc3c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.685+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 0x7fc3c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.685+0000 7fc3bffff700 1 -- 172.21.15.139:0/464658474 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc3d0006e40 con 0x7fc3d81045e0 2023-10-08T13:31:57.686 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.685+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 0x7fc3c00a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009fd0 tx=0x7fc3c8009f40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 Processor -- start 2023-10-08T13:31:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 -- start start 2023-10-08T13:31:57.688 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d00880 0x5572f0d00c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0cfab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0c63400 con 0x5572f0d00880 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0c54bc0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0c524e0 con 0x5572f0d011a0 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0cfab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0cfab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42304/0 (socket says 172.21.15.139:42304) 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.686+0000 7fc3d67fc700 1 -- 172.21.15.139:0/4014650970 learned_addr learned my addr 172.21.15.139:0/4014650970 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d00880 0x5572f0d00c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 -- 172.21.15.139:0/4014650970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 msgr2=0x5572f0cfab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0cfab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 -- 172.21.15.139:0/4014650970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d00880 msgr2=0x5572f0d00c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d00880 0x5572f0d00c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 -- 172.21.15.139:0/4014650970 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572f0a78d80 con 0x5572f0cfb0b0 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfb510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ca150 tx=0x7fc3d0099410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba9591aa78efe05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3bd7fa700 1 -- 172.21.15.139:0/4014650970 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d009db30 con 0x5572f0cfb0b0 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3bd7fa700 1 -- 172.21.15.139:0/4014650970 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3d00a1d70 con 0x5572f0cfb0b0 2023-10-08T13:31:57.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.687+0000 7fc3bd7fa700 1 -- 172.21.15.139:0/4014650970 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0099130 con 0x5572f0cfb0b0 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/4014650970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 msgr2=0x5572f0cfb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfb510 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ca150 tx=0x7fc3d0099410 comp rx=0 tx=0).stop 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/4014650970 shutdown_connections 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfb510 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d00880 0x5572f0d00c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/4014650970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0cfab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/4014650970 >> 172.21.15.139:0/4014650970 conn(0x5572f0c6f200 msgr2=0x5572f0cf5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/4014650970 shutdown_connections 2023-10-08T13:31:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/4014650970 wait complete. 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 -- start start 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.688+0000 7fc3e96cbb80 1 Processor -- start 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d04520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d04c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0c4ddd0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0bea6b0 con 0x5572f0d00880 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0bea350 con 0x5572f0d011a0 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 10 client.0 _ll_register_callbacks cb 0x5572f0a477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d04520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42592/0 (socket says 172.21.15.139:42592) 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/758862402 learned_addr learned my addr 172.21.15.139:0/758862402 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d04c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 msgr2=0x5572f0d04c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d04c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/758862402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 msgr2=0x5572f0d04520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d04520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/758862402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d81ac0c0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d04520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80098e0 tx=0x7fc3c801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d35df3b62d0d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3baff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c802b050 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc3c8026270 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.689+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572f0c15e50 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c8026af0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 10 client.16797 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5572f0a61c00 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5572f0c15e50 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc3c8030400 con 0x5572f0cfb0b0 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 10 client.16797 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 10 client.16797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 20 client.16797 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d14d80 0x5572f0d171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 4 client.16797 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572f0c46db0 con 0x5572f0d14d80 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.690+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d14d80 0x5572f0d171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.691+0000 7fc3baff5700 10 client.16797 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.691+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d14d80 0x5572f0d171a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aad0b6c82de9259 server_cookie=56522508fcb3aebe in_seq=0 out_seq=0 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3baff5700 1 -- 172.21.15.139:0/758862402 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5572f0c46db0 con 0x5572f0d14d80 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3baff5700 10 client.16797 handle_command_reply: tid=0 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 client.16797 shutdown 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 msgr2=0x5572f0d07230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80098e0 tx=0x7fc3c801a050 comp rx=0 tx=0).stop 2023-10-08T13:31:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 shutdown_connections 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d04c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d07230 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d14d80 0x5572f0d171a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/758862402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d04520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3baff5700 0 client.16797 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 >> 172.21.15.139:0/758862402 conn(0x5572f0c6f200 msgr2=0x5572f0cf5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 shutdown_connections 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/758862402 wait complete. 2023-10-08T13:31:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.692+0000 7fc3e96cbb80 20 client.16797 trim_cache size 0 max 16384 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.713+0000 7fc3e96cbb80 1 Processor -- start 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.713+0000 7fc3e96cbb80 1 -- start start 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0cf5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 0x5572f0cf5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0ace8c0 con 0x5572f0d011a0 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0d11700 con 0x5572f0d00880 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0d01010 con 0x5572f0cfb0b0 2023-10-08T13:31:57.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 0x5572f0cf5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0cf5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42316/0 (socket says 172.21.15.139:42316) 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3217125636 learned_addr learned my addr 172.21.15.139:0/3217125636 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0cf5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32888/0 (socket says 172.21.15.139:32888) 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3217125636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 msgr2=0x5572f0cf5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0cf5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3217125636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 msgr2=0x5572f0cf5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 0x5572f0cf5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3217125636 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572f0a9f1f0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 0x5572f0cf5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.714+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800bf50 tx=0x7fc3c8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=199ae2d828dab800 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3bdffb700 1 -- 172.21.15.139:0/3217125636 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c802b070 con 0x5572f0cfb0b0 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3bdffb700 1 -- 172.21.15.139:0/3217125636 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3c802c040 con 0x5572f0cfb0b0 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3bdffb700 1 -- 172.21.15.139:0/3217125636 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c803a450 con 0x5572f0cfb0b0 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3217125636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 msgr2=0x5572f0cfab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800bf50 tx=0x7fc3c8009310 comp rx=0 tx=0).stop 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3217125636 shutdown_connections 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0d011a0 0x5572f0cf5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0cfb0b0 0x5572f0cfab70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.715+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3217125636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0cf5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3217125636 >> 172.21.15.139:0/3217125636 conn(0x5572f0c6f200 msgr2=0x5572f0d1bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3217125636 shutdown_connections 2023-10-08T13:31:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3217125636 wait complete. 2023-10-08T13:31:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- start start 2023-10-08T13:31:57.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 Processor -- start 2023-10-08T13:31:57.722 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d0bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d0a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0d0a940 con 0x5572f0cfb0b0 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0d67bb0 con 0x5572f0d00880 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572f0d67cf0 con 0x5572f0d011a0 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.716+0000 7fc3e96cbb80 10 client.0 _ll_register_callbacks cb 0x5572f0a477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d0a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d67fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32894/0 (socket says 172.21.15.139:32894) 2023-10-08T13:31:57.723 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d67fc700 1 -- 172.21.15.139:0/3049475416 learned_addr learned my addr 172.21.15.139:0/3049475416 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d0bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 msgr2=0x5572f0d0a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d0a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3049475416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 msgr2=0x5572f0d09b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 -- 172.21.15.139:0/3049475416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572f0a78d80 con 0x5572f0cfb0b0 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d77fe700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d0a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3d6ffd700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d0bd50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8030760 tx=0x7fc3c8026250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df442a306d3804 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3baff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c802b070 con 0x5572f0cfb0b0 2023-10-08T13:31:57.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc3c80269f0 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3d00a1d70 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c8030b80 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3e96cbb80 10 client.16803 fetch_fsmap learned FSMap version 37 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.717+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5572f0a61c00 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3d00a1d70 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fc3c8052080 con 0x5572f0cfb0b0 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 10 client.16803 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 20 client.16803 populate_metadata read hostname 'smithi139' 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d69000 0x5572f0d6b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 4 client.16803 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:31:57.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5572f0c46ad0 con 0x5572f0d69000 2023-10-08T13:31:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d69000 0x5572f0d6b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:31:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3d67fc700 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d69000 0x5572f0d6b420 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf167146587a8c4 server_cookie=789b4419d0bcc179 in_seq=0 out_seq=0 2023-10-08T13:31:57.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.718+0000 7fc3baff5700 10 client.16803 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3baff5700 1 -- 172.21.15.139:0/3049475416 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5572f0c46ad0 con 0x5572f0d69000 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3baff5700 10 client.16803 handle_command_reply: tid=0 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 client.16803 shutdown 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 msgr2=0x5572f0d0bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d0bd50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8030760 tx=0x7fc3c8026250 comp rx=0 tx=0).stop 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 shutdown_connections 2023-10-08T13:31:57.745 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5572f0d011a0 0x5572f0d0a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572f0cfb0b0 0x5572f0d0bd50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5572f0d69000 0x5572f0d6b420 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 --2- 172.21.15.139:0/3049475416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5572f0d00880 0x5572f0d09b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3baff5700 0 client.16803 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 >> 172.21.15.139:0/3049475416 conn(0x5572f0c6f200 msgr2=0x5572f0d02a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 shutdown_connections 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.743+0000 7fc3e96cbb80 1 -- 172.21.15.139:0/3049475416 wait complete. 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3e96cbb80 20 client.16803 trim_cache size 0 max 16384 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:31:57.746 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:31:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:31:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:31:57.747 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 msgr2=0x7fc3c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 0x7fc3c00a3ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009fd0 tx=0x7fc3c8009f40 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 msgr2=0x7fc3d806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d806d540 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000be20 tx=0x7fc3d0009ed0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 shutdown_connections 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc3c00a15f0 0x7fc3c00a3ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3d81045e0 0x7fc3d806d540 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3d80ff5d0 0x7fc3d8072050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 --2- 172.21.15.139:0/464658474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3d80fff90 0x7fc3d806d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 >> 172.21.15.139:0/464658474 conn(0x7fc3d8076790 msgr2=0x7fc3d80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 shutdown_connections 2023-10-08T13:31:57.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:31:57.744+0000 7fc3dd4e2700 1 -- 172.21.15.139:0/464658474 wait complete. 2023-10-08T13:31:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:57 smithi155 ceph-mon[103467]: pgmap v435: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 439 op/s 2023-10-08T13:31:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:57 smithi139 ceph-mon[99506]: pgmap v435: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 439 op/s 2023-10-08T13:31:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:57 smithi187 ceph-mon[104336]: pgmap v435: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.3 MiB/s wr, 439 op/s 2023-10-08T13:32:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:31:59 smithi155 ceph-mon[103467]: pgmap v436: 129 pgs: 129 active+clean; 69 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2023-10-08T13:32:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:31:59 smithi139 ceph-mon[99506]: pgmap v436: 129 pgs: 129 active+clean; 69 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2023-10-08T13:32:00.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:31:59 smithi187 ceph-mon[104336]: pgmap v436: 129 pgs: 129 active+clean; 69 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2023-10-08T13:32:01.726 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:01 smithi187 ceph-mon[104336]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.2 MiB/s wr, 416 op/s 2023-10-08T13:32:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:01 smithi155 ceph-mon[103467]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.2 MiB/s wr, 416 op/s 2023-10-08T13:32:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:01 smithi139 ceph-mon[99506]: pgmap v437: 129 pgs: 129 active+clean; 68 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 2.2 MiB/s wr, 416 op/s 2023-10-08T13:32:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:03 smithi155 ceph-mon[103467]: pgmap v438: 129 pgs: 129 active+clean; 70 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-10-08T13:32:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:03 smithi139 ceph-mon[99506]: pgmap v438: 129 pgs: 129 active+clean; 70 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-10-08T13:32:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:03 smithi187 ceph-mon[104336]: pgmap v438: 129 pgs: 129 active+clean; 70 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 2.1 MiB/s wr, 399 op/s 2023-10-08T13:32:05.653 INFO:tasks.workunit.client.0.smithi139.stdout:50000 trunc from 0x3a0a6d to 0x51d279 2023-10-08T13:32:05.653 INFO:tasks.workunit.client.0.smithi139.stdout:All 50000 operations completed A-OK! 2023-10-08T13:32:05.656 INFO:tasks.workunit.client.0.smithi139.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2023-10-08T13:32:05.657 INFO:tasks.workunit.client.0.smithi139.stdout:Seed set to 1 2023-10-08T13:32:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:05 smithi155 ceph-mon[103467]: pgmap v439: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2023-10-08T13:32:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:05 smithi139 ceph-mon[99506]: pgmap v439: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2023-10-08T13:32:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:05 smithi187 ceph-mon[104336]: pgmap v439: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2023-10-08T13:32:06.759 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode 0, disabling! 2023-10-08T13:32:06.759 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2023-10-08T13:32:06.762 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2023-10-08T13:32:06.762 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2023-10-08T13:32:06.762 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support clone range, disabling! 2023-10-08T13:32:06.767 INFO:tasks.workunit.client.0.smithi139.stderr:main: filesystem does not support dedupe range, disabling! 2023-10-08T13:32:06.769 INFO:tasks.workunit.client.0.smithi139.stdout:skipping zero size read 2023-10-08T13:32:06.769 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x7e0023 2023-10-08T13:32:06.777 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0xe91bf1 2023-10-08T13:32:06.778 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x5a6de73 2023-10-08T13:32:06.801 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x5bdf572 2023-10-08T13:32:06.805 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x602fcad 2023-10-08T13:32:06.996 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x623914d 2023-10-08T13:32:07.080 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x628f369 2023-10-08T13:32:07.157 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x6328dee 2023-10-08T13:32:07.447 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x635b95a 2023-10-08T13:32:07.831 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x637b84e 2023-10-08T13:32:07.990 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x63b535e 2023-10-08T13:32:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:07 smithi155 ceph-mon[103467]: pgmap v440: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:32:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:07 smithi139 ceph-mon[99506]: pgmap v440: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:32:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:07 smithi187 ceph-mon[104336]: pgmap v440: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 2.3 MiB/s wr, 443 op/s 2023-10-08T13:32:09.925 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 -- 172.21.15.139:0/777292027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 msgr2=0x7f0890106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 --2- 172.21.15.139:0/777292027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890106b30 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f088c009990 tx=0x7f088c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 -- 172.21.15.139:0/777292027 shutdown_connections 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 --2- 172.21.15.139:0/777292027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 --2- 172.21.15.139:0/777292027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890106b30 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 --2- 172.21.15.139:0/777292027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 0x7f0890100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 -- 172.21.15.139:0/777292027 >> 172.21.15.139:0/777292027 conn(0x7f08900fc230 msgr2=0x7f08900fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.083 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 -- 172.21.15.139:0/777292027 shutdown_connections 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.080+0000 7f0897b5f700 1 -- 172.21.15.139:0/777292027 wait complete. 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 Processor -- start 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 -- start start 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 0x7f089019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890196fe0 con 0x7f0890106750 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890197150 con 0x7f0890100740 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f0897b5f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890197310 con 0x7f0890101100 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08960fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.084 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08958fb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 0x7f089019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08960fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42630/0 (socket says 172.21.15.139:42630) 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08960fc700 1 -- 172.21.15.139:0/4224816602 learned_addr learned my addr 172.21.15.139:0/4224816602 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 -- 172.21.15.139:0/4224816602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 msgr2=0x7f089019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 0x7f089019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 -- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 msgr2=0x7f0890196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 -- 172.21.15.139:0/4224816602 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0095f0 con 0x7f0890101100 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08960fc700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.081+0000 7f08950fa700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089019cd90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f088000e9f0 tx=0x7f088000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.082+0000 7f0886ffd700 1 -- 172.21.15.139:0/4224816602 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088000c9c0 con 0x7f0890101100 2023-10-08T13:32:10.085 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.082+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08901975f0 con 0x7f0890101100 2023-10-08T13:32:10.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.082+0000 7f0886ffd700 1 -- 172.21.15.139:0/4224816602 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0880010430 con 0x7f0890101100 2023-10-08T13:32:10.086 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.082+0000 7f0886ffd700 1 -- 172.21.15.139:0/4224816602 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880018680 con 0x7f0890101100 2023-10-08T13:32:10.087 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.082+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901a3840 con 0x7f0890101100 2023-10-08T13:32:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.084+0000 7f0886ffd700 1 -- 172.21.15.139:0/4224816602 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f08800187e0 con 0x7f0890101100 2023-10-08T13:32:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.085+0000 7f0886ffd700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 0x7f087c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.089 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.085+0000 7f08958fb700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 0x7f087c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.085+0000 7f0886ffd700 1 -- 172.21.15.139:0/4224816602 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f0880014070 con 0x7f0890101100 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.085+0000 7f08958fb700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 0x7f087c0a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f088c00b2e0 tx=0x7f088c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 Processor -- start 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 -- start start 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205857460 con 0x55b2058fda60 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205848c20 con 0x55b2058ee7a0 2023-10-08T13:32:10.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205846540 con 0x55b2058ede80 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08960fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08958fb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08950fa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08950fa700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32924/0 (socket says 172.21.15.139:32924) 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08958fb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42350/0 (socket says 172.21.15.139:42350) 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08960fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42638/0 (socket says 172.21.15.139:42638) 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.086+0000 7f08950fa700 1 -- 172.21.15.139:0/1861623488 learned_addr learned my addr 172.21.15.139:0/1861623488 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 -- 172.21.15.139:0/1861623488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 msgr2=0x55b2058ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 -- 172.21.15.139:0/1861623488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 msgr2=0x55b2058ffe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 -- 172.21.15.139:0/1861623488 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b20566cde0 con 0x55b2058ee7a0 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08960fc700 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08958fb700 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f08950fa700 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f088009a1b0 tx=0x7f0880099c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58cabeef6a512168 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f087bfff700 1 -- 172.21.15.139:0/1861623488 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088009e370 con 0x55b2058ee7a0 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f087bfff700 1 -- 172.21.15.139:0/1861623488 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08800a25b0 con 0x55b2058ee7a0 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.087+0000 7f087bfff700 1 -- 172.21.15.139:0/1861623488 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880010960 con 0x55b2058ee7a0 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1861623488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 msgr2=0x55b2058fd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f088009a1b0 tx=0x7f0880099c70 comp rx=0 tx=0).stop 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1861623488 shutdown_connections 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b2058ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b2058ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.092 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1861623488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ee7a0 0x55b2058fd520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1861623488 >> 172.21.15.139:0/1861623488 conn(0x55b205863260 msgr2=0x55b2058ea2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1861623488 shutdown_connections 2023-10-08T13:32:10.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1861623488 wait complete. 2023-10-08T13:32:10.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 -- start start 2023-10-08T13:32:10.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.088+0000 7f08a3d48b80 1 Processor -- start 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b2058fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058fda60 0x55b2058fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205841e30 con 0x55b2058ee7a0 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2057de710 con 0x55b2058ede80 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2057de3b0 con 0x55b2058fda60 2023-10-08T13:32:10.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08a3d48b80 10 client.0 _ll_register_callbacks cb 0x55b20563b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42642/0 (socket says 172.21.15.139:42642) 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 -- 172.21.15.139:0/1932796176 learned_addr learned my addr 172.21.15.139:0/1932796176 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08958fb700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b2058fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08960fc700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058fda60 0x55b2058fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 -- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058fda60 msgr2=0x55b2058fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058fda60 0x55b2058fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 -- 172.21.15.139:0/1932796176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 msgr2=0x55b2058fd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b2058fd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 -- 172.21.15.139:0/1932796176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0888009110 con 0x55b2058ee7a0 2023-10-08T13:32:10.097 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08950fa700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0880099f20 tx=0x7f08800107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc18eeae215c1eab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.089+0000 7f08797fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800b8070 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f088009e370 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b205809eb0 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f088009a480 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 10 client.16815 fetch_fsmap learned FSMap version 37 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f08901a3840 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b205809eb0 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f088000cb20 con 0x55b2058ee7a0 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 10 client.16815 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:10.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 20 client.16815 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b20590d300 0x55b20590f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 4 client.16815 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b20583ae10 con 0x55b20590d300 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.090+0000 7f08958fb700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b20590d300 0x55b20590f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.091+0000 7f08958fb700 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b20590d300 0x55b20590f720 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bef0079a055520b server_cookie=983eca7c23c6a533 in_seq=0 out_seq=0 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.091+0000 7f08797fa700 10 client.16815 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08797fa700 1 -- 172.21.15.139:0/1932796176 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b20583ae10 con 0x55b20590d300 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08797fa700 10 client.16815 handle_command_reply: tid=0 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 client.16815 shutdown 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 msgr2=0x55b2058fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.099 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0880099f20 tx=0x7f08800107d0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 shutdown_connections 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058fda60 0x55b2058fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b20590d300 0x55b20590f720 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b2058fd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1932796176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fa740 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 >> 172.21.15.139:0/1932796176 conn(0x55b205863260 msgr2=0x55b2058e9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08797fa700 0 client.16815 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 shutdown_connections 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1932796176 wait complete. 2023-10-08T13:32:10.100 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.094+0000 7f08a3d48b80 20 client.16815 trim_cache size 0 max 16384 2023-10-08T13:32:10.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:09 smithi155 ceph-mon[103467]: pgmap v441: 129 pgs: 129 active+clean; 77 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 2.0 MiB/s wr, 396 op/s 2023-10-08T13:32:10.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 Processor -- start 2023-10-08T13:32:10.123 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 -- start start 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b205904550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 0x55b2058f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2056c2920 con 0x55b2058ee7a0 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2058fb6c0 con 0x55b2058fda60 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2058e4570 con 0x55b2058ede80 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08950fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08958fb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b205904550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08960fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 0x55b2058f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.124 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08958fb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b205904550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42364/0 (socket says 172.21.15.139:42364) 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08958fb700 1 -- 172.21.15.139:0/1724978272 learned_addr learned my addr 172.21.15.139:0/1724978272 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.121+0000 7f08950fa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42650/0 (socket says 172.21.15.139:42650) 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 -- 172.21.15.139:0/1724978272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 msgr2=0x55b205904550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b205904550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 -- 172.21.15.139:0/1724978272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 msgr2=0x55b2058fcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 -- 172.21.15.139:0/1724978272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b205655c60 con 0x55b2058fda60 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08950fa700 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f08960fc700 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 0x55b2058f5a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0888007850 tx=0x7f088800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f34bda59a4acb611 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.125 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f0884d82700 1 -- 172.21.15.139:0/1724978272 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888004db0 con 0x55b2058fda60 2023-10-08T13:32:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f0884d82700 1 -- 172.21.15.139:0/1724978272 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f088801b070 con 0x55b2058fda60 2023-10-08T13:32:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.122+0000 7f0884d82700 1 -- 172.21.15.139:0/1724978272 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888004020 con 0x55b2058fda60 2023-10-08T13:32:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.123+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1724978272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 msgr2=0x55b2058f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.123+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 0x55b2058f5a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0888007850 tx=0x7f088800b040 comp rx=0 tx=0).stop 2023-10-08T13:32:10.126 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.124+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1724978272 shutdown_connections 2023-10-08T13:32:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.125+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058fda60 0x55b2058f5a60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.125+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ede80 0x55b205904550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.125+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/1724978272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058ee7a0 0x55b2058fcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.127 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.125+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1724978272 >> 172.21.15.139:0/1724978272 conn(0x55b205863260 msgr2=0x55b2058e5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.130 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.130+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1724978272 shutdown_connections 2023-10-08T13:32:10.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.130+0000 7f08a3d48b80 1 -- 172.21.15.139:0/1724978272 wait complete. 2023-10-08T13:32:10.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.130+0000 7f08a3d48b80 1 -- start start 2023-10-08T13:32:10.131 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.130+0000 7f08a3d48b80 1 Processor -- start 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b205903e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b205902670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205902cc0 con 0x55b2058fda60 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205902e30 con 0x55b2058ede80 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b205902ff0 con 0x55b2058ee7a0 2023-10-08T13:32:10.132 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.131+0000 7f08a3d48b80 10 client.0 _ll_register_callbacks cb 0x7f0888009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:10.133 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.133+0000 7f08950fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.133+0000 7f08950fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42374/0 (socket says 172.21.15.139:42374) 2023-10-08T13:32:10.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.133+0000 7f08950fa700 1 -- 172.21.15.139:0/3709081574 learned_addr learned my addr 172.21.15.139:0/3709081574 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.133+0000 7f08958fb700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b205903e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.134 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.133+0000 7f08960fc700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b205902670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 -- 172.21.15.139:0/3709081574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 msgr2=0x55b205903e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b205903e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 -- 172.21.15.139:0/3709081574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 msgr2=0x55b205902670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b205902670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 -- 172.21.15.139:0/3709081574 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901a3840 con 0x55b2058ee7a0 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08950fa700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08800966d0 tx=0x7f08800092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67539e25a84bd62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.134+0000 7f08797fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800b8040 con 0x55b2058ee7a0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f088009e370 con 0x55b2058ee7a0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08800a25b0 con 0x55b2058ee7a0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f088009a920 con 0x55b2058ee7a0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 10 client.26254 fetch_fsmap learned FSMap version 37 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7f0888007500 con 0x55b2058ee7a0 2023-10-08T13:32:10.137 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08800a25b0 con 0x55b2058ee7a0 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0880096010 con 0x55b2058ee7a0 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 10 client.26254 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 10 client.26254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 20 client.26254 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b205957f20 0x55b20595a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 4 client.26254 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.135+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b20583ab30 con 0x55b205957f20 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08958fb700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b205957f20 0x55b20595a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08797fa700 10 client.26254 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08958fb700 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b205957f20 0x55b20595a340 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd229bd0a1c070bc server_cookie=f1d135b574f93125 in_seq=0 out_seq=0 2023-10-08T13:32:10.139 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08797fa700 1 -- 172.21.15.139:0/3709081574 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b20583ab30 con 0x55b205957f20 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08797fa700 10 client.26254 handle_command_reply: tid=0 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.136+0000 7f08a3d48b80 1 client.26254 shutdown 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 msgr2=0x55b2059043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08800966d0 tx=0x7f08800092d0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 shutdown_connections 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b2058fda60 0x55b205902670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55b205957f20 0x55b20595a340 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2058ede80 0x55b205903e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08797fa700 0 client.26254 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 --2- 172.21.15.139:0/3709081574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2058ee7a0 0x55b2059043d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 >> 172.21.15.139:0/3709081574 conn(0x55b205863260 msgr2=0x55b2058f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 shutdown_connections 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 1 -- 172.21.15.139:0/3709081574 wait complete. 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.137+0000 7f08a3d48b80 20 client.26254 trim_cache size 0 max 16384 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:32:10.141 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:32:10.142 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 msgr2=0x7f087c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 0x7f087c0a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f088c00b2e0 tx=0x7f088c005960 comp rx=0 tx=0).stop 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 msgr2=0x7f089019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089019cd90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f088000e9f0 tx=0x7f088000ed00 comp rx=0 tx=0).stop 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 shutdown_connections 2023-10-08T13:32:10.143 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f087c0a15f0 0x7f087c0a3ab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0890106750 0x7f0890196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0890100740 0x7f089019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 --2- 172.21.15.139:0/4224816602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0890101100 0x7f089019cd90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 >> 172.21.15.139:0/4224816602 conn(0x7f08900fc230 msgr2=0x7f08900fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 shutdown_connections 2023-10-08T13:32:10.144 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:10.138+0000 7f0897b5f700 1 -- 172.21.15.139:0/4224816602 wait complete. 2023-10-08T13:32:10.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:09 smithi139 ceph-mon[99506]: pgmap v441: 129 pgs: 129 active+clean; 77 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 2.0 MiB/s wr, 396 op/s 2023-10-08T13:32:10.153 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:32:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:09 smithi187 ceph-mon[104336]: pgmap v441: 129 pgs: 129 active+clean; 77 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 2.0 MiB/s wr, 396 op/s 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2593360798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 msgr2=0x7f9c080ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2593360798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c080ff3a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009990 tx=0x7f9bfc009ca0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2593360798 shutdown_connections 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2593360798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 0x7f9c0810bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2593360798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c080ff3a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2593360798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c080ff970 0x7f9c081039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2593360798 >> 172.21.15.139:0/2593360798 conn(0x7f9c08075bf0 msgr2=0x7f9c080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2593360798 shutdown_connections 2023-10-08T13:32:10.889 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.885+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2593360798 wait complete. 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 Processor -- start 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 -- start start 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 0x7f9c0819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081969d0 0x7f9c08196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08197450 con 0x7f9c080fefc0 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081975c0 con 0x7f9c081969d0 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.886+0000 7f9c0dc54700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08197780 con 0x7f9c081040e0 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42666/0 (socket says 172.21.15.139:42666) 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 -- 172.21.15.139:0/2209975301 learned_addr learned my addr 172.21.15.139:0/2209975301 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.890 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 0x7f9c0819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 -- 172.21.15.139:0/2209975301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 msgr2=0x7f9c0819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 0x7f9c0819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 -- 172.21.15.139:0/2209975301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081969d0 msgr2=0x7f9c08196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081969d0 0x7f9c08196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 -- 172.21.15.139:0/2209975301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0095f0 con 0x7f9c080fefc0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc004760 tx=0x7f9bfc004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c04ff9700 1 -- 172.21.15.139:0/2209975301 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc01d070 con 0x7f9c080fefc0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c081a3710 con 0x7f9c080fefc0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c04ff9700 1 -- 172.21.15.139:0/2209975301 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bfc022470 con 0x7f9c080fefc0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c04ff9700 1 -- 172.21.15.139:0/2209975301 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc017650 con 0x7f9c080fefc0 2023-10-08T13:32:10.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.887+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c081a3b90 con 0x7f9c080fefc0 2023-10-08T13:32:10.893 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.890+0000 7f9c04ff9700 1 -- 172.21.15.139:0/2209975301 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f9bfc017870 con 0x7f9c080fefc0 2023-10-08T13:32:10.893 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c04ff9700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 0x7f9bf00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c04ff9700 1 -- 172.21.15.139:0/2209975301 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9bfc0ce580 con 0x7f9c080fefc0 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 0x7f9bf00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c19e3db80 1 Processor -- start 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 0x7f9bf00a3ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c08197b90 tx=0x7f9bf8010040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c19e3db80 1 -- start start 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.891+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7491a0 0x5648bf742b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf743510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf6ab400 con 0x5648bf748880 2023-10-08T13:32:10.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf69cbc0 con 0x5648bf7430b0 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf69a4e0 con 0x5648bf7491a0 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c06ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7491a0 0x5648bf742b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42674/0 (socket says 172.21.15.139:42674) 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 -- 172.21.15.139:0/3458160466 learned_addr learned my addr 172.21.15.139:0/3458160466 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf743510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 -- 172.21.15.139:0/3458160466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7491a0 msgr2=0x5648bf742b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7491a0 0x5648bf742b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 -- 172.21.15.139:0/3458160466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 msgr2=0x5648bf743510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf743510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 -- 172.21.15.139:0/3458160466 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648bf4c0d80 con 0x5648bf748880 2023-10-08T13:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9c077fe700 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc097d20 tx=0x7f9bfc095f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd52ba3f4f3bc85e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9bedffb700 1 -- 172.21.15.139:0/3458160466 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc09b9b0 con 0x5648bf748880 2023-10-08T13:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9bedffb700 1 -- 172.21.15.139:0/3458160466 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bfc0a1040 con 0x5648bf748880 2023-10-08T13:32:10.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.892+0000 7f9bedffb700 1 -- 172.21.15.139:0/3458160466 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc099720 con 0x5648bf748880 2023-10-08T13:32:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3458160466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 msgr2=0x5648bf748c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc097d20 tx=0x7f9bfc095f90 comp rx=0 tx=0).stop 2023-10-08T13:32:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3458160466 shutdown_connections 2023-10-08T13:32:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf743510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf748c60 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3458160466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7491a0 0x5648bf742b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3458160466 >> 172.21.15.139:0/3458160466 conn(0x5648bf6b7200 msgr2=0x5648bf73db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3458160466 shutdown_connections 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.893+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3458160466 wait complete. 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 -- start start 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 Processor -- start 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf74f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 0x5648bf74c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf74cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf695dd0 con 0x5648bf7491a0 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf6326b0 con 0x5648bf748880 2023-10-08T13:32:10.903 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf632350 con 0x5648bf7430b0 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c19e3db80 10 client.0 _ll_register_callbacks cb 0x5648bf48f7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c06ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 0x5648bf74c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf74f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf74cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c06ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 0x5648bf74c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32970/0 (socket says 172.21.15.139:32970) 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c06ffd700 1 -- 172.21.15.139:0/3393935386 learned_addr learned my addr 172.21.15.139:0/3393935386 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf74f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42396/0 (socket says 172.21.15.139:42396) 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c07fff700 1 -- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 msgr2=0x5648bf74f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.894+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf74f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c07fff700 1 -- 172.21.15.139:0/3393935386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 msgr2=0x5648bf74c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 0x5648bf74c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c07fff700 1 -- 172.21.15.139:0/3393935386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c081a3b90 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf74cbd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9c00011bf0 tx=0x7f9c00011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e9f813bb96b785 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00010040 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648bf65de50 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9c00004bb0 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c00004d70 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 10 client.16833 fetch_fsmap learned FSMap version 37 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5648bf4a9c00 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5648bf65de50 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9c0000f5a0 con 0x5648bf7491a0 2023-10-08T13:32:10.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 10 client.16833 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 10 client.16833 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 20 client.16833 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.895+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf75cad0 0x5648bf75eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.896+0000 7f9c19e3db80 4 client.16833 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.896+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648bf68edb0 con 0x5648bf75cad0 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.896+0000 7f9c077fe700 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf75cad0 0x5648bf75eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.896+0000 7f9be6ffd700 10 client.16833 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.896+0000 7f9c077fe700 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf75cad0 0x5648bf75eef0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92754dea5d0772b server_cookie=9d51775e29a75d9 in_seq=0 out_seq=0 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.897+0000 7f9be6ffd700 1 -- 172.21.15.139:0/3393935386 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648bf68edb0 con 0x5648bf75cad0 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.897+0000 7f9be6ffd700 10 client.16833 handle_command_reply: tid=0 2023-10-08T13:32:10.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.897+0000 7f9c19e3db80 1 client.16833 shutdown 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 msgr2=0x5648bf74cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf74cbd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9c00011bf0 tx=0x7f9c00011f00 comp rx=0 tx=0).stop 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 shutdown_connections 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf74cbd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf74f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf75cad0 0x5648bf75eef0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3393935386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf748880 0x5648bf74c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 >> 172.21.15.139:0/3393935386 conn(0x5648bf6b7200 msgr2=0x5648bf73d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9be6ffd700 0 client.16833 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 shutdown_connections 2023-10-08T13:32:10.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3393935386 wait complete. 2023-10-08T13:32:10.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.898+0000 7f9c19e3db80 20 client.16833 trim_cache size 0 max 16384 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 Processor -- start 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 -- start start 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf7588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 0x5648bf7538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf5168c0 con 0x5648bf7491a0 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf73e790 con 0x5648bf7430b0 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.918+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf73a830 con 0x5648bf748880 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.921 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c06ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 0x5648bf7538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42692/0 (socket says 172.21.15.139:42692) 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf7588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c06ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 0x5648bf7538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42406/0 (socket says 172.21.15.139:42406) 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 -- 172.21.15.139:0/3250376771 learned_addr learned my addr 172.21.15.139:0/3250376771 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 -- 172.21.15.139:0/3250376771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 msgr2=0x5648bf7538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 0x5648bf7538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 -- 172.21.15.139:0/3250376771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 msgr2=0x5648bf7588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf7588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 -- 172.21.15.139:0/3250376771 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648bf4e71f0 con 0x5648bf7491a0 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9c07fff700 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009dd0 tx=0x7f9c00004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a403137b7bde89a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9bee7fc700 1 -- 172.21.15.139:0/3250376771 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000f5a0 con 0x5648bf7491a0 2023-10-08T13:32:10.922 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9bee7fc700 1 -- 172.21.15.139:0/3250376771 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c0000f700 con 0x5648bf7491a0 2023-10-08T13:32:10.923 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.919+0000 7f9bee7fc700 1 -- 172.21.15.139:0/3250376771 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00016450 con 0x5648bf7491a0 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3250376771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 msgr2=0x5648bf747c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009dd0 tx=0x7f9c00004a90 comp rx=0 tx=0).stop 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3250376771 shutdown_connections 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf7491a0 0x5648bf747c90 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7430b0 0x5648bf7588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.926 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/3250376771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf748880 0x5648bf7538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3250376771 >> 172.21.15.139:0/3250376771 conn(0x5648bf6b7200 msgr2=0x5648bf747580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3250376771 shutdown_connections 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.920+0000 7f9c19e3db80 1 -- 172.21.15.139:0/3250376771 wait complete. 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 -- start start 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 Processor -- start 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf7456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf745c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf753ef0 con 0x5648bf748880 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf744970 con 0x5648bf7491a0 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648bf744b30 con 0x5648bf7430b0 2023-10-08T13:32:10.927 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c19e3db80 10 client.0 _ll_register_callbacks cb 0x7f9c00011550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c077fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf7456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c07fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:32984/0 (socket says 172.21.15.139:32984) 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c07fff700 1 -- 172.21.15.139:0/2757981993 learned_addr learned my addr 172.21.15.139:0/2757981993 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.921+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf745c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 -- 172.21.15.139:0/2757981993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 msgr2=0x5648bf744400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 -- 172.21.15.139:0/2757981993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 msgr2=0x5648bf745c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf745c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 -- 172.21.15.139:0/2757981993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648bf4a9c00 con 0x5648bf7430b0 2023-10-08T13:32:10.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c07fff700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c077fe700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf7456e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc09f5c0 tx=0x7f9bfc01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71721df230513a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9be6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc09f400 con 0x5648bf7430b0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9bfc0a35b0 con 0x5648bf7430b0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bfc0a1040 con 0x5648bf7430b0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bfc0228e0 con 0x5648bf7430b0 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c19e3db80 10 client.26272 fetch_fsmap learned FSMap version 37 2023-10-08T13:32:10.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5648bf4bf250 con 0x5648bf7430b0 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.922+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bfc0a9080 con 0x5648bf7430b0 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 37) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9bfc0b92c0 con 0x5648bf7430b0 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 10 client.26272 fetch_fsmap finished waiting for FSMap version 37 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 20 client.26272 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf7b5940 0x5648bf7b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 4 client.26272 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5648bf68ead0 con 0x5648bf7b5940 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf7b5940 0x5648bf7b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9be6ffd700 10 client.26272 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.923+0000 7f9c06ffd700 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf7b5940 0x5648bf7b7d60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=533ac3962113a754 server_cookie=7e87eef6229500ca in_seq=0 out_seq=0 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9be6ffd700 1 -- 172.21.15.139:0/2757981993 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5648bf68ead0 con 0x5648bf7b5940 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9be6ffd700 10 client.26272 handle_command_reply: tid=0 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 client.26272 shutdown 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 msgr2=0x5648bf7456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf7456e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc09f5c0 tx=0x7f9bfc01a040 comp rx=0 tx=0).stop 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 shutdown_connections 2023-10-08T13:32:10.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5648bf7b5940 0x5648bf7b7d60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648bf7491a0 0x5648bf744400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9be6ffd700 0 client.26272 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5648bf7430b0 0x5648bf7456e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 --2- 172.21.15.139:0/2757981993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5648bf748880 0x5648bf745c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 >> 172.21.15.139:0/2757981993 conn(0x5648bf6b7200 msgr2=0x5648bf749580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.957+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 shutdown_connections 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c19e3db80 1 -- 172.21.15.139:0/2757981993 wait complete. 2023-10-08T13:32:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c19e3db80 20 client.26272 trim_cache size 0 max 16384 2023-10-08T13:32:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:32:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:32:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:32:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 msgr2=0x7f9bf00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 0x7f9bf00a3ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9c08197b90 tx=0x7f9bf8010040 comp rx=0 tx=0).stop 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 msgr2=0x7f9c0819c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc004760 tx=0x7f9bfc004790 comp rx=0 tx=0).stop 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 shutdown_connections 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9bf00a15f0 0x7f9bf00a3ab0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.958+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c081969d0 0x7f9c08196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.959+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c080fefc0 0x7f9c0819c8a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.959+0000 7f9c0dc54700 1 --2- 172.21.15.139:0/2209975301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c081040e0 0x7f9c0819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.959+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 >> 172.21.15.139:0/2209975301 conn(0x7f9c08075bf0 msgr2=0x7f9c081023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.959+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 shutdown_connections 2023-10-08T13:32:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:10.959+0000 7f9c0dc54700 1 -- 172.21.15.139:0/2209975301 wait complete. 2023-10-08T13:32:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:11 smithi155 ceph-mon[103467]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2023-10-08T13:32:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:11 smithi139 ceph-mon[99506]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2023-10-08T13:32:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:11 smithi187 ceph-mon[104336]: pgmap v442: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2023-10-08T13:32:14.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:13 smithi155 ceph-mon[103467]: pgmap v443: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.7 MiB/s wr, 452 op/s 2023-10-08T13:32:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:13 smithi139 ceph-mon[99506]: pgmap v443: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.7 MiB/s wr, 452 op/s 2023-10-08T13:32:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:13 smithi187 ceph-mon[104336]: pgmap v443: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.7 MiB/s wr, 452 op/s 2023-10-08T13:32:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:15 smithi155 ceph-mon[103467]: pgmap v444: 129 pgs: 129 active+clean; 87 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.8 MiB/s wr, 483 op/s 2023-10-08T13:32:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:15 smithi139 ceph-mon[99506]: pgmap v444: 129 pgs: 129 active+clean; 87 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.8 MiB/s wr, 483 op/s 2023-10-08T13:32:16.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:15 smithi187 ceph-mon[104336]: pgmap v444: 129 pgs: 129 active+clean; 87 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.8 MiB/s wr, 483 op/s 2023-10-08T13:32:17.169 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x63d8bf1 2023-10-08T13:32:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:17 smithi155 ceph-mon[103467]: pgmap v445: 129 pgs: 129 active+clean; 79 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 606 op/s 2023-10-08T13:32:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:17 smithi139 ceph-mon[99506]: pgmap v445: 129 pgs: 129 active+clean; 79 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 606 op/s 2023-10-08T13:32:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:17 smithi187 ceph-mon[104336]: pgmap v445: 129 pgs: 129 active+clean; 79 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 606 op/s 2023-10-08T13:32:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:19 smithi155 ceph-mon[103467]: pgmap v446: 129 pgs: 129 active+clean; 83 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2023-10-08T13:32:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:19 smithi139 ceph-mon[99506]: pgmap v446: 129 pgs: 129 active+clean; 83 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2023-10-08T13:32:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:19 smithi187 ceph-mon[104336]: pgmap v446: 129 pgs: 129 active+clean; 83 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2023-10-08T13:32:20.364 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x63e65d6 2023-10-08T13:32:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:21 smithi155 ceph-mon[103467]: pgmap v447: 129 pgs: 129 active+clean; 81 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 638 op/s 2023-10-08T13:32:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:21 smithi139 ceph-mon[99506]: pgmap v447: 129 pgs: 129 active+clean; 81 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 638 op/s 2023-10-08T13:32:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:21 smithi187 ceph-mon[104336]: pgmap v447: 129 pgs: 129 active+clean; 81 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 638 op/s 2023-10-08T13:32:23.748 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x63ea964 2023-10-08T13:32:23.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:23 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:23.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:23 smithi155 ceph-mon[103467]: pgmap v448: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 806 op/s 2023-10-08T13:32:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:23 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:23 smithi139 ceph-mon[99506]: pgmap v448: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 806 op/s 2023-10-08T13:32:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:23 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:23 smithi187 ceph-mon[104336]: pgmap v448: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 806 op/s 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1554787896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 msgr2=0x7f9b9c1055a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1554787896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c1055a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9b900099c0 tx=0x7f9b90009cd0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1554787896 shutdown_connections 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1554787896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1554787896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c067fd0 0x7f9b9c0683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1554787896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c1055a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.093 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1554787896 >> 172.21.15.139:0/1554787896 conn(0x7f9b9c076790 msgr2=0x7f9b9c076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1554787896 shutdown_connections 2023-10-08T13:32:24.094 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.091+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1554787896 wait complete. 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.092+0000 7f9ba1eea700 1 Processor -- start 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.092+0000 7f9ba1eea700 1 -- start start 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c067fd0 0x7f9b9c19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c197150 con 0x7f9b9c105120 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1972c0 con 0x7f9b9c105ae0 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9ba1eea700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c197480 con 0x7f9b9c067fd0 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.096 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42710/0 (socket says 172.21.15.139:42710) 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 -- 172.21.15.139:0/1107022142 learned_addr learned my addr 172.21.15.139:0/1107022142 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c067fd0 0x7f9b9c19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 -- 172.21.15.139:0/1107022142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c067fd0 msgr2=0x7f9b9c19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c067fd0 0x7f9b9c19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 -- 172.21.15.139:0/1107022142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 msgr2=0x7f9b9c196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 -- 172.21.15.139:0/1107022142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900095f0 con 0x7f9b9c105120 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.093+0000 7f9b9affd700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c010 tx=0x7f9b90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.097 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.094+0000 7f9b98ff9700 1 -- 172.21.15.139:0/1107022142 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9001d070 con 0x7f9b9c105120 2023-10-08T13:32:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.094+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c197700 con 0x7f9b9c105120 2023-10-08T13:32:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.094+0000 7f9b98ff9700 1 -- 172.21.15.139:0/1107022142 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b9000fc70 con 0x7f9b9c105120 2023-10-08T13:32:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.094+0000 7f9b98ff9700 1 -- 172.21.15.139:0/1107022142 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90022c10 con 0x7f9b9c105120 2023-10-08T13:32:24.098 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.094+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1a39b0 con 0x7f9b9c105120 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.096+0000 7f9b98ff9700 1 -- 172.21.15.139:0/1107022142 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f9b90022470 con 0x7f9b9c105120 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.096+0000 7f9b98ff9700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 0x7f9b840a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.097+0000 7f9b98ff9700 1 -- 172.21.15.139:0/1107022142 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9b900ce920 con 0x7f9b9c105120 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.097+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 0x7f9b840a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.097+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 0x7f9b840a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c006fd0 tx=0x7f9b8c009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.098+0000 7f9bae0d3b80 1 Processor -- start 2023-10-08T13:32:24.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.098+0000 7f9bae0d3b80 1 -- start start 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a34b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a350b0 0x560283a35510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56028399d400 con 0x560283a3b1a0 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56028398ebc0 con 0x560283a3a880 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56028398c4e0 con 0x560283a350b0 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a34b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33004/0 (socket says 172.21.15.139:33004) 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/441637379 learned_addr learned my addr 172.21.15.139:0/441637379 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:24.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a350b0 0x560283a35510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 -- 172.21.15.139:0/441637379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a350b0 msgr2=0x560283a35510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a350b0 0x560283a35510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 -- 172.21.15.139:0/441637379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 msgr2=0x560283a3ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 -- 172.21.15.139:0/441637379 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602837b2d80 con 0x560283a3b1a0 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b9affd700 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a34b70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b900cbd30 tx=0x7f9b90005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d04eb406a0a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b81ffb700 1 -- 172.21.15.139:0/441637379 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9009b650 con 0x560283a3b1a0 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b81ffb700 1 -- 172.21.15.139:0/441637379 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b9009f7a0 con 0x560283a3b1a0 2023-10-08T13:32:24.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.099+0000 7f9b81ffb700 1 -- 172.21.15.139:0/441637379 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9009ab40 con 0x560283a3b1a0 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/441637379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 msgr2=0x560283a34b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a34b70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9b900cbd30 tx=0x7f9b90005a00 comp rx=0 tx=0).stop 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/441637379 shutdown_connections 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a350b0 0x560283a35510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3a880 0x560283a3ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/441637379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a34b70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/441637379 >> 172.21.15.139:0/441637379 conn(0x5602839a9200 msgr2=0x560283a2fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.100+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/441637379 shutdown_connections 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/441637379 wait complete. 2023-10-08T13:32:24.104 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 -- start start 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 Processor -- start 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a3e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283987dd0 con 0x560283a350b0 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602839246b0 con 0x560283a3b1a0 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.101+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283924350 con 0x560283a3a880 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9bae0d3b80 10 client.0 _ll_register_callbacks cb 0x5602837817a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.108 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a3e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42722/0 (socket says 172.21.15.139:42722) 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a3e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42440/0 (socket says 172.21.15.139:42440) 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/43183296 learned_addr learned my addr 172.21.15.139:0/43183296 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 msgr2=0x560283a3e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a3e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/43183296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 msgr2=0x560283a3eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a3eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/43183296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c00e700 con 0x560283a350b0 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a3eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:24.109 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c015700 tx=0x7f9b8c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2232a5db4d83a8ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c015dd0 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9b8c013450 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56028394fe50 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.102+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b8c013610 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 10 client.16851 fetch_fsmap learned FSMap version 38 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f9b9c1a39b0 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56028394fe50 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 38) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9b8c021810 con 0x560283a350b0 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 10 client.16851 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T13:32:24.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 20 client.16851 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283a4e980 0x560283a50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 4 client.16851 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560283980db0 con 0x560283a4e980 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.103+0000 7f9b9affd700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283a4e980 0x560283a50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.104+0000 7f9b7affd700 10 client.16851 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.104+0000 7f9b9affd700 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283a4e980 0x560283a50da0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81a1ec15549f4d95 server_cookie=6963617e519f5cc4 in_seq=0 out_seq=0 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9b7affd700 1 -- 172.21.15.139:0/43183296 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560283980db0 con 0x560283a4e980 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9b7affd700 10 client.16851 handle_command_reply: tid=0 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 client.16851 shutdown 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 msgr2=0x560283a41160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c015700 tx=0x7f9b8c0047e0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 shutdown_connections 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283a4e980 0x560283a50da0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a3eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a41160 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9b7affd700 0 client.16851 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/43183296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a3e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 >> 172.21.15.139:0/43183296 conn(0x5602839a9200 msgr2=0x560283a2f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 shutdown_connections 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/43183296 wait complete. 2023-10-08T13:32:24.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.105+0000 7f9bae0d3b80 20 client.16851 trim_cache size 0 max 16384 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 Processor -- start 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 -- start start 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a45960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a35490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602838088c0 con 0x560283a350b0 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283a45ea0 con 0x560283a3b1a0 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283a39110 con 0x560283a3a880 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.123 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42730/0 (socket says 172.21.15.139:42730) 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/3145321171 learned_addr learned my addr 172.21.15.139:0/3145321171 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9affd700 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a45960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a35490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/3145321171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 msgr2=0x560283a45960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a45960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/3145321171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 msgr2=0x560283a35490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a35490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 -- 172.21.15.139:0/3145321171 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56028379bc00 con 0x560283a350b0 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.121+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009760 tx=0x7f9b8c00e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373d4f8e578572d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9b827fc700 1 -- 172.21.15.139:0/3145321171 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c021640 con 0x560283a350b0 2023-10-08T13:32:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9b827fc700 1 -- 172.21.15.139:0/3145321171 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b8c02e070 con 0x560283a350b0 2023-10-08T13:32:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9b827fc700 1 -- 172.21.15.139:0/3145321171 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c003b40 con 0x560283a350b0 2023-10-08T13:32:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3145321171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 msgr2=0x560283a34b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009760 tx=0x7f9b8c00e5e0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3145321171 shutdown_connections 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a3b1a0 0x560283a35490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a350b0 0x560283a34b70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3145321171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a45960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3145321171 >> 172.21.15.139:0/3145321171 conn(0x5602839a9200 msgr2=0x560283a556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3145321171 shutdown_connections 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.122+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3145321171 wait complete. 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.123+0000 7f9bae0d3b80 1 -- start start 2023-10-08T13:32:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.123+0000 7f9bae0d3b80 1 Processor -- start 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.123+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a350b0 0x560283a438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.123+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a43e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.123+0000 7f9bae0d3b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283aa5c30 con 0x560283a3b1a0 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283aa5da0 con 0x560283a350b0 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9bae0d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560283aa5f60 con 0x560283a3a880 2023-10-08T13:32:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9bae0d3b80 10 client.0 _ll_register_callbacks cb 0x7f9b8c00ecb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9b9bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9b9bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42736/0 (socket says 172.21.15.139:42736) 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.124+0000 7f9b9bfff700 1 -- 172.21.15.139:0/3239813355 learned_addr learned my addr 172.21.15.139:0/3239813355 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9affd700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a43e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 -- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 msgr2=0x560283a43e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a43e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 -- 172.21.15.139:0/3239813355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a350b0 msgr2=0x560283a438e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a350b0 0x560283a438e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 -- 172.21.15.139:0/3239813355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1a39b0 con 0x560283a3b1a0 2023-10-08T13:32:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9affd700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a43e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b9bfff700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400f690 tx=0x7f9b9400f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dedbbf1ede5dc5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.125+0000 7f9b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9401a5f0 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f9b94006e40 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b9009f7a0 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9401a750 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9bae0d3b80 10 client.16857 fetch_fsmap learned FSMap version 38 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5602837d91f0 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.126+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b9009f7a0 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 38) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9b9400e3a0 con 0x560283a3b1a0 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 10 client.16857 fetch_fsmap finished waiting for FSMap version 38 2023-10-08T13:32:24.131 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 20 client.16857 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283aa78a0 0x560283aa9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 4 client.16857 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560283980ad0 con 0x560283aa78a0 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.127+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283aa78a0 0x560283aa9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.128+0000 7f9b9b7fe700 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283aa78a0 0x560283aa9cc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec3ccc8366543ac server_cookie=4d3d3f70ab2c3dd8 in_seq=0 out_seq=0 2023-10-08T13:32:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.129+0000 7f9b7affd700 10 client.16857 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.151+0000 7f9b7affd700 1 -- 172.21.15.139:0/3239813355 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560283980ad0 con 0x560283aa78a0 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.151+0000 7f9b7affd700 10 client.16857 handle_command_reply: tid=0 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.151+0000 7f9bae0d3b80 1 client.16857 shutdown 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 msgr2=0x560283a44360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400f690 tx=0x7f9b9400f770 comp rx=0 tx=0).stop 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 shutdown_connections 2023-10-08T13:32:24.153 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560283a3b1a0 0x560283a44360 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560283aa78a0 0x560283aa9cc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560283a350b0 0x560283a438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 --2- 172.21.15.139:0/3239813355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560283a3a880 0x560283a43e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9b7affd700 0 client.16857 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 >> 172.21.15.139:0/3239813355 conn(0x5602839a9200 msgr2=0x560283a35490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 shutdown_connections 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 1 -- 172.21.15.139:0/3239813355 wait complete. 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9bae0d3b80 20 client.16857 trim_cache size 0 max 16384 2023-10-08T13:32:24.154 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:32:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:32:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:32:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:32:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 msgr2=0x7f9b840a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 0x7f9b840a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c006fd0 tx=0x7f9b8c009190 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 msgr2=0x7f9b9c19cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c010 tx=0x7f9b90004730 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.152+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 shutdown_connections 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f9b840a15f0 0x7f9b840a3ab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b9c105ae0 0x7f9b9c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b9c067fd0 0x7f9b9c19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 --2- 172.21.15.139:0/1107022142 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b9c105120 0x7f9b9c19cf00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 >> 172.21.15.139:0/1107022142 conn(0x7f9b9c076790 msgr2=0x7f9b9c0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 shutdown_connections 2023-10-08T13:32:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:24.153+0000 7f9ba1eea700 1 -- 172.21.15.139:0/1107022142 wait complete. 2023-10-08T13:32:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:25 smithi155 ceph-mon[103467]: pgmap v449: 129 pgs: 129 active+clean; 80 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.8 MiB/s wr, 689 op/s 2023-10-08T13:32:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:25 smithi139 ceph-mon[99506]: pgmap v449: 129 pgs: 129 active+clean; 80 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.8 MiB/s wr, 689 op/s 2023-10-08T13:32:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:25 smithi187 ceph-mon[104336]: pgmap v449: 129 pgs: 129 active+clean; 80 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 1.8 MiB/s wr, 689 op/s 2023-10-08T13:32:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:27 smithi155 ceph-mon[103467]: pgmap v450: 129 pgs: 129 active+clean; 85 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 789 op/s 2023-10-08T13:32:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:27 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:27 smithi139 ceph-mon[99506]: pgmap v450: 129 pgs: 129 active+clean; 85 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 789 op/s 2023-10-08T13:32:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:27 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:27 smithi187 ceph-mon[104336]: pgmap v450: 129 pgs: 129 active+clean; 85 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 789 op/s 2023-10-08T13:32:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:27 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:32:30.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:29 smithi155 ceph-mon[103467]: pgmap v451: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:32:30.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:29 smithi139 ceph-mon[99506]: pgmap v451: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:32:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:29 smithi187 ceph-mon[104336]: pgmap v451: 129 pgs: 129 active+clean; 79 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:32:31.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:31 smithi155 ceph-mon[103467]: pgmap v452: 129 pgs: 129 active+clean; 83 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 657 op/s 2023-10-08T13:32:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:31 smithi139 ceph-mon[99506]: pgmap v452: 129 pgs: 129 active+clean; 83 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 657 op/s 2023-10-08T13:32:31.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:31 smithi187 ceph-mon[104336]: pgmap v452: 129 pgs: 129 active+clean; 83 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 657 op/s 2023-10-08T13:32:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:33 smithi155 ceph-mon[103467]: pgmap v453: 129 pgs: 129 active+clean; 89 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.0 MiB/s wr, 804 op/s 2023-10-08T13:32:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:33 smithi139 ceph-mon[99506]: pgmap v453: 129 pgs: 129 active+clean; 89 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.0 MiB/s wr, 804 op/s 2023-10-08T13:32:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:33 smithi187 ceph-mon[104336]: pgmap v453: 129 pgs: 129 active+clean; 89 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.0 MiB/s wr, 804 op/s 2023-10-08T13:32:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:35 smithi155 ceph-mon[103467]: pgmap v454: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.8 MiB/s wr, 673 op/s 2023-10-08T13:32:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:35 smithi139 ceph-mon[99506]: pgmap v454: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.8 MiB/s wr, 673 op/s 2023-10-08T13:32:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:35 smithi187 ceph-mon[104336]: pgmap v454: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.8 MiB/s wr, 673 op/s 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/1435132839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a780ff8d0 msgr2=0x7f4a780ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/1435132839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a780ff8d0 0x7f4a780ffd50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009990 tx=0x7f4a6c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/1435132839 shutdown_connections 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/1435132839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 0x7f4a7810c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/1435132839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a78105670 0x7f4a78105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/1435132839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a780ff8d0 0x7f4a780ffd50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/1435132839 >> 172.21.15.139:0/1435132839 conn(0x7f4a780764c0 msgr2=0x7f4a780768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/1435132839 shutdown_connections 2023-10-08T13:32:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.284+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/1435132839 wait complete. 2023-10-08T13:32:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 Processor -- start 2023-10-08T13:32:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 -- start start 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 0x7f4a78197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 0x7f4a781a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78198680 con 0x7f4a78105670 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781a2eb0 con 0x7f4a78100290 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a7d2e8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781a2ff0 con 0x7f4a780ff8d0 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 0x7f4a781a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42466/0 (socket says 172.21.15.139:42466) 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a76ffd700 1 -- 172.21.15.139:0/3016827664 learned_addr learned my addr 172.21.15.139:0/3016827664 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.285+0000 7f4a767fc700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 0x7f4a78197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 -- 172.21.15.139:0/3016827664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 msgr2=0x7f4a78197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 0x7f4a78197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 -- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 msgr2=0x7f4a781a2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 0x7f4a781a2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 -- 172.21.15.139:0/3016827664 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c0095f0 con 0x7f4a780ff8d0 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a777fe700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 0x7f4a781a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800e970 tx=0x7f4a6800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a5ffff700 1 -- 172.21.15.139:0/3016827664 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68009790 con 0x7f4a780ff8d0 2023-10-08T13:32:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a78195740 con 0x7f4a780ff8d0 2023-10-08T13:32:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a78195c70 con 0x7f4a780ff8d0 2023-10-08T13:32:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a5ffff700 1 -- 172.21.15.139:0/3016827664 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6800c7e0 con 0x7f4a780ff8d0 2023-10-08T13:32:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.286+0000 7f4a5ffff700 1 -- 172.21.15.139:0/3016827664 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003be0 con 0x7f4a780ff8d0 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.289+0000 7f4a5ffff700 1 -- 172.21.15.139:0/3016827664 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f4a68004220 con 0x7f4a780ff8d0 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a5ffff700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 0x7f4a600a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 Processor -- start 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a5ffff700 1 -- 172.21.15.139:0/3016827664 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4a68014070 con 0x7f4a780ff8d0 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 -- start start 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a767fc700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 0x7f4a600a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113e0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.293 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311348400 con 0x5583113e61a0 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311339bc0 con 0x5583113e5880 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.290+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583113374e0 con 0x5583113e00b0 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33046/0 (socket says 172.21.15.139:33046) 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a76ffd700 1 -- 172.21.15.139:0/2166952108 learned_addr learned my addr 172.21.15.139:0/2166952108 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a767fc700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 0x7f4a600a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b2e0 tx=0x7f4a6c005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 -- 172.21.15.139:0/2166952108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 msgr2=0x5583113e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 -- 172.21.15.139:0/2166952108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 msgr2=0x5583113dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.291+0000 7f4a777fe700 1 -- 172.21.15.139:0/2166952108 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55831115dd80 con 0x5583113e00b0 2023-10-08T13:32:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.292+0000 7f4a777fe700 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113e0510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a70003d00 tx=0x7f4a70009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b71f1bd7da4998d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.292+0000 7f4a5d7fa700 1 -- 172.21.15.139:0/2166952108 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70004bb0 con 0x5583113e00b0 2023-10-08T13:32:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.292+0000 7f4a5d7fa700 1 -- 172.21.15.139:0/2166952108 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a7000f040 con 0x5583113e00b0 2023-10-08T13:32:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.292+0000 7f4a5d7fa700 1 -- 172.21.15.139:0/2166952108 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000ecb0 con 0x5583113e00b0 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2166952108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 msgr2=0x5583113e0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113e0510 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a70003d00 tx=0x7f4a70009920 comp rx=0 tx=0).stop 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2166952108 shutdown_connections 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113e0510 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2166952108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2166952108 >> 172.21.15.139:0/2166952108 conn(0x558311354200 msgr2=0x5583113dab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2166952108 shutdown_connections 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.293+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2166952108 wait complete. 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 -- start start 2023-10-08T13:32:37.297 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 Processor -- start 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113ec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311332dd0 con 0x5583113e61a0 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583112cf6b0 con 0x5583113e5880 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583112cf350 con 0x5583113e00b0 2023-10-08T13:32:37.298 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.294+0000 7f4a894d1b80 10 client.0 _ll_register_callbacks cb 0x55831112c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.296+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.296+0000 7f4a777fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42766/0 (socket says 172.21.15.139:42766) 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.296+0000 7f4a777fe700 1 -- 172.21.15.139:0/4267121175 learned_addr learned my addr 172.21.15.139:0/4267121175 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a777fe700 1 -- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 msgr2=0x5583113ec150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.299 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a777fe700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113ec150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a777fe700 1 -- 172.21.15.139:0/4267121175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 msgr2=0x5583113e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a777fe700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.297+0000 7f4a777fe700 1 -- 172.21.15.139:0/4267121175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a70003a00 con 0x5583113e61a0 2023-10-08T13:32:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.298+0000 7f4a777fe700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009f50 tx=0x7f4a7000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865c31a3840f5920 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.300 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.299+0000 7f4a5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.299+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700090d0 con 0x5583113e61a0 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.299+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4a7000eba0 con 0x5583113e61a0 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.299+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583112fae50 con 0x5583113e61a0 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.299+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a700093b0 con 0x5583113e61a0 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.300+0000 7f4a894d1b80 10 client.16866 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:37.301 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.301+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558311146c00 con 0x5583113e61a0 2023-10-08T13:32:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.301+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5583112fae50 con 0x5583113e61a0 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4a70025020 con 0x5583113e61a0 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 10 client.16866 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 10 client.16866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 20 client.16866 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583114133a0 0x5583114157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 4 client.16866 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55831132bdb0 con 0x5583114133a0 2023-10-08T13:32:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.303+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583114133a0 0x5583114157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.304+0000 7f4a5aff5700 10 client.16866 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.304+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583114133a0 0x5583114157c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae626a43c4d60213 server_cookie=64c1fb7fe3c6a0f3 in_seq=0 out_seq=0 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4267121175 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55831132bdb0 con 0x5583114133a0 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a5aff5700 10 client.16866 handle_command_reply: tid=0 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 client.16866 shutdown 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 msgr2=0x5583113e9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009f50 tx=0x7f4a7000e7c0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 shutdown_connections 2023-10-08T13:32:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e61a0 0x5583113e9b10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113ec150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5583114133a0 0x5583114157c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4267121175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x5583113e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a5aff5700 0 client.16866 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 >> 172.21.15.139:0/4267121175 conn(0x558311354200 msgr2=0x5583113da010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 shutdown_connections 2023-10-08T13:32:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.305+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4267121175 wait complete. 2023-10-08T13:32:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.306+0000 7f4a894d1b80 20 client.16866 trim_cache size 0 max 16384 2023-10-08T13:32:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 Processor -- start 2023-10-08T13:32:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 -- start start 2023-10-08T13:32:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e61a0 0x55831140a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583111b38c0 con 0x5583113e5880 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583113d52b0 con 0x5583113e61a0 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.327+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583113ea0f0 con 0x5583113e00b0 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42774/0 (socket says 172.21.15.139:42774) 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 -- 172.21.15.139:0/2558594930 learned_addr learned my addr 172.21.15.139:0/2558594930 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a777fe700 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e61a0 0x55831140a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 -- 172.21.15.139:0/2558594930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 msgr2=0x5583113dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113dfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 -- 172.21.15.139:0/2558594930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e61a0 msgr2=0x55831140a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e61a0 0x55831140a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 -- 172.21.15.139:0/2558594930 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583111841f0 con 0x5583113e5880 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a767fc700 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009990 tx=0x7f4a6c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b2a377074b8664 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a5dffb700 1 -- 172.21.15.139:0/2558594930 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c005610 con 0x5583113e5880 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a5dffb700 1 -- 172.21.15.139:0/2558594930 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a6c0049c0 con 0x5583113e5880 2023-10-08T13:32:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.328+0000 7f4a5dffb700 1 -- 172.21.15.139:0/2558594930 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c00f8c0 con 0x5583113e5880 2023-10-08T13:32:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2558594930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 msgr2=0x558311415790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009990 tx=0x7f4a6c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2558594930 shutdown_connections 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e61a0 0x55831140a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e00b0 0x5583113dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/2558594930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e5880 0x558311415790 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2558594930 >> 172.21.15.139:0/2558594930 conn(0x558311354200 msgr2=0x5583113e7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2558594930 shutdown_connections 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- 172.21.15.139:0/2558594930 wait complete. 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.329+0000 7f4a894d1b80 1 -- start start 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 Processor -- start 2023-10-08T13:32:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x558311406bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 0x5583114661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311407380 con 0x5583113e00b0 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558311466710 con 0x5583113e5880 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583114668d0 con 0x5583113e61a0 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 10 client.0 _ll_register_callbacks cb 0x7f4a68095f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42778/0 (socket says 172.21.15.139:42778) 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 -- 172.21.15.139:0/4161861635 learned_addr learned my addr 172.21.15.139:0/4161861635 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a767fc700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x558311406bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a777fe700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 0x5583114661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 -- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 msgr2=0x5583114661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 0x5583114661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 -- 172.21.15.139:0/4161861635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 msgr2=0x558311406bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x558311406bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 -- 172.21.15.139:0/4161861635 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7810cda0 con 0x5583113e00b0 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a777fe700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 0x5583114661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a76ffd700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4a68099fe0 tx=0x7f4a68099e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1298dfd81abc912a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:37.337 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a5aff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680b0040 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f4a680a2670 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.330+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a7000f040 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a68098680 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 10 client.16872 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55831115c250 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a7000f040 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4a680cd280 con 0x5583113e00b0 2023-10-08T13:32:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 10 client.16872 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 20 client.16872 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558311468120 0x55831146a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 4 client.16872 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55831132bad0 con 0x558311468120 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a767fc700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558311468120 0x55831146a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a5aff5700 10 client.16872 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.331+0000 7f4a767fc700 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558311468120 0x55831146a540 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d8be9dc031e83bc server_cookie=76dbd653da3ab272 in_seq=0 out_seq=0 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a5aff5700 1 -- 172.21.15.139:0/4161861635 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55831132bad0 con 0x558311468120 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a5aff5700 10 client.16872 handle_command_reply: tid=0 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 client.16872 shutdown 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 msgr2=0x5583114066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4a68099fe0 tx=0x7f4a68099e20 comp rx=0 tx=0).stop 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 shutdown_connections 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5583113e61a0 0x5583114661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583113e00b0 0x5583114066b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.363 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558311468120 0x55831146a540 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 --2- 172.21.15.139:0/4161861635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5583113e5880 0x558311406bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 >> 172.21.15.139:0/4161861635 conn(0x558311354200 msgr2=0x55831140ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a5aff5700 0 client.16872 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 shutdown_connections 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 1 -- 172.21.15.139:0/4161861635 wait complete. 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.361+0000 7f4a894d1b80 20 client.16872 trim_cache size 0 max 16384 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:32:37.364 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:32:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:32:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 msgr2=0x7f4a600a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.365 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 0x7f4a600a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00b2e0 tx=0x7f4a6c005960 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 msgr2=0x7f4a781978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800e970 tx=0x7f4a6800ec80 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 shutdown_connections 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f4a600a15f0 0x7f4a600a3ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78105670 0x7f4a781a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a780ff8d0 0x7f4a781978f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 --2- 172.21.15.139:0/3016827664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a78100290 0x7f4a78197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.362+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 >> 172.21.15.139:0/3016827664 conn(0x7f4a780764c0 msgr2=0x7f4a780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.363+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 shutdown_connections 2023-10-08T13:32:37.366 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:37.363+0000 7f4a7d2e8700 1 -- 172.21.15.139:0/3016827664 wait complete. 2023-10-08T13:32:38.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:37 smithi155 ceph-mon[103467]: pgmap v455: 129 pgs: 129 active+clean; 93 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 781 op/s 2023-10-08T13:32:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:37 smithi139 ceph-mon[99506]: pgmap v455: 129 pgs: 129 active+clean; 93 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 781 op/s 2023-10-08T13:32:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:37 smithi187 ceph-mon[104336]: pgmap v455: 129 pgs: 129 active+clean; 93 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 781 op/s 2023-10-08T13:32:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:39 smithi155 ceph-mon[103467]: pgmap v456: 129 pgs: 129 active+clean; 94 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 691 op/s 2023-10-08T13:32:40.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:32:40.180 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:39 smithi139 ceph-mon[99506]: pgmap v456: 129 pgs: 129 active+clean; 94 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 691 op/s 2023-10-08T13:32:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:39 smithi187 ceph-mon[104336]: pgmap v456: 129 pgs: 129 active+clean; 94 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.8 MiB/s wr, 691 op/s 2023-10-08T13:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 -- 172.21.15.139:0/2930792513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7378100b80 msgr2=0x7f737810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2930792513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7378100b80 0x7f737810c510 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f737000b0a0 tx=0x7f737000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 -- 172.21.15.139:0/2930792513 shutdown_connections 2023-10-08T13:32:40.313 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2930792513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7378100b80 0x7f737810c510 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2930792513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73781046a0 0x7f7378104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2930792513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f7378100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.310+0000 7f737f0eb700 1 -- 172.21.15.139:0/2930792513 >> 172.21.15.139:0/2930792513 conn(0x7f7378074940 msgr2=0x7f7378074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- 172.21.15.139:0/2930792513 shutdown_connections 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- 172.21.15.139:0/2930792513 wait complete. 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 Processor -- start 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- start start 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7378100b80 0x7f737819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 0x7f7378195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.314 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73781960b0 con 0x7f73781001c0 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7378196220 con 0x7f73781046a0 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.311+0000 7f737f0eb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73781963e0 con 0x7f7378100b80 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737ce87700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737ce87700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42792/0 (socket says 172.21.15.139:42792) 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737ce87700 1 -- 172.21.15.139:0/2687804877 learned_addr learned my addr 172.21.15.139:0/2687804877 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 0x7f7378195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f7377fff700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7378100b80 0x7f737819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 -- 172.21.15.139:0/2687804877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7378100b80 msgr2=0x7f737819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7378100b80 0x7f737819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 -- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 msgr2=0x7f737819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.315 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 -- 172.21.15.139:0/2687804877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7364009520 con 0x7f73781046a0 2023-10-08T13:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737ce87700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:32:40.316 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.312+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 0x7f7378195a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f737000b070 tx=0x7f7370007860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.313+0000 7f7375ffb700 1 -- 172.21.15.139:0/2687804877 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737000e040 con 0x7f73781046a0 2023-10-08T13:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.314+0000 7f7375ffb700 1 -- 172.21.15.139:0/2687804877 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f737001d470 con 0x7f73781046a0 2023-10-08T13:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.314+0000 7f7375ffb700 1 -- 172.21.15.139:0/2687804877 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370005280 con 0x7f73781046a0 2023-10-08T13:32:40.317 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.315+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7370009d00 con 0x7f73781046a0 2023-10-08T13:32:40.318 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.315+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73781a26e0 con 0x7f73781046a0 2023-10-08T13:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.320+0000 7f738b2d4b80 1 Processor -- start 2023-10-08T13:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.320+0000 7f7375ffb700 1 -- 172.21.15.139:0/2687804877 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f737001d5e0 con 0x7f73781046a0 2023-10-08T13:32:40.321 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 -- start start 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca51a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9b7460 con 0x55599ca61c80 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a8c20 con 0x55599ca4fa00 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a6540 con 0x55599ca515f0 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f7377fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f7377fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42802/0 (socket says 172.21.15.139:42802) 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f7377fff700 1 -- 172.21.15.139:0/4031468508 learned_addr learned my addr 172.21.15.139:0/4031468508 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f737ce87700 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca51a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.323 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.321+0000 7f7375ffb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 0x7f73680a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 -- 172.21.15.139:0/4031468508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 msgr2=0x55599ca51a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca51a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 -- 172.21.15.139:0/4031468508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 msgr2=0x55599ca510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7375ffb700 1 -- 172.21.15.139:0/2687804877 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f73700cdfe0 con 0x7f73781046a0 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 -- 172.21.15.139:0/4031468508 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599c7ccde0 con 0x55599ca61c80 2023-10-08T13:32:40.324 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7377fff700 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7364009f20 tx=0x7f7364012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6219e3739b19f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7362ffd700 1 -- 172.21.15.139:0/4031468508 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364009a70 con 0x55599ca61c80 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7362ffd700 1 -- 172.21.15.139:0/4031468508 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736400fb10 con 0x55599ca61c80 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f7362ffd700 1 -- 172.21.15.139:0/4031468508 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736401bca0 con 0x55599ca61c80 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.322+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 0x7f73680a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 -- 172.21.15.139:0/4031468508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 msgr2=0x55599ca64070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f737d688700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 0x7f73680a3c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7370097740 tx=0x7f73700a1040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7364009f20 tx=0x7f7364012730 comp rx=0 tx=0).stop 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 -- 172.21.15.139:0/4031468508 shutdown_connections 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca64070 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.327 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/4031468508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca51a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 -- 172.21.15.139:0/4031468508 >> 172.21.15.139:0/4031468508 conn(0x55599c9c3260 msgr2=0x55599ca4a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 -- 172.21.15.139:0/4031468508 shutdown_connections 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.323+0000 7f738b2d4b80 1 -- 172.21.15.139:0/4031468508 wait complete. 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 -- start start 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 Processor -- start 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca5f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca5f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a1e30 con 0x55599ca61c80 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c93e710 con 0x55599ca4fa00 2023-10-08T13:32:40.328 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c93e3b0 con 0x55599ca515f0 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.324+0000 7f738b2d4b80 10 client.0 _ll_register_callbacks cb 0x55599c79b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f737ce87700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca5f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33094/0 (socket says 172.21.15.139:33094) 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 -- 172.21.15.139:0/2852100482 learned_addr learned my addr 172.21.15.139:0/2852100482 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca5f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 -- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 msgr2=0x55599ca5f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca5f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 -- 172.21.15.139:0/2852100482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 msgr2=0x55599ca5f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca5f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 -- 172.21.15.139:0/2852100482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7364009bd0 con 0x55599ca4fa00 2023-10-08T13:32:40.329 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7377fff700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f736401b4b0 tx=0x7f736401b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fde5e9d00b35af7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7357fff700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.325+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736401bc40 con 0x55599ca4fa00 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f7364000e40 con 0x55599ca4fa00 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55599c969eb0 con 0x55599ca4fa00 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f736401bda0 con 0x55599ca4fa00 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f738b2d4b80 10 client.26312 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:40.330 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55599c7b5c60 con 0x55599ca4fa00 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.326+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55599c969eb0 con 0x55599ca4fa00 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7364003680 con 0x55599ca4fa00 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 10 client.26312 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 10 client.26312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 20 client.26312 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599ca71900 0x55599ca73d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.332 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 4 client.26312 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55599c99ae10 con 0x55599ca71900 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.327+0000 7f737ce87700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599ca71900 0x55599ca73d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f7357fff700 10 client.26312 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f737ce87700 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599ca71900 0x55599ca73d20 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee7f283302577e84 server_cookie=75ffbcddf993f374 in_seq=0 out_seq=0 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f7357fff700 1 -- 172.21.15.139:0/2852100482 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55599c99ae10 con 0x55599ca71900 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f7357fff700 10 client.26312 handle_command_reply: tid=0 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 client.26312 shutdown 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 msgr2=0x55599ca5ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f736401b4b0 tx=0x7f736401b840 comp rx=0 tx=0).stop 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 shutdown_connections 2023-10-08T13:32:40.333 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca5f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.328+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599ca71900 0x55599ca73d20 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5ebb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/2852100482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca5f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f7357fff700 0 client.26312 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 >> 172.21.15.139:0/2852100482 conn(0x55599c9c3260 msgr2=0x55599ca49ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 shutdown_connections 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 1 -- 172.21.15.139:0/2852100482 wait complete. 2023-10-08T13:32:40.334 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.329+0000 7f738b2d4b80 20 client.26312 trim_cache size 0 max 16384 2023-10-08T13:32:40.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 Processor -- start 2023-10-08T13:32:40.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 -- start start 2023-10-08T13:32:40.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.348 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c822920 con 0x55599ca61c80 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599ca61ac0 con 0x55599ca4fa00 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599ca41be0 con 0x55599ca515f0 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f7377fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f7377fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42818/0 (socket says 172.21.15.139:42818) 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.345+0000 7f7377fff700 1 -- 172.21.15.139:0/216010301 learned_addr learned my addr 172.21.15.139:0/216010301 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f737ce87700 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 -- 172.21.15.139:0/216010301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 msgr2=0x55599ca4fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca4fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 -- 172.21.15.139:0/216010301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 msgr2=0x55599ca5f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.349 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 -- 172.21.15.139:0/216010301 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599ca462a0 con 0x55599ca61c80 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f7377fff700 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f73640059d0 tx=0x7f7364015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab7f0a279506c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f73637fe700 1 -- 172.21.15.139:0/216010301 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364003880 con 0x55599ca61c80 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f73637fe700 1 -- 172.21.15.139:0/216010301 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7364020070 con 0x55599ca61c80 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.346+0000 7f73637fe700 1 -- 172.21.15.139:0/216010301 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400f850 con 0x55599ca61c80 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- 172.21.15.139:0/216010301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 msgr2=0x55599ca50320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f73640059d0 tx=0x7f7364015040 comp rx=0 tx=0).stop 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- 172.21.15.139:0/216010301 shutdown_connections 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca61c80 0x55599ca50320 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/216010301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca515f0 0x55599ca4fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.350 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- 172.21.15.139:0/216010301 >> 172.21.15.139:0/216010301 conn(0x55599c9c3260 msgr2=0x55599ca63830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- 172.21.15.139:0/216010301 shutdown_connections 2023-10-08T13:32:40.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- 172.21.15.139:0/216010301 wait complete. 2023-10-08T13:32:40.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 -- start start 2023-10-08T13:32:40.351 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.347+0000 7f738b2d4b80 1 Processor -- start 2023-10-08T13:32:40.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca61c80 0x55599ca5ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599ca5b510 con 0x55599ca515f0 2023-10-08T13:32:40.354 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599ca5b680 con 0x55599ca4fa00 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599ca5b840 con 0x55599ca61c80 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 10 client.0 _ll_register_callbacks cb 0x7f736400fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42822/0 (socket says 172.21.15.139:42822) 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 -- 172.21.15.139:0/1183089926 learned_addr learned my addr 172.21.15.139:0/1183089926 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7377fff700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca61c80 0x55599ca5ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7377fff700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 -- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca61c80 msgr2=0x55599ca5ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca61c80 0x55599ca5ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 -- 172.21.15.139:0/1183089926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 msgr2=0x55599ca5c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.355 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 -- 172.21.15.139:0/1183089926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55599c7b5c60 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7377fff700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f737ce87700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55599ca4ba10 tx=0x7f736c004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3335199afc75c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7357fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c017070 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f736400fb10 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f736c021a00 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f736c0122d0 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 10 client.16890 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.348+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55599c7f3250 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f736400fb10 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f736c003840 con 0x55599ca515f0 2023-10-08T13:32:40.356 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 10 client.16890 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 20 client.16890 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599cac6960 0x55599cac8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 4 client.16890 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55599c99ab30 con 0x55599cac6960 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7377fff700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599cac6960 0x55599cac8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7357fff700 10 client.16890 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7377fff700 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599cac6960 0x55599cac8d80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc76932a67cb42 server_cookie=265290ec540752d3 in_seq=0 out_seq=0 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7357fff700 1 -- 172.21.15.139:0/1183089926 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55599c99ab30 con 0x55599cac6960 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f7357fff700 10 client.16890 handle_command_reply: tid=0 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.349+0000 7f738b2d4b80 1 client.16890 shutdown 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 msgr2=0x55599ca5c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.357 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55599ca4ba10 tx=0x7f736c004460 comp rx=0 tx=0).stop 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 shutdown_connections 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55599ca61c80 0x55599ca5ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55599cac6960 0x55599cac8d80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55599ca4fa00 0x55599ca5c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 --2- 172.21.15.139:0/1183089926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55599ca515f0 0x55599ca5c850 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f7357fff700 0 client.16890 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 >> 172.21.15.139:0/1183089926 conn(0x55599c9c3260 msgr2=0x55599ca63830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 shutdown_connections 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 1 -- 172.21.15.139:0/1183089926 wait complete. 2023-10-08T13:32:40.358 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f738b2d4b80 20 client.16890 trim_cache size 0 max 16384 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:32:40.359 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:32:40.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 msgr2=0x7f73680a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.360 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 0x7f73680a3c00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7370097740 tx=0x7f73700a1040 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 msgr2=0x7f7378195a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 0x7f7378195a50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f737000b070 tx=0x7f7370007860 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 shutdown_connections 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f73680a1740 0x7f73680a3c00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73781046a0 0x7f7378195a50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73781001c0 0x7f737819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 --2- 172.21.15.139:0/2687804877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7378100b80 0x7f737819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 >> 172.21.15.139:0/2687804877 conn(0x7f7378074940 msgr2=0x7f73780fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 shutdown_connections 2023-10-08T13:32:40.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:32:40.350+0000 7f737f0eb700 1 -- 172.21.15.139:0/2687804877 wait complete. 2023-10-08T13:32:40.363 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:32:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:41 smithi155 ceph-mon[103467]: pgmap v457: 129 pgs: 129 active+clean; 95 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.8 MiB/s wr, 666 op/s 2023-10-08T13:32:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:41 smithi139 ceph-mon[99506]: pgmap v457: 129 pgs: 129 active+clean; 95 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.8 MiB/s wr, 666 op/s 2023-10-08T13:32:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:41 smithi187 ceph-mon[104336]: pgmap v457: 129 pgs: 129 active+clean; 95 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.8 MiB/s wr, 666 op/s 2023-10-08T13:32:43.338 INFO:tasks.workunit.client.0.smithi139.stdout:copying to largest ever: 0x63fd4d5 2023-10-08T13:32:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:43 smithi155 ceph-mon[103467]: pgmap v458: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 805 op/s 2023-10-08T13:32:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:43 smithi139 ceph-mon[99506]: pgmap v458: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 805 op/s 2023-10-08T13:32:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:43 smithi187 ceph-mon[104336]: pgmap v458: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 805 op/s 2023-10-08T13:32:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:45 smithi155 ceph-mon[103467]: pgmap v459: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 665 op/s 2023-10-08T13:32:46.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:45 smithi139 ceph-mon[99506]: pgmap v459: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 665 op/s 2023-10-08T13:32:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:45 smithi187 ceph-mon[104336]: pgmap v459: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 665 op/s 2023-10-08T13:32:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:47 smithi155 ceph-mon[103467]: pgmap v460: 129 pgs: 129 active+clean; 91 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 772 op/s 2023-10-08T13:32:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:47 smithi139 ceph-mon[99506]: pgmap v460: 129 pgs: 129 active+clean; 91 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 772 op/s 2023-10-08T13:32:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:47 smithi187 ceph-mon[104336]: pgmap v460: 129 pgs: 129 active+clean; 91 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.9 MiB/s wr, 772 op/s 2023-10-08T13:32:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:49 smithi155 ceph-mon[103467]: pgmap v461: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.7 MiB/s wr, 665 op/s 2023-10-08T13:32:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:49 smithi139 ceph-mon[99506]: pgmap v461: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.7 MiB/s wr, 665 op/s 2023-10-08T13:32:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:49 smithi187 ceph-mon[104336]: pgmap v461: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 1.7 MiB/s wr, 665 op/s 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- 172.21.15.139:0/1220828458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000ff970 msgr2=0x7fc5001039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 --2- 172.21.15.139:0/1220828458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000ff970 0x7fc5001039b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00098f0 tx=0x7fc4f0009c00 comp rx=0 tx=0).stop 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- 172.21.15.139:0/1220828458 shutdown_connections 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 --2- 172.21.15.139:0/1220828458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001040e0 0x7fc50010bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 --2- 172.21.15.139:0/1220828458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5000fefc0 0x7fc5000ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.510 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 --2- 172.21.15.139:0/1220828458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000ff970 0x7fc5001039b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- 172.21.15.139:0/1220828458 >> 172.21.15.139:0/1220828458 conn(0x7fc500075bf0 msgr2=0x7fc5000fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- 172.21.15.139:0/1220828458 shutdown_connections 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- 172.21.15.139:0/1220828458 wait complete. 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 Processor -- start 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.507+0000 7fc507d20700 1 -- start start 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 0x7fc50019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 0x7fc50019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001949b0 0x7fc500194e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500195430 con 0x7fc5000fefc0 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001955a0 con 0x7fc5001040e0 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500195760 con 0x7fc5001949b0 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 0x7fc50019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 0x7fc50019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 0x7fc50019adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33124/0 (socket says 172.21.15.139:33124) 2023-10-08T13:32:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc5052bb700 1 -- 172.21.15.139:0/182835962 learned_addr learned my addr 172.21.15.139:0/182835962 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc5062bd700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001949b0 0x7fc500194e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 -- 172.21.15.139:0/182835962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001949b0 msgr2=0x7fc500194e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001949b0 0x7fc500194e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 -- 172.21.15.139:0/182835962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 msgr2=0x7fc50019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 0x7fc50019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 -- 172.21.15.139:0/182835962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f0009520 con 0x7fc5000fefc0 2023-10-08T13:32:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc505abc700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 0x7fc50019a880 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00b450 tx=0x7fc4fc00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc4f6ffd700 1 -- 172.21.15.139:0/182835962 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc011830 con 0x7fc5000fefc0 2023-10-08T13:32:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5001a1750 con 0x7fc5000fefc0 2023-10-08T13:32:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc4f6ffd700 1 -- 172.21.15.139:0/182835962 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4fc00be60 con 0x7fc5000fefc0 2023-10-08T13:32:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.508+0000 7fc4f6ffd700 1 -- 172.21.15.139:0/182835962 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc010d20 con 0x7fc5000fefc0 2023-10-08T13:32:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.509+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5001a1c30 con 0x7fc5000fefc0 2023-10-08T13:32:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.511+0000 7fc4f6ffd700 1 -- 172.21.15.139:0/182835962 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc4fc01a400 con 0x7fc5000fefc0 2023-10-08T13:32:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.512+0000 7fc4f6ffd700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 0x7fc4ec0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.512+0000 7fc4f6ffd700 1 -- 172.21.15.139:0/182835962 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc4fc0cccb0 con 0x7fc5000fefc0 2023-10-08T13:32:50.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 Processor -- start 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc5052bb700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 0x7fc4ec0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 -- start start 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5d880 0x56147da5dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da58510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d9c0400 con 0x56147da5e1a0 2023-10-08T13:32:50.517 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.513+0000 7fc513f09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d9b1bc0 con 0x56147da580b0 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc513f09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d9af4e0 con 0x56147da5d880 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42846/0 (socket says 172.21.15.139:42846) 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 -- 172.21.15.139:0/373288840 learned_addr learned my addr 172.21.15.139:0/373288840 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 0x7fc4ec0a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc500195b70 tx=0x7fc4f0019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc505abc700 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5d880 0x56147da5dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 -- 172.21.15.139:0/373288840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5d880 msgr2=0x56147da5dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5d880 0x56147da5dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 -- 172.21.15.139:0/373288840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 msgr2=0x56147da58510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da58510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.514+0000 7fc5052bb700 1 -- 172.21.15.139:0/373288840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56147d7d5d80 con 0x56147da5e1a0 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.515+0000 7fc5052bb700 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0000c00 tx=0x7fc4f001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6485e51912f1b395 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.515+0000 7fc4ebfff700 1 -- 172.21.15.139:0/373288840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f002a070 con 0x56147da5e1a0 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.515+0000 7fc4ebfff700 1 -- 172.21.15.139:0/373288840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f001d040 con 0x56147da5e1a0 2023-10-08T13:32:50.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.515+0000 7fc4ebfff700 1 -- 172.21.15.139:0/373288840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00053a0 con 0x56147da5e1a0 2023-10-08T13:32:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.516+0000 7fc513f09b80 1 -- 172.21.15.139:0/373288840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 msgr2=0x56147da57b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.516+0000 7fc513f09b80 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0000c00 tx=0x7fc4f001e000 comp rx=0 tx=0).stop 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 -- 172.21.15.139:0/373288840 shutdown_connections 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da58510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5d880 0x56147da5dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 --2- 172.21.15.139:0/373288840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da57b70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 -- 172.21.15.139:0/373288840 >> 172.21.15.139:0/373288840 conn(0x56147d9cc200 msgr2=0x56147da52b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 -- 172.21.15.139:0/373288840 shutdown_connections 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.517+0000 7fc513f09b80 1 -- 172.21.15.139:0/373288840 wait complete. 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 -- start start 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 Processor -- start 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da63f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da61510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da61a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.523 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d9aadd0 con 0x56147da5d880 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d9476b0 con 0x56147da580b0 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d947350 con 0x56147da5e1a0 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.518+0000 7fc513f09b80 10 client.0 _ll_register_callbacks cb 0x56147d7a47a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.519+0000 7fc5062bd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da61a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.519+0000 7fc5062bd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da61a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42568/0 (socket says 172.21.15.139:42568) 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.519+0000 7fc5062bd700 1 -- 172.21.15.139:0/3000337496 learned_addr learned my addr 172.21.15.139:0/3000337496 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:50.524 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.519+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da61510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.519+0000 7fc505abc700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da63f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 -- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 msgr2=0x56147da61a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da61a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 -- 172.21.15.139:0/3000337496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 msgr2=0x56147da63f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da63f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 -- 172.21.15.139:0/3000337496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc500067230 con 0x56147da5d880 2023-10-08T13:32:50.525 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da61510 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ffd0 tx=0x7fc4f000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845c14ade13515f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.526 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.520+0000 7fc4e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f002a050 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc4f00054e0 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56147d972e50 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f00056a0 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc513f09b80 10 client.16902 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.521+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56147d7bec00 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56147d972e50 con 0x56147da5d880 2023-10-08T13:32:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4f00375b0 con 0x56147da5d880 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 10 client.16902 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 10 client.16902 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 20 client.16902 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147da6b7b0 0x56147da6dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 4 client.16902 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.522+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56147d9a3db0 con 0x56147da6b7b0 2023-10-08T13:32:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.523+0000 7fc505abc700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147da6b7b0 0x56147da6dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.524+0000 7fc4e97fa700 10 client.16902 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.524+0000 7fc505abc700 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147da6b7b0 0x56147da6dba0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3469d5854edbc227 server_cookie=bbbff619807045f in_seq=0 out_seq=0 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3000337496 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56147d9a3db0 con 0x56147da6b7b0 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc4e97fa700 10 client.16902 handle_command_reply: tid=0 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 client.16902 shutdown 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 msgr2=0x56147da61510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da61510 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ffd0 tx=0x7fc4f000be90 comp rx=0 tx=0).stop 2023-10-08T13:32:50.530 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 shutdown_connections 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da61a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147da6b7b0 0x56147da6dba0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da63f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3000337496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da61510 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc4e97fa700 0 client.16902 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 >> 172.21.15.139:0/3000337496 conn(0x56147d9cc200 msgr2=0x56147da52010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.525+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 shutdown_connections 2023-10-08T13:32:50.531 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.526+0000 7fc513f09b80 1 -- 172.21.15.139:0/3000337496 wait complete. 2023-10-08T13:32:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.526+0000 7fc513f09b80 20 client.16902 trim_cache size 0 max 16384 2023-10-08T13:32:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 Processor -- start 2023-10-08T13:32:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 -- start start 2023-10-08T13:32:50.552 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 0x56147da57b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da5d880 0x56147da72410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da63d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147d82b8c0 con 0x56147da5e1a0 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147da62ac0 con 0x56147da5d880 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc513f09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147da647e0 con 0x56147da580b0 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc505abc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 0x56147da57b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc5062bd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da63d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc505abc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 0x56147da57b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42572/0 (socket says 172.21.15.139:42572) 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.545+0000 7fc505abc700 1 -- 172.21.15.139:0/3919774599 learned_addr learned my addr 172.21.15.139:0/3919774599 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da5d880 0x56147da72410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.553 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 -- 172.21.15.139:0/3919774599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 msgr2=0x56147da57b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 0x56147da57b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 -- 172.21.15.139:0/3919774599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da5d880 msgr2=0x56147da72410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da5d880 0x56147da72410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 -- 172.21.15.139:0/3919774599 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56147d7fc1f0 con 0x56147da5e1a0 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc5062bd700 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da63d00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437fe21073a7161b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc4f4ff9700 1 -- 172.21.15.139:0/3919774599 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8017070 con 0x56147da5e1a0 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc4f4ff9700 1 -- 172.21.15.139:0/3919774599 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f80092e0 con 0x56147da5e1a0 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.546+0000 7fc4f4ff9700 1 -- 172.21.15.139:0/3919774599 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80074a0 con 0x56147da5e1a0 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 -- 172.21.15.139:0/3919774599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 msgr2=0x56147da63d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.554 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da63d00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009fd0 tx=0x7fc4f80099e0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 -- 172.21.15.139:0/3919774599 shutdown_connections 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5e1a0 0x56147da63d00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da580b0 0x56147da57b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3919774599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da5d880 0x56147da72410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 -- 172.21.15.139:0/3919774599 >> 172.21.15.139:0/3919774599 conn(0x56147d9cc200 msgr2=0x56147da58490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.555 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 -- 172.21.15.139:0/3919774599 shutdown_connections 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.547+0000 7fc513f09b80 1 -- 172.21.15.139:0/3919774599 wait complete. 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 -- start start 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 Processor -- start 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da51900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da52380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.556 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147dad58b0 con 0x56147da5d880 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147dad59f0 con 0x56147da580b0 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56147dad5b80 con 0x56147da5e1a0 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc513f09b80 10 client.0 _ll_register_callbacks cb 0x7fc4fc095d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc5052bb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42862/0 (socket says 172.21.15.139:42862) 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc5052bb700 1 -- 172.21.15.139:0/3264314554 learned_addr learned my addr 172.21.15.139:0/3264314554 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc505abc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da51900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.557 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.548+0000 7fc5062bd700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da52380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 -- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 msgr2=0x56147da52380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da52380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 -- 172.21.15.139:0/3264314554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 msgr2=0x56147da51900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da51900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 -- 172.21.15.139:0/3264314554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f8012430 con 0x56147da5d880 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc5052bb700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0037a10 tx=0x7fc4f000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b01f5b0ef4e9d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:32:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f002a040 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fc4f0037620 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4f001d040 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f0040070 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 10 client.16908 fetch_fsmap learned FSMap version 39 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56147d7d4250 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f001d040 con 0x56147da5d880 2023-10-08T13:32:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4f0003cf0 con 0x56147da5d880 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 10 client.16908 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 10 client.16908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 20 client.16908 populate_metadata read hostname 'smithi139' 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147dad6ed0 0x56147dad92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.549+0000 7fc513f09b80 4 client.16908 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.550+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56147d9a3ad0 con 0x56147dad6ed0 2023-10-08T13:32:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.550+0000 7fc505abc700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147dad6ed0 0x56147dad92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:32:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.550+0000 7fc4e97fa700 10 client.16908 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.550+0000 7fc505abc700 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147dad6ed0 0x56147dad92c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c7683f4e0018f0 server_cookie=19dd283a2583ec98 in_seq=0 out_seq=0 2023-10-08T13:32:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.570+0000 7fc4e97fa700 1 -- 172.21.15.139:0/3264314554 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56147d9a3ad0 con 0x56147dad6ed0 2023-10-08T13:32:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.570+0000 7fc4e97fa700 10 client.16908 handle_command_reply: tid=0 2023-10-08T13:32:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.570+0000 7fc513f09b80 1 client.16908 shutdown 2023-10-08T13:32:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.570+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 msgr2=0x56147da51e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.573 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.570+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0037a10 tx=0x7fc4f000bc20 comp rx=0 tx=0).stop 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 shutdown_connections 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56147da5e1a0 0x56147da52380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x56147dad6ed0 0x56147dad92c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56147da580b0 0x56147da51900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 --2- 172.21.15.139:0/3264314554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56147da5d880 0x56147da51e40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.574 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 >> 172.21.15.139:0/3264314554 conn(0x56147d9cc200 msgr2=0x56147da5fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc4e97fa700 0 client.16908 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:32:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 shutdown_connections 2023-10-08T13:32:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 1 -- 172.21.15.139:0/3264314554 wait complete. 2023-10-08T13:32:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc513f09b80 20 client.16908 trim_cache size 0 max 16384 2023-10-08T13:32:50.575 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:32:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:32:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:32:50.576 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:32:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 msgr2=0x7fc4ec0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 0x7fc4ec0a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc500195b70 tx=0x7fc4f0019040 comp rx=0 tx=0).stop 2023-10-08T13:32:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 msgr2=0x7fc50019a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:32:50.577 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.571+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 0x7fc50019a880 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00b450 tx=0x7fc4fc00b760 comp rx=0 tx=0).stop 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 shutdown_connections 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4ec0a1670 0x7fc4ec0a3b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5001949b0 0x7fc500194e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5000fefc0 0x7fc50019a880 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 --2- 172.21.15.139:0/182835962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5001040e0 0x7fc50019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 >> 172.21.15.139:0/182835962 conn(0x7fc500075bf0 msgr2=0x7fc5001026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:32:50.578 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 shutdown_connections 2023-10-08T13:32:50.579 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:32:50.572+0000 7fc507d20700 1 -- 172.21.15.139:0/182835962 wait complete. 2023-10-08T13:32:51.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:50 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:32:51.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:50 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:32:51.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:50 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:32:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:51 smithi155 ceph-mon[103467]: pgmap v462: 129 pgs: 129 active+clean; 97 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.8 MiB/s wr, 684 op/s 2023-10-08T13:32:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:32:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:32:52.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:32:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:51 smithi139 ceph-mon[99506]: pgmap v462: 129 pgs: 129 active+clean; 97 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.8 MiB/s wr, 684 op/s 2023-10-08T13:32:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:32:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:32:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:32:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:51 smithi187 ceph-mon[104336]: pgmap v462: 129 pgs: 129 active+clean; 97 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 MiB/s rd, 1.8 MiB/s wr, 684 op/s 2023-10-08T13:32:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:32:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:32:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:32:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:53 smithi155 ceph-mon[103467]: pgmap v463: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 776 op/s 2023-10-08T13:32:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:53 smithi139 ceph-mon[99506]: pgmap v463: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 776 op/s 2023-10-08T13:32:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:53 smithi187 ceph-mon[104336]: pgmap v463: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 776 op/s 2023-10-08T13:32:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:55 smithi155 ceph-mon[103467]: pgmap v464: 129 pgs: 129 active+clean; 79 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.5 MiB/s wr, 602 op/s 2023-10-08T13:32:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:55 smithi139 ceph-mon[99506]: pgmap v464: 129 pgs: 129 active+clean; 79 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.5 MiB/s wr, 602 op/s 2023-10-08T13:32:56.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:55 smithi187 ceph-mon[104336]: pgmap v464: 129 pgs: 129 active+clean; 79 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.5 MiB/s wr, 602 op/s 2023-10-08T13:32:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:57 smithi155 ceph-mon[103467]: pgmap v465: 129 pgs: 129 active+clean; 103 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 736 op/s 2023-10-08T13:32:58.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:57 smithi139 ceph-mon[99506]: pgmap v465: 129 pgs: 129 active+clean; 103 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 736 op/s 2023-10-08T13:32:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:57 smithi187 ceph-mon[104336]: pgmap v465: 129 pgs: 129 active+clean; 103 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 1.8 MiB/s wr, 736 op/s 2023-10-08T13:33:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:32:59 smithi155 ceph-mon[103467]: pgmap v466: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 632 op/s 2023-10-08T13:33:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:32:59 smithi139 ceph-mon[99506]: pgmap v466: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 632 op/s 2023-10-08T13:33:00.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:32:59 smithi187 ceph-mon[104336]: pgmap v466: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.5 MiB/s wr, 632 op/s 2023-10-08T13:33:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:01 smithi155 ceph-mon[103467]: pgmap v467: 129 pgs: 129 active+clean; 100 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2023-10-08T13:33:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:01 smithi139 ceph-mon[99506]: pgmap v467: 129 pgs: 129 active+clean; 100 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2023-10-08T13:33:01.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:01 smithi187 ceph-mon[104336]: pgmap v467: 129 pgs: 129 active+clean; 100 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2023-10-08T13:33:03.713 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 -- 172.21.15.139:0/3286658576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01066c0 msgr2=0x7fcdb0106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/3286658576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01066c0 0x7fcdb0106aa0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009990 tx=0x7fcda0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 -- 172.21.15.139:0/3286658576 shutdown_connections 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/3286658576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb0101070 0x7fcdb010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/3286658576 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01066c0 0x7fcdb0106aa0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/3286658576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb01006b0 0x7fcdb0100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 -- 172.21.15.139:0/3286658576 >> 172.21.15.139:0/3286658576 conn(0x7fcdb00fc1c0 msgr2=0x7fcdb00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 -- 172.21.15.139:0/3286658576 shutdown_connections 2023-10-08T13:33:03.714 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.712+0000 7fcdb60bc700 1 -- 172.21.15.139:0/3286658576 wait complete. 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.713+0000 7fcdb60bc700 1 Processor -- start 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.713+0000 7fcdb60bc700 1 -- start start 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.713+0000 7fcdb60bc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.713+0000 7fcdb60bc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 0x7fcdb0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.713+0000 7fcdb60bc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb01066c0 0x7fcdb0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdb60bc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01a4eb0 con 0x7fcdb01006b0 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdb60bc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01a5020 con 0x7fcdb0101070 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdb60bc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01a51e0 con 0x7fcdb01066c0 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 0x7fcdb0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.717 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42872/0 (socket says 172.21.15.139:42872) 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaf7fe700 1 -- 172.21.15.139:0/4191653054 learned_addr learned my addr 172.21.15.139:0/4191653054 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaffff700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb01066c0 0x7fcdb0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 -- 172.21.15.139:0/4191653054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb01066c0 msgr2=0x7fcdb0073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb01066c0 0x7fcdb0073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 -- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 msgr2=0x7fcdb0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 -- 172.21.15.139:0/4191653054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00095f0 con 0x7fcdb0101070 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 0x7fcdb0073030 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9f0 tx=0x7fcda400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdacff9700 1 -- 172.21.15.139:0/4191653054 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400c9c0 con 0x7fcdb0101070 2023-10-08T13:33:03.718 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.714+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb01a54c0 con 0x7fcdb0101070 2023-10-08T13:33:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.715+0000 7fcdacff9700 1 -- 172.21.15.139:0/4191653054 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcda4010430 con 0x7fcdb0101070 2023-10-08T13:33:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.715+0000 7fcdacff9700 1 -- 172.21.15.139:0/4191653054 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4018680 con 0x7fcdb0101070 2023-10-08T13:33:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.715+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb01a5a20 con 0x7fcdb0101070 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.717+0000 7fcdacff9700 1 -- 172.21.15.139:0/4191653054 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fcda40187e0 con 0x7fcdb0101070 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.717+0000 7fcdacff9700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 0x7fcd980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdacff9700 1 -- 172.21.15.139:0/4191653054 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcda4014070 con 0x7fcdb0101070 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 0x7fcd980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 0x7fcd980a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda0005bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 Processor -- start 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 -- start start 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c2366880 0x5643c2366c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c2360b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c22c9400 con 0x5643c23610b0 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c22babc0 con 0x5643c2366880 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c22b84e0 con 0x5643c23671a0 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42882/0 (socket says 172.21.15.139:42882) 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaffff700 1 -- 172.21.15.139:0/238192737 learned_addr learned my addr 172.21.15.139:0/238192737 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.718+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c2366880 0x5643c2366c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 -- 172.21.15.139:0/238192737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 msgr2=0x5643c2360b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c2360b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 -- 172.21.15.139:0/238192737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c2366880 msgr2=0x5643c2366c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c2366880 0x5643c2366c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 -- 172.21.15.139:0/238192737 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c20ded80 con 0x5643c23610b0 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcdaffff700 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011680 tx=0x7fcda8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403cd084b0495c4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcd95ffb700 1 -- 172.21.15.139:0/238192737 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda800e040 con 0x5643c23610b0 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcd95ffb700 1 -- 172.21.15.139:0/238192737 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcda800f040 con 0x5643c23610b0 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.719+0000 7fcd95ffb700 1 -- 172.21.15.139:0/238192737 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8004860 con 0x5643c23610b0 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/238192737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 msgr2=0x5643c2361510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011680 tx=0x7fcda8009920 comp rx=0 tx=0).stop 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/238192737 shutdown_connections 2023-10-08T13:33:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c2361510 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c2366880 0x5643c2366c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/238192737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c2360b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/238192737 >> 172.21.15.139:0/238192737 conn(0x5643c22d5200 msgr2=0x5643c235bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/238192737 shutdown_connections 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/238192737 wait complete. 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 -- start start 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.720+0000 7fcdc22a5b80 1 Processor -- start 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c236abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23671a0 0x5643c236b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c22b3dd0 con 0x5643c23610b0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c22506b0 con 0x5643c23671a0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c2250350 con 0x5643c2366880 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 10 client.0 _ll_register_callbacks cb 0x5643c20ad7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42884/0 (socket says 172.21.15.139:42884) 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 -- 172.21.15.139:0/15838125 learned_addr learned my addr 172.21.15.139:0/15838125 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaffff700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23671a0 0x5643c236b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c236abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 -- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 msgr2=0x5643c236abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c236abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 -- 172.21.15.139:0/15838125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23671a0 msgr2=0x5643c236b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23671a0 0x5643c236b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 -- 172.21.15.139:0/15838125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda8011330 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcda00047b0 tx=0x7fcda0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0e0a3d694e38d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcd8effd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000f730 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643c227be50 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcda000f890 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcda000fa50 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 10 client.16920 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.721+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5643c20c7c00 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5643c227be50 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcda002f070 con 0x5643c23610b0 2023-10-08T13:33:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 10 client.16920 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 10 client.16920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 20 client.16920 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c237add0 0x5643c237d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 4 client.16920 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643c22acdb0 con 0x5643c237add0 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c237add0 0x5643c237d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcd8effd700 10 client.16920 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.722+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c237add0 0x5643c237d1f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b9d83b2b5f4caa server_cookie=3936b94a8aa36d05 in_seq=0 out_seq=0 2023-10-08T13:33:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcd8effd700 1 -- 172.21.15.139:0/15838125 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643c22acdb0 con 0x5643c237add0 2023-10-08T13:33:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcd8effd700 10 client.16920 handle_command_reply: tid=0 2023-10-08T13:33:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 client.16920 shutdown 2023-10-08T13:33:03.731 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 msgr2=0x5643c236a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcda00047b0 tx=0x7fcda0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 shutdown_connections 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c237add0 0x5643c237d1f0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23671a0 0x5643c236b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcd8effd700 0 client.16920 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23610b0 0x5643c236a680 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/15838125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c236abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 >> 172.21.15.139:0/15838125 conn(0x5643c22d5200 msgr2=0x5643c235b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 shutdown_connections 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/15838125 wait complete. 2023-10-08T13:33:03.732 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.724+0000 7fcdc22a5b80 20 client.16920 trim_cache size 0 max 16384 2023-10-08T13:33:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 Processor -- start 2023-10-08T13:33:03.742 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 -- start start 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c2360b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c235b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c21348c0 con 0x5643c23671a0 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c235d100 con 0x5643c23610b0 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c2361ce0 con 0x5643c2366880 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdaffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdaf7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c2360b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdaffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42896/0 (socket says 172.21.15.139:42896) 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdaffff700 1 -- 172.21.15.139:0/3839668321 learned_addr learned my addr 172.21.15.139:0/3839668321 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:03.743 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.740+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c235b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 -- 172.21.15.139:0/3839668321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 msgr2=0x5643c235b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c235b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 -- 172.21.15.139:0/3839668321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 msgr2=0x5643c2360b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c2360b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 -- 172.21.15.139:0/3839668321 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c21051f0 con 0x5643c23671a0 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c2360b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcdaffff700 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011680 tx=0x7fcda8006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481abf9a87ca8e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcd967fc700 1 -- 172.21.15.139:0/3839668321 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda800e040 con 0x5643c23671a0 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcd967fc700 1 -- 172.21.15.139:0/3839668321 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcda80092e0 con 0x5643c23671a0 2023-10-08T13:33:03.744 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.741+0000 7fcd967fc700 1 -- 172.21.15.139:0/3839668321 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8005830 con 0x5643c23671a0 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/3839668321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 msgr2=0x5643c235bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcda8011680 tx=0x7fcda8006000 comp rx=0 tx=0).stop 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/3839668321 shutdown_connections 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c23671a0 0x5643c235bcd0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c2360b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/3839668321 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c2366880 0x5643c235b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/3839668321 >> 172.21.15.139:0/3839668321 conn(0x5643c22d5200 msgr2=0x5643c2381b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/3839668321 shutdown_connections 2023-10-08T13:33:03.748 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/3839668321 wait complete. 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.742+0000 7fcdc22a5b80 1 -- start start 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 Processor -- start 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c236fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c23cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c2370a70 con 0x5643c2366880 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c23ce120 con 0x5643c23610b0 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c23ce2e0 con 0x5643c23671a0 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42900/0 (socket says 172.21.15.139:42900) 2023-10-08T13:33:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 -- 172.21.15.139:0/1597735137 learned_addr learned my addr 172.21.15.139:0/1597735137 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdc22a5b80 10 client.0 _ll_register_callbacks cb 0x5643c20ad7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c236fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 -- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 msgr2=0x5643c23cdbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c23cdbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 -- 172.21.15.139:0/1597735137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 msgr2=0x5643c236fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c236fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 -- 172.21.15.139:0/1597735137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c20c7c00 con 0x5643c2366880 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c236fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcdaeffd700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcda4096c20 tx=0x7fcda40092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b784e62e8e371e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.743+0000 7fcd8effd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda409e300 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fcda40a2540 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcda800f040 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcda4010860 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 10 client.16926 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5643c20ded80 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcda800f040 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcda40cd210 con 0x5643c2366880 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 10 client.16926 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 20 client.16926 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c23cfb30 0x5643c23d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 4 client.16926 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:33:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.744+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5643c22acad0 con 0x5643c23cfb30 2023-10-08T13:33:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.745+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c23cfb30 0x5643c23d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.746+0000 7fcdaf7fe700 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c23cfb30 0x5643c23d1f50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11046210a9731d60 server_cookie=f4156f70863c9486 in_seq=0 out_seq=0 2023-10-08T13:33:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.746+0000 7fcd8effd700 10 client.16926 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.768+0000 7fcd8effd700 1 -- 172.21.15.139:0/1597735137 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5643c22acad0 con 0x5643c23cfb30 2023-10-08T13:33:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.768+0000 7fcd8effd700 10 client.16926 handle_command_reply: tid=0 2023-10-08T13:33:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.768+0000 7fcdc22a5b80 1 client.16926 shutdown 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.768+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 msgr2=0x5643c2370300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.768+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcda4096c20 tx=0x7fcda40092d0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 shutdown_connections 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5643c23671a0 0x5643c23cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5643c23cfb30 0x5643c23d1f50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643c23610b0 0x5643c236fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 --2- 172.21.15.139:0/1597735137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5643c2366880 0x5643c2370300 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcd8effd700 0 client.16926 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 >> 172.21.15.139:0/1597735137 conn(0x5643c22d5200 msgr2=0x5643c2368f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 shutdown_connections 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 1 -- 172.21.15.139:0/1597735137 wait complete. 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdc22a5b80 20 client.16926 trim_cache size 0 max 16384 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:33:03.771 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:33:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 msgr2=0x7fcd980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 0x7fcd980a3b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda0005bc0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 msgr2=0x7fcdb0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:03.772 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 0x7fcdb0073030 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9f0 tx=0x7fcda400ed00 comp rx=0 tx=0).stop 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 shutdown_connections 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fcd980a1670 0x7fcd980a3b30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdb01066c0 0x7fcdb0073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcdb01006b0 0x7fcdb0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 --2- 172.21.15.139:0/4191653054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdb0101070 0x7fcdb0073030 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.769+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 >> 172.21.15.139:0/4191653054 conn(0x7fcdb00fc1c0 msgr2=0x7fcdb00fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.770+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 shutdown_connections 2023-10-08T13:33:03.773 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:03.770+0000 7fcdb60bc700 1 -- 172.21.15.139:0/4191653054 wait complete. 2023-10-08T13:33:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:03 smithi155 ceph-mon[103467]: pgmap v468: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 751 op/s 2023-10-08T13:33:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:03 smithi139 ceph-mon[99506]: pgmap v468: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 751 op/s 2023-10-08T13:33:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:03 smithi187 ceph-mon[104336]: pgmap v468: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.9 MiB/s wr, 751 op/s 2023-10-08T13:33:06.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:05 smithi155 ceph-mon[103467]: pgmap v469: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 592 op/s 2023-10-08T13:33:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:05 smithi139 ceph-mon[99506]: pgmap v469: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 592 op/s 2023-10-08T13:33:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:05 smithi187 ceph-mon[104336]: pgmap v469: 129 pgs: 129 active+clean; 102 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 592 op/s 2023-10-08T13:33:07.665 INFO:tasks.workunit.client.0.smithi139.stdout:30000 mapread 0x11b12cb thru 0x11b885f (0x7595 bytes) 2023-10-08T13:33:08.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:07 smithi155 ceph-mon[103467]: pgmap v470: 129 pgs: 129 active+clean; 113 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.0 MiB/s wr, 764 op/s 2023-10-08T13:33:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:07 smithi139 ceph-mon[99506]: pgmap v470: 129 pgs: 129 active+clean; 113 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.0 MiB/s wr, 764 op/s 2023-10-08T13:33:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:07 smithi187 ceph-mon[104336]: pgmap v470: 129 pgs: 129 active+clean; 113 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.0 MiB/s wr, 764 op/s 2023-10-08T13:33:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:09 smithi155 ceph-mon[103467]: pgmap v471: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 639 op/s 2023-10-08T13:33:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:09 smithi139 ceph-mon[99506]: pgmap v471: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 639 op/s 2023-10-08T13:33:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:09 smithi187 ceph-mon[104336]: pgmap v471: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 639 op/s 2023-10-08T13:33:10.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:33:10.549 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 -- 172.21.15.139:0/2927174198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 msgr2=0x7fb508105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 --2- 172.21.15.139:0/2927174198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb508105a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009990 tx=0x7fb4f8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 -- 172.21.15.139:0/2927174198 shutdown_connections 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 --2- 172.21.15.139:0/2927174198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 --2- 172.21.15.139:0/2927174198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb508105a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 --2- 172.21.15.139:0/2927174198 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb5080ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 -- 172.21.15.139:0/2927174198 >> 172.21.15.139:0/2927174198 conn(0x7fb508076790 msgr2=0x7fb508076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 -- 172.21.15.139:0/2927174198 shutdown_connections 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.546+0000 7fb50d0de700 1 -- 172.21.15.139:0/2927174198 wait complete. 2023-10-08T13:33:10.550 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 Processor -- start 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 -- start start 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508197020 con 0x7fb5080ff640 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508197190 con 0x7fb508100000 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50d0de700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508197350 con 0x7fb508105630 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.551 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33200/0 (socket says 172.21.15.139:33200) 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42630/0 (socket says 172.21.15.139:42630) 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42912/0 (socket says 172.21.15.139:42912) 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.547+0000 7fb50659c700 1 -- 172.21.15.139:0/4200339313 learned_addr learned my addr 172.21.15.139:0/4200339313 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 -- 172.21.15.139:0/4200339313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 msgr2=0x7fb5081969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 -- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 msgr2=0x7fb50819c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 -- 172.21.15.139:0/4200339313 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80095f0 con 0x7fb508100000 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb506d9d700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50759e700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:10.552 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50659c700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e9a0 tx=0x7fb4fc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb4effff700 1 -- 172.21.15.139:0/4200339313 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc009790 con 0x7fb508100000 2023-10-08T13:33:10.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508197630 con 0x7fb508100000 2023-10-08T13:33:10.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb4effff700 1 -- 172.21.15.139:0/4200339313 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4fc010430 con 0x7fb508100000 2023-10-08T13:33:10.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb4effff700 1 -- 172.21.15.139:0/4200339313 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc018680 con 0x7fb508100000 2023-10-08T13:33:10.553 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.548+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5081a3880 con 0x7fb508100000 2023-10-08T13:33:10.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.552+0000 7fb4effff700 1 -- 172.21.15.139:0/4200339313 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb4fc00ca10 con 0x7fb508100000 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.552+0000 7fb4effff700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 0x7fb4f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.552+0000 7fb5192c7b80 1 Processor -- start 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.552+0000 7fb4effff700 1 -- 172.21.15.139:0/4200339313 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb4fc014070 con 0x7fb508100000 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.552+0000 7fb506d9d700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 0x7fb4f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 -- start start 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f7016460 con 0x5621f70ace80 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f7007c20 con 0x5621f70b8650 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f7005540 con 0x5621f70ad7a0 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 0x7fb4f00a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b2e0 tx=0x7fb4f8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42918/0 (socket says 172.21.15.139:42918) 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 -- 172.21.15.139:0/704821009 learned_addr learned my addr 172.21.15.139:0/704821009 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb50659c700 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb50759e700 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 -- 172.21.15.139:0/704821009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 msgr2=0x5621f70b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 -- 172.21.15.139:0/704821009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 msgr2=0x5621f70baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 -- 172.21.15.139:0/704821009 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621f6e2bde0 con 0x5621f70ace80 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.553+0000 7fb506d9d700 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8015000 tx=0x7fb4f8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f19eb99e10e9c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.554+0000 7fb4ed7fa700 1 -- 172.21.15.139:0/704821009 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800fdd0 con 0x5621f70ace80 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.554+0000 7fb4ed7fa700 1 -- 172.21.15.139:0/704821009 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f801e040 con 0x5621f70ace80 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.554+0000 7fb4ed7fa700 1 -- 172.21.15.139:0/704821009 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8004ce0 con 0x5621f70ace80 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.554+0000 7fb5192c7b80 1 -- 172.21.15.139:0/704821009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 msgr2=0x5621f70ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.554+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8015000 tx=0x7fb4f8020000 comp rx=0 tx=0).stop 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- 172.21.15.139:0/704821009 shutdown_connections 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.561 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70ad260 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/704821009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- 172.21.15.139:0/704821009 >> 172.21.15.139:0/704821009 conn(0x5621f7022260 msgr2=0x5621f70a92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- 172.21.15.139:0/704821009 shutdown_connections 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- 172.21.15.139:0/704821009 wait complete. 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- start start 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 Processor -- start 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 0x5621f70b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.562 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 0x5621f70b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f7000e30 con 0x5621f70ace80 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f6f9d710 con 0x5621f70ad7a0 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f6f9d3b0 con 0x5621f70b8650 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb5192c7b80 10 client.0 _ll_register_callbacks cb 0x5621f6dfa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.555+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.563 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42924/0 (socket says 172.21.15.139:42924) 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb50659c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 0x5621f70b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 -- 172.21.15.139:0/3799871789 learned_addr learned my addr 172.21.15.139:0/3799871789 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb50759e700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 0x5621f70b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 -- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 msgr2=0x5621f70b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 0x5621f70b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.564 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 -- 172.21.15.139:0/3799871789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 msgr2=0x5621f70b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 0x5621f70b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 -- 172.21.15.139:0/3799871789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50810cdf0 con 0x5621f70ace80 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb50659c700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 0x5621f70b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb50759e700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 0x5621f70b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8005f20 tx=0x7fb4f800fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d44057ae490d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb4eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8029070 con 0x5621f70ace80 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb4f8005050 con 0x5621f70ace80 2023-10-08T13:33:10.565 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621f6fc8eb0 con 0x5621f70ace80 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4f8005210 con 0x5621f70ace80 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.556+0000 7fb5192c7b80 10 client.16938 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5621f6e14c60 con 0x5621f70ace80 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5621f6fc8eb0 con 0x5621f70ace80 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4f803f070 con 0x5621f70ace80 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 10 client.16938 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 20 client.16938 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f70d0460 0x5621f70d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.566 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 4 client.16938 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:10.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621f6ff9e10 con 0x5621f70d0460 2023-10-08T13:33:10.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.557+0000 7fb50659c700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f70d0460 0x5621f70d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.558+0000 7fb4eaff5700 10 client.16938 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:10.567 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.558+0000 7fb50659c700 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f70d0460 0x5621f70d2850 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de2caba114e24d9 server_cookie=72d716dc42e12f48 in_seq=0 out_seq=0 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.558+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3799871789 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621f6ff9e10 con 0x5621f70d0460 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.558+0000 7fb4eaff5700 10 client.16938 handle_command_reply: tid=0 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.558+0000 7fb5192c7b80 1 client.16938 shutdown 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 msgr2=0x5621f70b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8005f20 tx=0x7fb4f800fe00 comp rx=0 tx=0).stop 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 shutdown_connections 2023-10-08T13:33:10.568 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70b8650 0x5621f70b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70b8080 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f70d0460 0x5621f70d2850 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3799871789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70ad7a0 0x5621f70b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb4eaff5700 0 client.16938 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 >> 172.21.15.139:0/3799871789 conn(0x5621f7022260 msgr2=0x5621f70a8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 shutdown_connections 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3799871789 wait complete. 2023-10-08T13:33:10.569 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.559+0000 7fb5192c7b80 20 client.16938 trim_cache size 0 max 16384 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.584+0000 7fb5192c7b80 1 Processor -- start 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.584+0000 7fb5192c7b80 1 -- start start 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70a9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f6e81920 con 0x5621f70ace80 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f70ae970 con 0x5621f70b8650 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f70a8b50 con 0x5621f70ad7a0 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42932/0 (socket says 172.21.15.139:42932) 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 -- 172.21.15.139:0/772876048 learned_addr learned my addr 172.21.15.139:0/772876048 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb50759e700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb50659c700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 -- 172.21.15.139:0/772876048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 msgr2=0x5621f70a8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70a8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 -- 172.21.15.139:0/772876048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 msgr2=0x5621f70a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 -- 172.21.15.139:0/772876048 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621f6e52250 con 0x5621f70ace80 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb50659c700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.585+0000 7fb506d9d700 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80056a0 tx=0x7fb4f8005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645ea33f70e65e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.586+0000 7fb4edffb700 1 -- 172.21.15.139:0/772876048 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8029070 con 0x5621f70ace80 2023-10-08T13:33:10.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.586+0000 7fb4edffb700 1 -- 172.21.15.139:0/772876048 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f8024e50 con 0x5621f70ace80 2023-10-08T13:33:10.589 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.586+0000 7fb4edffb700 1 -- 172.21.15.139:0/772876048 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8038480 con 0x5621f70ace80 2023-10-08T13:33:10.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- 172.21.15.139:0/772876048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 msgr2=0x5621f70c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80056a0 tx=0x7fb4f8005790 comp rx=0 tx=0).stop 2023-10-08T13:33:10.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- 172.21.15.139:0/772876048 shutdown_connections 2023-10-08T13:33:10.592 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ace80 0x5621f70c79b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/772876048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ad7a0 0x5621f70a8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- 172.21.15.139:0/772876048 >> 172.21.15.139:0/772876048 conn(0x5621f7022260 msgr2=0x5621f70b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- 172.21.15.139:0/772876048 shutdown_connections 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- 172.21.15.139:0/772876048 wait complete. 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 -- start start 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.587+0000 7fb5192c7b80 1 Processor -- start 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 0x5621f70c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.593 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f70c6590 con 0x5621f70ad7a0 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f70c6700 con 0x5621f70b8650 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621f70c68c0 con 0x5621f70ace80 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb5192c7b80 10 client.0 _ll_register_callbacks cb 0x5621f6dfa800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 0x5621f70c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb506d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42654/0 (socket says 172.21.15.139:42654) 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb506d9d700 1 -- 172.21.15.139:0/3098807694 learned_addr learned my addr 172.21.15.139:0/3098807694 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 -- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 msgr2=0x5621f70c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:10.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 -- 172.21.15.139:0/3098807694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 msgr2=0x5621f70c6050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70c6050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.588+0000 7fb50659c700 1 -- 172.21.15.139:0/3098807694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621f6e14c60 con 0x5621f70ad7a0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb50659c700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 0x5621f70c5b10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0caa10 tx=0x7fb4fc096660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355f88695090d0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb4eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc098640 con 0x5621f70ad7a0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb4fc0105a0 con 0x5621f70ad7a0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4f801e040 con 0x5621f70ad7a0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4fc010880 con 0x5621f70ad7a0 2023-10-08T13:33:10.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb5192c7b80 10 client.16944 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5621f6e2a2b0 con 0x5621f70ad7a0 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.589+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4f801e040 con 0x5621f70ad7a0 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4fc09a500 con 0x5621f70ad7a0 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 10 client.16944 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 20 client.16944 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f7136540 0x5621f7138960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 4 client.16944 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5621f6ff9b30 con 0x5621f7136540 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.590+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f7136540 0x5621f7138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb4eaff5700 10 client.16944 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:10.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb506d9d700 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f7136540 0x5621f7138960 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a27bd33f54e70111 server_cookie=6c70e55c9e0259b7 in_seq=0 out_seq=0 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb4eaff5700 1 -- 172.21.15.139:0/3098807694 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5621f6ff9b30 con 0x5621f7136540 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb4eaff5700 10 client.16944 handle_command_reply: tid=0 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 client.16944 shutdown 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 msgr2=0x5621f70c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 0x5621f70c5b10 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0caa10 tx=0x7fb4fc096660 comp rx=0 tx=0).stop 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 shutdown_connections 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5621f7136540 0x5621f7138960 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5621f70b8650 0x5621f70c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb4eaff5700 0 client.16944 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:10.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621f70ace80 0x5621f70c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 --2- 172.21.15.139:0/3098807694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5621f70ad7a0 0x5621f70c5b10 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 >> 172.21.15.139:0/3098807694 conn(0x5621f7022260 msgr2=0x5621f70a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 shutdown_connections 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 1 -- 172.21.15.139:0/3098807694 wait complete. 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.591+0000 7fb5192c7b80 20 client.16944 trim_cache size 0 max 16384 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:33:10.598 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:33:10.599 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 msgr2=0x7fb4f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 0x7fb4f00a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800b2e0 tx=0x7fb4f8005960 comp rx=0 tx=0).stop 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 msgr2=0x7fb50819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e9a0 tx=0x7fb4fc00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 shutdown_connections 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb4f00a15f0 0x7fb4f00a3ab0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb508105630 0x7fb5081969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5080ff640 0x7fb50819c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 --2- 172.21.15.139:0/4200339313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb508100000 0x7fb50819cdd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:10.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 >> 172.21.15.139:0/4200339313 conn(0x7fb508076790 msgr2=0x7fb508069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:10.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 shutdown_connections 2023-10-08T13:33:10.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:10.592+0000 7fb50d0de700 1 -- 172.21.15.139:0/4200339313 wait complete. 2023-10-08T13:33:10.605 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:33:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:11 smithi155 ceph-mon[103467]: pgmap v472: 129 pgs: 129 active+clean; 111 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 619 op/s 2023-10-08T13:33:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:11 smithi139 ceph-mon[99506]: pgmap v472: 129 pgs: 129 active+clean; 111 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 619 op/s 2023-10-08T13:33:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:11 smithi187 ceph-mon[104336]: pgmap v472: 129 pgs: 129 active+clean; 111 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 619 op/s 2023-10-08T13:33:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:13 smithi155 ceph-mon[103467]: pgmap v473: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 741 op/s 2023-10-08T13:33:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:13 smithi139 ceph-mon[99506]: pgmap v473: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 741 op/s 2023-10-08T13:33:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:13 smithi187 ceph-mon[104336]: pgmap v473: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 2.1 MiB/s wr, 741 op/s 2023-10-08T13:33:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:15 smithi155 ceph-mon[103467]: pgmap v474: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.6 MiB/s wr, 573 op/s 2023-10-08T13:33:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:15 smithi139 ceph-mon[99506]: pgmap v474: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.6 MiB/s wr, 573 op/s 2023-10-08T13:33:16.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:15 smithi187 ceph-mon[104336]: pgmap v474: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.6 MiB/s wr, 573 op/s 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 -- 172.21.15.139:0/1154609510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 msgr2=0x7f69400ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 --2- 172.21.15.139:0/1154609510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 0x7f69400ffd50 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f69340098f0 tx=0x7f6934009c00 comp rx=0 tx=0).stop 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 -- 172.21.15.139:0/1154609510 shutdown_connections 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 --2- 172.21.15.139:0/1154609510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f694010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 --2- 172.21.15.139:0/1154609510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f6940105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 --2- 172.21.15.139:0/1154609510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 0x7f69400ffd50 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 -- 172.21.15.139:0/1154609510 >> 172.21.15.139:0/1154609510 conn(0x7f69400764c0 msgr2=0x7f69400768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 -- 172.21.15.139:0/1154609510 shutdown_connections 2023-10-08T13:33:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 -- 172.21.15.139:0/1154609510 wait complete. 2023-10-08T13:33:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.890+0000 7f69460a2700 1 Processor -- start 2023-10-08T13:33:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 -- start start 2023-10-08T13:33:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 0x7f69401956a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f6940195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69401964a0 con 0x7f69400ff8d0 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694019ac30 con 0x7f6940105670 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f69460a2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694019adf0 con 0x7f6940100290 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f693effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f6940195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f693ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f693ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33242/0 (socket says 172.21.15.139:33242) 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f693ffff700 1 -- 172.21.15.139:0/2583740046 learned_addr learned my addr 172.21.15.139:0/2583740046 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.891+0000 7f693ffff700 1 -- 172.21.15.139:0/2583740046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 msgr2=0x7f6940195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693ffff700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f6940195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693ffff700 1 -- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 msgr2=0x7f69401956a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693ffff700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 0x7f69401956a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693ffff700 1 -- 172.21.15.139:0/2583740046 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69300095f0 con 0x7f6940105670 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693effd700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f6940195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693ffff700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f693800efc0 tx=0x7f693800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693cff9700 1 -- 172.21.15.139:0/2583740046 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938018070 con 0x7f6940105670 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693cff9700 1 -- 172.21.15.139:0/2583740046 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f693800f040 con 0x7f6940105670 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6934009520 con 0x7f6940105670 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f693cff9700 1 -- 172.21.15.139:0/2583740046 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693800ccc0 con 0x7f6940105670 2023-10-08T13:33:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.892+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694019b3c0 con 0x7f6940105670 2023-10-08T13:33:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.895+0000 7f693cff9700 1 -- 172.21.15.139:0/2583740046 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f6938003a00 con 0x7f6940105670 2023-10-08T13:33:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.895+0000 7f693cff9700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 0x7f69280a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.895+0000 7f693cff9700 1 -- 172.21.15.139:0/2583740046 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f69380ccf50 con 0x7f6940105670 2023-10-08T13:33:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.895+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 0x7f69280a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 0x7f69280a3b30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69300095c0 tx=0x7f6930009510 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 Processor -- start 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 -- start start 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a84a400 con 0x558f9a8e20b0 2023-10-08T13:33:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a83bbc0 con 0x558f9a8e7880 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f695228bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a8394e0 con 0x558f9a8e81a0 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33246/0 (socket says 172.21.15.139:33246) 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42676/0 (socket says 172.21.15.139:42676) 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.896+0000 7f693f7fe700 1 -- 172.21.15.139:0/2618250944 learned_addr learned my addr 172.21.15.139:0/2618250944 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 -- 172.21.15.139:0/2618250944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 msgr2=0x558f9a8e1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 -- 172.21.15.139:0/2618250944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 msgr2=0x558f9a8e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 -- 172.21.15.139:0/2618250944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9a65fd80 con 0x558f9a8e20b0 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693effd700 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f693ffff700 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e2510 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f69380ca300 tx=0x7f69380996c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f91c730193c48d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f6925ffb700 1 -- 172.21.15.139:0/2618250944 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693809a280 con 0x558f9a8e20b0 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f6925ffb700 1 -- 172.21.15.139:0/2618250944 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f693800ce60 con 0x558f9a8e20b0 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.897+0000 7f6925ffb700 1 -- 172.21.15.139:0/2618250944 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693801b320 con 0x558f9a8e20b0 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- 172.21.15.139:0/2618250944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 msgr2=0x558f9a8e2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e2510 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f69380ca300 tx=0x7f69380996c0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- 172.21.15.139:0/2618250944 shutdown_connections 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e2510 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 --2- 172.21.15.139:0/2618250944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a8e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- 172.21.15.139:0/2618250944 >> 172.21.15.139:0/2618250944 conn(0x558f9a856200 msgr2=0x558f9a8dcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- 172.21.15.139:0/2618250944 shutdown_connections 2023-10-08T13:33:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- 172.21.15.139:0/2618250944 wait complete. 2023-10-08T13:33:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 -- start start 2023-10-08T13:33:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.898+0000 7f695228bb80 1 Processor -- start 2023-10-08T13:33:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8eba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a834dd0 con 0x558f9a8e81a0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a7d16b0 con 0x558f9a8e20b0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a7d1350 con 0x558f9a8e7880 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 10 client.0 _ll_register_callbacks cb 0x558f9a62e7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33252/0 (socket says 172.21.15.139:33252) 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 -- 172.21.15.139:0/3425103203 learned_addr learned my addr 172.21.15.139:0/3425103203 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42968/0 (socket says 172.21.15.139:42968) 2023-10-08T13:33:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 -- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 msgr2=0x558f9a8eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 -- 172.21.15.139:0/3425103203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 msgr2=0x558f9a8ebf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 -- 172.21.15.139:0/3425103203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693000eb20 con 0x558f9a8e20b0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693ffff700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6930005da0 tx=0x7f6930004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961b1a9642731885 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f691effd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930010a90 con 0x558f9a8e20b0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6930010bf0 con 0x558f9a8e20b0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.899+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f9a7fce50 con 0x558f9a8e20b0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6930010df0 con 0x558f9a8e20b0 2023-10-08T13:33:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 10 client.26375 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f694010cda0 con 0x558f9a8e20b0 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558f9a7fce50 con 0x558f9a8e20b0 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6930018070 con 0x558f9a8e20b0 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 10 client.26375 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 10 client.26375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 20 client.26375 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a8fbce0 0x558f9a8fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 4 client.26375 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f9a82ddb0 con 0x558f9a8fbce0 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.901+0000 7f693effd700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a8fbce0 0x558f9a8fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.902+0000 7f691effd700 10 client.26375 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.902+0000 7f693effd700 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a8fbce0 0x558f9a8fe100 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c22f95487baa19 server_cookie=aea7896137bd1961 in_seq=0 out_seq=0 2023-10-08T13:33:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.904+0000 7f691effd700 1 -- 172.21.15.139:0/3425103203 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f9a82ddb0 con 0x558f9a8fbce0 2023-10-08T13:33:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.904+0000 7f691effd700 10 client.26375 handle_command_reply: tid=0 2023-10-08T13:33:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.905+0000 7f695228bb80 1 client.26375 shutdown 2023-10-08T13:33:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.905+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 msgr2=0x558f9a8eb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.905+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6930005da0 tx=0x7f6930004750 comp rx=0 tx=0).stop 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 shutdown_connections 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e81a0 0x558f9a8ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a8fbce0 0x558f9a8fe100 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e20b0 0x558f9a8eb4c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 --2- 172.21.15.139:0/3425103203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f691effd700 0 client.26375 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 >> 172.21.15.139:0/3425103203 conn(0x558f9a856200 msgr2=0x558f9a8dc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 shutdown_connections 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 1 -- 172.21.15.139:0/3425103203 wait complete. 2023-10-08T13:33:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.906+0000 7f695228bb80 20 client.26375 trim_cache size 0 max 16384 2023-10-08T13:33:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 Processor -- start 2023-10-08T13:33:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 -- start start 2023-10-08T13:33:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8dc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 0x558f9a8dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a6b58c0 con 0x558f9a8e20b0 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a8d9830 con 0x558f9a8e81a0 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f695228bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a8dd610 con 0x558f9a8e7880 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42972/0 (socket says 172.21.15.139:42972) 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 -- 172.21.15.139:0/3304995204 learned_addr learned my addr 172.21.15.139:0/3304995204 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693ffff700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 0x558f9a8dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693effd700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8dc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 -- 172.21.15.139:0/3304995204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 msgr2=0x558f9a8dc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8dc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 -- 172.21.15.139:0/3304995204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 msgr2=0x558f9a8dccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 0x558f9a8dccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693f7fe700 1 -- 172.21.15.139:0/3304995204 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6938084040 con 0x558f9a8e20b0 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.926+0000 7f693ffff700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 0x558f9a8dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.927+0000 7f693f7fe700 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6930013040 tx=0x7f6930005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24de3f0662bbfb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.927+0000 7f69267fc700 1 -- 172.21.15.139:0/3304995204 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693000f850 con 0x558f9a8e20b0 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.927+0000 7f69267fc700 1 -- 172.21.15.139:0/3304995204 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6930004030 con 0x558f9a8e20b0 2023-10-08T13:33:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.927+0000 7f69267fc700 1 -- 172.21.15.139:0/3304995204 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930010b30 con 0x558f9a8e20b0 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- 172.21.15.139:0/3304995204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 msgr2=0x558f9a8e1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6930013040 tx=0x7f6930005980 comp rx=0 tx=0).stop 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- 172.21.15.139:0/3304995204 shutdown_connections 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e81a0 0x558f9a8dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8e1b70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 --2- 172.21.15.139:0/3304995204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e7880 0x558f9a8dc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- 172.21.15.139:0/3304995204 >> 172.21.15.139:0/3304995204 conn(0x558f9a856200 msgr2=0x558f9a8ebda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- 172.21.15.139:0/3304995204 shutdown_connections 2023-10-08T13:33:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- 172.21.15.139:0/3304995204 wait complete. 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 -- start start 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.928+0000 7f695228bb80 1 Processor -- start 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a94ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a8f13c0 con 0x558f9a8e20b0 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a8f1530 con 0x558f9a8e7880 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9a960070 con 0x558f9a8e81a0 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f695228bb80 10 client.0 _ll_register_callbacks cb 0x7f693001d7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f693f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42978/0 (socket says 172.21.15.139:42978) 2023-10-08T13:33:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.929+0000 7f693f7fe700 1 -- 172.21.15.139:0/2367260995 learned_addr learned my addr 172.21.15.139:0/2367260995 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 -- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 msgr2=0x558f9a94ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a94ead0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 -- 172.21.15.139:0/2367260995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 msgr2=0x558f9a8f0be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8f0be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 -- 172.21.15.139:0/2367260995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f9a65fd80 con 0x558f9a8e20b0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f693f7fe700 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6930009b50 tx=0x7f69300043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d7bb7bdd5015c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f691effd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930010bc0 con 0x558f9a8e20b0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f6930010d20 con 0x558f9a8e20b0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.930+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f693800ce60 con 0x558f9a8e20b0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6930004580 con 0x558f9a8e20b0 2023-10-08T13:33:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 10 client.16959 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f694010cda0 con 0x558f9a8e20b0 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f693800ce60 con 0x558f9a8e20b0 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f693003c030 con 0x558f9a8e20b0 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 10 client.16959 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 20 client.16959 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a9614b0 0x558f9a9638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 4 client.16959 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f9a82dad0 con 0x558f9a9614b0 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.931+0000 7f693effd700 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a9614b0 0x558f9a9638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.932+0000 7f691effd700 10 client.16959 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.932+0000 7f693effd700 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a9614b0 0x558f9a9638d0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd899265afb259b0 server_cookie=b77e9903d2e81091 in_seq=0 out_seq=0 2023-10-08T13:33:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f691effd700 1 -- 172.21.15.139:0/2367260995 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f9a82dad0 con 0x558f9a9614b0 2023-10-08T13:33:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f691effd700 10 client.16959 handle_command_reply: tid=0 2023-10-08T13:33:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 client.16959 shutdown 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 msgr2=0x558f9a8f06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6930009b50 tx=0x7f69300043d0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 shutdown_connections 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f9a8e81a0 0x558f9a94ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558f9a8e20b0 0x558f9a8f06a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558f9a9614b0 0x558f9a9638d0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 --2- 172.21.15.139:0/2367260995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558f9a8e7880 0x558f9a8f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f691effd700 0 client.16959 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 >> 172.21.15.139:0/2367260995 conn(0x558f9a856200 msgr2=0x558f9a8e65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 shutdown_connections 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 1 -- 172.21.15.139:0/2367260995 wait complete. 2023-10-08T13:33:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.957+0000 7f695228bb80 20 client.16959 trim_cache size 0 max 16384 2023-10-08T13:33:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:33:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:33:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:33:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 msgr2=0x7f69280a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 0x7f69280a3b30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69300095c0 tx=0x7f6930009510 comp rx=0 tx=0).stop 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 msgr2=0x7f694019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f693800efc0 tx=0x7f693800c3a0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 shutdown_connections 2023-10-08T13:33:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69280a1670 0x7f69280a3b30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6940105670 0x7f694019a6f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69400ff8d0 0x7f69401956a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 --2- 172.21.15.139:0/2583740046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6940100290 0x7f6940195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 >> 172.21.15.139:0/2583740046 conn(0x7f69400764c0 msgr2=0x7f69400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 shutdown_connections 2023-10-08T13:33:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:16.958+0000 7f69460a2700 1 -- 172.21.15.139:0/2583740046 wait complete. 2023-10-08T13:33:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:17 smithi155 ceph-mon[103467]: pgmap v475: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 716 op/s 2023-10-08T13:33:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:17 smithi139 ceph-mon[99506]: pgmap v475: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 716 op/s 2023-10-08T13:33:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:17 smithi187 ceph-mon[104336]: pgmap v475: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.9 MiB/s wr, 716 op/s 2023-10-08T13:33:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:19 smithi155 ceph-mon[103467]: pgmap v476: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2023-10-08T13:33:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:19 smithi139 ceph-mon[99506]: pgmap v476: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2023-10-08T13:33:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:19 smithi187 ceph-mon[104336]: pgmap v476: 129 pgs: 129 active+clean; 117 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 1.6 MiB/s wr, 619 op/s 2023-10-08T13:33:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:21 smithi155 ceph-mon[103467]: pgmap v477: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.5 MiB/s wr, 598 op/s 2023-10-08T13:33:21.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:21 smithi139 ceph-mon[99506]: pgmap v477: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.5 MiB/s wr, 598 op/s 2023-10-08T13:33:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:21 smithi187 ceph-mon[104336]: pgmap v477: 129 pgs: 129 active+clean; 113 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 1.5 MiB/s wr, 598 op/s 2023-10-08T13:33:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:23 smithi155 ceph-mon[103467]: pgmap v478: 129 pgs: 129 active+clean; 99 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:33:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:23 smithi139 ceph-mon[99506]: pgmap v478: 129 pgs: 129 active+clean; 99 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:33:24.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:23 smithi187 ceph-mon[104336]: pgmap v478: 129 pgs: 129 active+clean; 99 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 1.8 MiB/s wr, 716 op/s 2023-10-08T13:33:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:25 smithi155 ceph-mon[103467]: pgmap v479: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 590 op/s 2023-10-08T13:33:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:25 smithi139 ceph-mon[99506]: pgmap v479: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 590 op/s 2023-10-08T13:33:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:25 smithi187 ceph-mon[104336]: pgmap v479: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 1.5 MiB/s wr, 590 op/s 2023-10-08T13:33:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:27 smithi155 ceph-mon[103467]: pgmap v480: 129 pgs: 129 active+clean; 103 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 1.6 MiB/s wr, 687 op/s 2023-10-08T13:33:28.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:27 smithi139 ceph-mon[99506]: pgmap v480: 129 pgs: 129 active+clean; 103 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 1.6 MiB/s wr, 687 op/s 2023-10-08T13:33:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:27 smithi187 ceph-mon[104336]: pgmap v480: 129 pgs: 129 active+clean; 103 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 1.6 MiB/s wr, 687 op/s 2023-10-08T13:33:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 -- 172.21.15.139:0/679625244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109ab0 msgr2=0x7fa8cc112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/679625244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc112200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80098f0 tx=0x7fa8c8009c00 comp rx=0 tx=0).stop 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 -- 172.21.15.139:0/679625244 shutdown_connections 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/679625244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc112740 0x7fa8cc114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/679625244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc109190 0x7fa8cc109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/679625244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc112200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.094+0000 7fa8d3a97700 1 -- 172.21.15.139:0/679625244 >> 172.21.15.139:0/679625244 conn(0x7fa8cc06b7c0 msgr2=0x7fa8cc06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.095+0000 7fa8d3a97700 1 -- 172.21.15.139:0/679625244 shutdown_connections 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.095+0000 7fa8d3a97700 1 -- 172.21.15.139:0/679625244 wait complete. 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.095+0000 7fa8d3a97700 1 Processor -- start 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.095+0000 7fa8d3a97700 1 -- start start 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 0x7fa8cc1a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1a55a0 con 0x7fa8cc112740 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1a5710 con 0x7fa8cc109190 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d3a97700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1a58d0 con 0x7fa8cc109ab0 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 0x7fa8cc1a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 0x7fa8cc1a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:42996/0 (socket says 172.21.15.139:42996) 2023-10-08T13:33:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33280/0 (socket says 172.21.15.139:33280) 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d2034700 1 -- 172.21.15.139:0/3525371197 learned_addr learned my addr 172.21.15.139:0/3525371197 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1032700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 -- 172.21.15.139:0/3525371197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc109ab0 msgr2=0x7fa8cc1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 -- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 msgr2=0x7fa8cc1a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 0x7fa8cc1a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 -- 172.21.15.139:0/3525371197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009520 con 0x7fa8cc109190 2023-10-08T13:33:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.096+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c970 tx=0x7fa8bc00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.097+0000 7fa8c2ffd700 1 -- 172.21.15.139:0/3525371197 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc004440 con 0x7fa8cc109190 2023-10-08T13:33:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.097+0000 7fa8c2ffd700 1 -- 172.21.15.139:0/3525371197 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8bc003b40 con 0x7fa8cc109190 2023-10-08T13:33:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.097+0000 7fa8c2ffd700 1 -- 172.21.15.139:0/3525371197 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc007bc0 con 0x7fa8cc109190 2023-10-08T13:33:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.097+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc1a5bb0 con 0x7fa8cc109190 2023-10-08T13:33:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.097+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1ae510 con 0x7fa8cc109190 2023-10-08T13:33:30.103 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:29 smithi155 ceph-mon[103467]: pgmap v481: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.100+0000 7fa8c2ffd700 1 -- 172.21.15.139:0/3525371197 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa8bc003cb0 con 0x7fa8cc109190 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.101+0000 7fa8c2ffd700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 0x7fa8b80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.101+0000 7fa8d1032700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 0x7fa8b80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.101+0000 7fa8c2ffd700 1 -- 172.21.15.139:0/3525371197 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa8bc0cd280 con 0x7fa8cc109190 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.101+0000 7fa8d1032700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 0x7fa8b80a3b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80098c0 tx=0x7fa8c8019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.101+0000 7fa8dfc80b80 1 Processor -- start 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 -- start start 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc73669880 0x55cc73669c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.110 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73663b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 0x55cc73664510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc735cc400 con 0x55cc7366a1a0 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc735bdbc0 con 0x55cc736640b0 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc735bb4e0 con 0x55cc73669880 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d1032700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73663b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d1032700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73663b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43002/0 (socket says 172.21.15.139:43002) 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d1032700 1 -- 172.21.15.139:0/3557996120 learned_addr learned my addr 172.21.15.139:0/3557996120 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 0x55cc73664510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc73669880 0x55cc73669c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 -- 172.21.15.139:0/3557996120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc73669880 msgr2=0x55cc73669c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc73669880 0x55cc73669c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 -- 172.21.15.139:0/3557996120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 msgr2=0x55cc73663b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73663b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.102+0000 7fa8d2034700 1 -- 172.21.15.139:0/3557996120 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc733e1d80 con 0x55cc736640b0 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.103+0000 7fa8d2034700 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 0x55cc73664510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009d40 tx=0x7fa8c40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525da525ba958a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.103+0000 7fa8b7fff700 1 -- 172.21.15.139:0/3557996120 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019070 con 0x55cc736640b0 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.103+0000 7fa8b7fff700 1 -- 172.21.15.139:0/3557996120 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c400f040 con 0x55cc736640b0 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.103+0000 7fa8b7fff700 1 -- 172.21.15.139:0/3557996120 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4015dd0 con 0x55cc736640b0 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.103+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3557996120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 msgr2=0x55cc73664510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 0x55cc73664510 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009d40 tx=0x7fa8c40091d0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3557996120 shutdown_connections 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc736640b0 0x55cc73664510 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc73669880 0x55cc73669c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3557996120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73663b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3557996120 >> 172.21.15.139:0/3557996120 conn(0x55cc735d8200 msgr2=0x55cc7365eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3557996120 shutdown_connections 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3557996120 wait complete. 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 -- start start 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 Processor -- start 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc73670190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc7366d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.104+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc735b6dd0 con 0x55cc7366a1a0 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc735536b0 con 0x55cc73669880 2023-10-08T13:33:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc73553350 con 0x55cc736640b0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 10 client.0 _ll_register_callbacks cb 0x55cc733b07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43010/0 (socket says 172.21.15.139:43010) 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d1032700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc7366d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 -- 172.21.15.139:0/713052309 learned_addr learned my addr 172.21.15.139:0/713052309 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d1833700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc73670190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 -- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 msgr2=0x55cc73670190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc73670190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 -- 172.21.15.139:0/713052309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 msgr2=0x55cc7366d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc7366d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 -- 172.21.15.139:0/713052309 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c40099a0 con 0x55cc7366a1a0 2023-10-08T13:33:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8d2034700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40167e0 tx=0x7fa8c4016810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c5fc8599770ffe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019040 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa8c4016e40 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc7357ee50 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c401f450 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.105+0000 7fa8dfc80b80 10 client.16968 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cc733cac00 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cc7357ee50 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa8c4005350 con 0x55cc7366a1a0 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 10 client.16968 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:30.115 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 10 client.16968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 20 client.16968 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc7367dbb0 0x55cc7367ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 4 client.16968 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc735afdb0 con 0x55cc7367dbb0 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8d1833700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc7367dbb0 0x55cc7367ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8b57fa700 10 client.16968 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.106+0000 7fa8d1833700 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc7367dbb0 0x55cc7367ffd0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c436c2d2bdaf97c server_cookie=c87f59509f8760eb in_seq=0 out_seq=0 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8b57fa700 1 -- 172.21.15.139:0/713052309 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc735afdb0 con 0x55cc7367dbb0 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8b57fa700 10 client.16968 handle_command_reply: tid=0 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 client.16968 shutdown 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 msgr2=0x55cc7366db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40167e0 tx=0x7fa8c4016810 comp rx=0 tx=0).stop 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 shutdown_connections 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc7366db00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc73670190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc7367dbb0 0x55cc7367ffd0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/713052309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc7366d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8b57fa700 0 client.16968 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 >> 172.21.15.139:0/713052309 conn(0x55cc735d8200 msgr2=0x55cc7365e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 shutdown_connections 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.107+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/713052309 wait complete. 2023-10-08T13:33:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.108+0000 7fa8dfc80b80 20 client.16968 trim_cache size 0 max 16384 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.124+0000 7fa8dfc80b80 1 Processor -- start 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.124+0000 7fa8dfc80b80 1 -- start start 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73668d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc7366a1a0 0x55cc73674c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc734378c0 con 0x55cc736640b0 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc7366ea50 con 0x55cc73669880 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc736694b0 con 0x55cc7366a1a0 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43014/0 (socket says 172.21.15.139:43014) 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 -- 172.21.15.139:0/3996441744 learned_addr learned my addr 172.21.15.139:0/3996441744 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d2034700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc7366a1a0 0x55cc73674c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1032700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73668d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 -- 172.21.15.139:0/3996441744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc7366a1a0 msgr2=0x55cc73674c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc7366a1a0 0x55cc73674c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 -- 172.21.15.139:0/3996441744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 msgr2=0x55cc73668d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73668d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 -- 172.21.15.139:0/3996441744 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc734081f0 con 0x55cc736640b0 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1032700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73668d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:33:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.125+0000 7fa8d1833700 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00cfd0 tx=0x7fa8bc01b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119cfb216be30fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8c0d82700 1 -- 172.21.15.139:0/3996441744 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc09e070 con 0x55cc736640b0 2023-10-08T13:33:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8c0d82700 1 -- 172.21.15.139:0/3996441744 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8bc0a22b0 con 0x55cc736640b0 2023-10-08T13:33:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8c0d82700 1 -- 172.21.15.139:0/3996441744 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc099410 con 0x55cc736640b0 2023-10-08T13:33:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3996441744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 msgr2=0x55cc7367ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00cfd0 tx=0x7fa8bc01b040 comp rx=0 tx=0).stop 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3996441744 shutdown_connections 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc7366a1a0 0x55cc73674c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc736640b0 0x55cc7367ffa0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/3996441744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73668d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3996441744 >> 172.21.15.139:0/3996441744 conn(0x55cc735d8200 msgr2=0x55cc73679370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3996441744 shutdown_connections 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.126+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/3996441744 wait complete. 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 -- start start 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 Processor -- start 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc736666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73666c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc73665990 con 0x55cc7366a1a0 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc73665b00 con 0x55cc73669880 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc73665cc0 con 0x55cc736640b0 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8dfc80b80 10 client.0 _ll_register_callbacks cb 0x55cc733b07a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8d1032700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73666c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8d1032700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73666c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33310/0 (socket says 172.21.15.139:33310) 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.127+0000 7fa8d2034700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43024/0 (socket says 172.21.15.139:43024) 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d1032700 1 -- 172.21.15.139:0/1162941068 learned_addr learned my addr 172.21.15.139:0/1162941068 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d1833700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc736666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 -- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 msgr2=0x55cc736666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc736666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 -- 172.21.15.139:0/1162941068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 msgr2=0x55cc73666c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73666c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 -- 172.21.15.139:0/1162941068 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1ae510 con 0x55cc7366a1a0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8d2034700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057b0 tx=0x7fa8c4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f418ba2137a21e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4019050 con 0x55cc7366a1a0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fa8c4005410 con 0x55cc7366a1a0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8c400f040 con 0x55cc7366a1a0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c4007b80 con 0x55cc7366a1a0 2023-10-08T13:33:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8dfc80b80 10 client.16974 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55cc733e0250 con 0x55cc7366a1a0 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.128+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c400f040 con 0x55cc7366a1a0 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa8c4015ca0 con 0x55cc7366a1a0 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 10 client.16974 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 10 client.16974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 20 client.16974 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc736dae40 0x55cc736dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 4 client.16974 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc735afad0 con 0x55cc736dae40 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8d1833700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc736dae40 0x55cc736dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8b57fa700 10 client.16974 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.129+0000 7fa8d1833700 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc736dae40 0x55cc736dd230 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bf45aab1f0a6397 server_cookie=13b68392981655b8 in_seq=0 out_seq=0 2023-10-08T13:33:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.167+0000 7fa8b57fa700 1 -- 172.21.15.139:0/1162941068 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc735afad0 con 0x55cc736dae40 2023-10-08T13:33:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.167+0000 7fa8b57fa700 10 client.16974 handle_command_reply: tid=0 2023-10-08T13:33:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.167+0000 7fa8dfc80b80 1 client.16974 shutdown 2023-10-08T13:33:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.167+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 msgr2=0x55cc73665400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.167+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40057b0 tx=0x7fa8c4005b50 comp rx=0 tx=0).stop 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 shutdown_connections 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cc7366a1a0 0x55cc73665400 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cc736640b0 0x55cc736666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55cc736dae40 0x55cc736dd230 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 --2- 172.21.15.139:0/1162941068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cc73669880 0x55cc73666c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8b57fa700 0 client.16974 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 >> 172.21.15.139:0/1162941068 conn(0x55cc735d8200 msgr2=0x55cc73668c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 shutdown_connections 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 1 -- 172.21.15.139:0/1162941068 wait complete. 2023-10-08T13:33:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8dfc80b80 20 client.16974 trim_cache size 0 max 16384 2023-10-08T13:33:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:33:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:33:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:33:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:33:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 msgr2=0x7fa8b80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 0x7fa8b80a3b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80098c0 tx=0x7fa8c8019040 comp rx=0 tx=0).stop 2023-10-08T13:33:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 msgr2=0x7fa8cc1a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c970 tx=0x7fa8bc00cc80 comp rx=0 tx=0).stop 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 shutdown_connections 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa8b80a1670 0x7fa8b80a3b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8cc112740 0x7fa8cc1a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8cc109190 0x7fa8cc1a1770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 --2- 172.21.15.139:0/3525371197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8cc109ab0 0x7fa8cc1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 >> 172.21.15.139:0/3525371197 conn(0x7fa8cc06b7c0 msgr2=0x7fa8cc1157d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.168+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 shutdown_connections 2023-10-08T13:33:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:30.169+0000 7fa8d3a97700 1 -- 172.21.15.139:0/3525371197 wait complete. 2023-10-08T13:33:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:29 smithi139 ceph-mon[99506]: pgmap v481: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2023-10-08T13:33:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:29 smithi187 ceph-mon[104336]: pgmap v481: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 1.6 MiB/s wr, 615 op/s 2023-10-08T13:33:30.827 INFO:tasks.workunit.client.0.smithi139.stdout:40000 copy from 0x98ca82 to 0x993e9d, (0x741b bytes) at 0xfd3925 2023-10-08T13:33:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:31 smithi155 ceph-mon[103467]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 562 op/s 2023-10-08T13:33:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:31 smithi139 ceph-mon[99506]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 562 op/s 2023-10-08T13:33:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:31 smithi187 ceph-mon[104336]: pgmap v482: 129 pgs: 129 active+clean; 110 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 1.4 MiB/s wr, 562 op/s 2023-10-08T13:33:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:33 smithi155 ceph-mon[103467]: pgmap v483: 129 pgs: 129 active+clean; 99 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.8 MiB/s wr, 683 op/s 2023-10-08T13:33:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:33 smithi139 ceph-mon[99506]: pgmap v483: 129 pgs: 129 active+clean; 99 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.8 MiB/s wr, 683 op/s 2023-10-08T13:33:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:33 smithi187 ceph-mon[104336]: pgmap v483: 129 pgs: 129 active+clean; 99 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 MiB/s rd, 1.8 MiB/s wr, 683 op/s 2023-10-08T13:33:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:35 smithi155 ceph-mon[103467]: pgmap v484: 129 pgs: 129 active+clean; 96 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.5 MiB/s wr, 550 op/s 2023-10-08T13:33:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:35 smithi139 ceph-mon[99506]: pgmap v484: 129 pgs: 129 active+clean; 96 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.5 MiB/s wr, 550 op/s 2023-10-08T13:33:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:35 smithi187 ceph-mon[104336]: pgmap v484: 129 pgs: 129 active+clean; 96 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 1.5 MiB/s wr, 550 op/s 2023-10-08T13:33:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:37 smithi155 ceph-mon[103467]: pgmap v485: 129 pgs: 129 active+clean; 107 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.8 MiB/s wr, 671 op/s 2023-10-08T13:33:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:37 smithi139 ceph-mon[99506]: pgmap v485: 129 pgs: 129 active+clean; 107 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.8 MiB/s wr, 671 op/s 2023-10-08T13:33:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:37 smithi187 ceph-mon[104336]: pgmap v485: 129 pgs: 129 active+clean; 107 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 1.8 MiB/s wr, 671 op/s 2023-10-08T13:33:39.156 INFO:tasks.workunit.client.0.smithi139.stdout:truncating to largest ever: 0x63ff6b1 2023-10-08T13:33:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:39 smithi155 ceph-mon[103467]: pgmap v486: 129 pgs: 129 active+clean; 111 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.6 MiB/s wr, 584 op/s 2023-10-08T13:33:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:39 smithi139 ceph-mon[99506]: pgmap v486: 129 pgs: 129 active+clean; 111 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.6 MiB/s wr, 584 op/s 2023-10-08T13:33:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:39 smithi187 ceph-mon[104336]: pgmap v486: 129 pgs: 129 active+clean; 111 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.6 MiB/s wr, 584 op/s 2023-10-08T13:33:40.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:33:40.761 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- 172.21.15.139:0/3189316939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 msgr2=0x7f3bb80ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/3189316939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb80ffac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009990 tx=0x7f3ba8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- 172.21.15.139:0/3189316939 shutdown_connections 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/3189316939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8100000 0x7f3bb810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/3189316939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8105630 0x7f3bb8105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/3189316939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb80ffac0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- 172.21.15.139:0/3189316939 >> 172.21.15.139:0/3189316939 conn(0x7f3bb8076790 msgr2=0x7f3bb8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- 172.21.15.139:0/3189316939 shutdown_connections 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- 172.21.15.139:0/3189316939 wait complete. 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 Processor -- start 2023-10-08T13:33:40.762 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.759+0000 7f3bc05b5700 1 -- start start 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8100000 0x7f3bb8101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8105630 0x7f3bb8101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a4f70 con 0x7f3bb80ff640 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a50e0 con 0x7f3bb8100000 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81a52a0 con 0x7f3bb8105630 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43034/0 (socket says 172.21.15.139:43034) 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 -- 172.21.15.139:0/2593963253 learned_addr learned my addr 172.21.15.139:0/2593963253 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8100000 0x7f3bb8101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbeb52700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8105630 0x7f3bb8101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 -- 172.21.15.139:0/2593963253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8105630 msgr2=0x7f3bb8101c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8105630 0x7f3bb8101c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 -- 172.21.15.139:0/2593963253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8100000 msgr2=0x7f3bb8101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8100000 0x7f3bb8101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 -- 172.21.15.139:0/2593963253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba80095f0 con 0x7f3bb80ff640 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e9a0 tx=0x7f3bb400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3baf7fe700 1 -- 172.21.15.139:0/2593963253 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4009790 con 0x7f3bb80ff640 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3baf7fe700 1 -- 172.21.15.139:0/2593963253 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb4010430 con 0x7f3bb80ff640 2023-10-08T13:33:40.764 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb81a5580 con 0x7f3bb80ff640 2023-10-08T13:33:40.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.760+0000 7f3baf7fe700 1 -- 172.21.15.139:0/2593963253 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4018680 con 0x7f3bb80ff640 2023-10-08T13:33:40.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.761+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb81a5a60 con 0x7f3bb80ff640 2023-10-08T13:33:40.765 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.763+0000 7f3baf7fe700 1 -- 172.21.15.139:0/2593963253 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f3bb40105a0 con 0x7f3bb80ff640 2023-10-08T13:33:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.764+0000 7f3baf7fe700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 0x7f3ba40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.764+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 0x7f3ba40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.764+0000 7f3baf7fe700 1 -- 172.21.15.139:0/2593963253 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3bb4014070 con 0x7f3bb80ff640 2023-10-08T13:33:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 0x7f3ba40a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b2e0 tx=0x7f3ba8005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.766 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 Processor -- start 2023-10-08T13:33:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 -- start start 2023-10-08T13:33:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1dda7a0 0x5630e1de5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1de5650 0x5630e1de7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1d43460 con 0x5630e1de5650 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1d34c20 con 0x5630e1dd9e80 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1d32540 con 0x5630e1dda7a0 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbeb52700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1de5650 0x5630e1de7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33330/0 (socket says 172.21.15.139:33330) 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbe351700 1 -- 172.21.15.139:0/2853422848 learned_addr learned my addr 172.21.15.139:0/2853422848 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.765+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1dda7a0 0x5630e1de5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 -- 172.21.15.139:0/2853422848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1dda7a0 msgr2=0x5630e1de5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1dda7a0 0x5630e1de5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 -- 172.21.15.139:0/2853422848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1de5650 msgr2=0x5630e1de7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1de5650 0x5630e1de7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 -- 172.21.15.139:0/2853422848 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e1b58de0 con 0x5630e1dd9e80 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400c2d0 tx=0x7f3bb4099c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be8e2f83d782a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bacff9700 1 -- 172.21.15.139:0/2853422848 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb409e390 con 0x5630e1dd9e80 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bacff9700 1 -- 172.21.15.139:0/2853422848 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb40a25d0 con 0x5630e1dd9e80 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.766+0000 7f3bacff9700 1 -- 172.21.15.139:0/2853422848 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb409a4a0 con 0x5630e1dd9e80 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2853422848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 msgr2=0x5630e1dda260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400c2d0 tx=0x7f3bb4099c20 comp rx=0 tx=0).stop 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2853422848 shutdown_connections 2023-10-08T13:33:40.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1de5650 0x5630e1de7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1dda260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2853422848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1dda7a0 0x5630e1de5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2853422848 >> 172.21.15.139:0/2853422848 conn(0x5630e1d4f260 msgr2=0x5630e1dd62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2853422848 shutdown_connections 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.767+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2853422848 wait complete. 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 -- start start 2023-10-08T13:33:40.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 Processor -- start 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1de2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1de2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1d2de30 con 0x5630e1dd9e80 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1cca710 con 0x5630e1dda7a0 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1cca3b0 con 0x5630e1de5650 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bcc79eb80 10 client.0 _ll_register_callbacks cb 0x5630e1b27800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bbdb50700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1de2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bbeb52700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1de2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.775 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bbdb50700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33338/0 (socket says 172.21.15.139:33338) 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.768+0000 7f3bbdb50700 1 -- 172.21.15.139:0/3004948173 learned_addr learned my addr 172.21.15.139:0/3004948173 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 -- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 msgr2=0x5630e1de2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1de2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 -- 172.21.15.139:0/3004948173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 msgr2=0x5630e1de2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1de2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 -- 172.21.15.139:0/3004948173 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb81a5a60 con 0x5630e1dda7a0 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009990 tx=0x7f3ba8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e6fc449ddc1f272 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3ba1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba800be80 con 0x5630e1dda7a0 2023-10-08T13:33:40.776 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630e1cf5eb0 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3ba8004e50 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba80397a0 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bcc79eb80 10 client.26408 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5630e1b41c60 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.769+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5630e1cf5eb0 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3ba802f070 con 0x5630e1dda7a0 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 10 client.26408 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 10 client.26408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 20 client.26408 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:40.777 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1df5210 0x5630e1df7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 4 client.26408 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630e1d26e10 con 0x5630e1df5210 2023-10-08T13:33:40.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.770+0000 7f3bbe351700 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1df5210 0x5630e1df7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.771+0000 7f3bbe351700 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1df5210 0x5630e1df7630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1085715e0f9631c5 server_cookie=531677d583d2400a in_seq=0 out_seq=0 2023-10-08T13:33:40.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.771+0000 7f3ba1ffb700 10 client.26408 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/3004948173 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5630e1d26e10 con 0x5630e1df5210 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3ba1ffb700 10 client.26408 handle_command_reply: tid=0 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 client.26408 shutdown 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 msgr2=0x5630e1de29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009990 tx=0x7f3ba8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 shutdown_connections 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1de2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1de2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1df5210 0x5630e1df7630 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.780 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/3004948173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de29c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3ba1ffb700 0 client.26408 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 >> 172.21.15.139:0/3004948173 conn(0x5630e1d4f260 msgr2=0x5630e1dd5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 shutdown_connections 2023-10-08T13:33:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/3004948173 wait complete. 2023-10-08T13:33:40.781 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.772+0000 7f3bcc79eb80 20 client.26408 trim_cache size 0 max 16384 2023-10-08T13:33:40.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.791+0000 7f3bcc79eb80 1 Processor -- start 2023-10-08T13:33:40.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.791+0000 7f3bcc79eb80 1 -- start start 2023-10-08T13:33:40.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1ddd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1bae920 con 0x5630e1dd9e80 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1dd2b10 con 0x5630e1dda7a0 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1dec760 con 0x5630e1de5650 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbdb50700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43056/0 (socket says 172.21.15.139:43056) 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 -- 172.21.15.139:0/2517335053 learned_addr learned my addr 172.21.15.139:0/2517335053 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbeb52700 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1ddd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 -- 172.21.15.139:0/2517335053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 msgr2=0x5630e1ddd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1ddd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 -- 172.21.15.139:0/2517335053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 msgr2=0x5630e1de2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 -- 172.21.15.139:0/2517335053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630e1b7f250 con 0x5630e1dd9e80 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4096740 tx=0x7f3bb4095f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892286714ec907df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.792+0000 7f3bad7fa700 1 -- 172.21.15.139:0/2517335053 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb409a010 con 0x5630e1dd9e80 2023-10-08T13:33:40.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bad7fa700 1 -- 172.21.15.139:0/2517335053 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb40985e0 con 0x5630e1dd9e80 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bad7fa700 1 -- 172.21.15.139:0/2517335053 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4099990 con 0x5630e1dd9e80 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2517335053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 msgr2=0x5630e1dec1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4096740 tx=0x7f3bb4095f10 comp rx=0 tx=0).stop 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2517335053 shutdown_connections 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1ddd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dd9e80 0x5630e1dec1a0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2517335053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dda7a0 0x5630e1de2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2517335053 >> 172.21.15.139:0/2517335053 conn(0x5630e1d4f260 msgr2=0x5630e1dd54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2517335053 shutdown_connections 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.793+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2517335053 wait complete. 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 -- start start 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 Processor -- start 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1debb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1dea180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1dea890 con 0x5630e1dda7a0 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1deaa00 con 0x5630e1dd9e80 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630e1deabc0 con 0x5630e1de5650 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bcc79eb80 10 client.0 _ll_register_callbacks cb 0x7f3ba800ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bbdb50700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bbe351700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1debb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bbdb50700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43064/0 (socket says 172.21.15.139:43064) 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bbdb50700 1 -- 172.21.15.139:0/2708587008 learned_addr learned my addr 172.21.15.139:0/2708587008 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.794+0000 7f3bbeb52700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1dea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 -- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 msgr2=0x5630e1dea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1dea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 -- 172.21.15.139:0/2708587008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 msgr2=0x5630e1debb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1debb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 -- 172.21.15.139:0/2708587008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630e1b41c60 con 0x5630e1dda7a0 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1debb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:40.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bbdb50700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005f50 tx=0x7f3ba8005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db670e9728586b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8042630 con 0x5630e1dda7a0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bb40a25d0 con 0x5630e1dda7a0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f3ba800fa80 con 0x5630e1dda7a0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba8004e50 con 0x5630e1dda7a0 2023-10-08T13:33:40.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 10 client.16992 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5630e1b58de0 con 0x5630e1dda7a0 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb40a25d0 con 0x5630e1dda7a0 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3ba8004500 con 0x5630e1dda7a0 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 10 client.16992 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 20 client.16992 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:40.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1e49db0 0x5630e1e4c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 4 client.16992 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.795+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630e1d26b30 con 0x5630e1e49db0 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1e49db0 0x5630e1e4c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3ba1ffb700 10 client.16992 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bbe351700 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1e49db0 0x5630e1e4c1d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3a2570c9f7b236 server_cookie=64f3dfc5fa1f29 in_seq=0 out_seq=0 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3ba1ffb700 1 -- 172.21.15.139:0/2708587008 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5630e1d26b30 con 0x5630e1e49db0 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3ba1ffb700 10 client.16992 handle_command_reply: tid=0 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 client.16992 shutdown 2023-10-08T13:33:40.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 msgr2=0x5630e1dec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005f50 tx=0x7f3ba8005690 comp rx=0 tx=0).stop 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 shutdown_connections 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630e1de5650 0x5630e1dea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5630e1e49db0 0x5630e1e4c1d0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5630e1dd9e80 0x5630e1debb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 --2- 172.21.15.139:0/2708587008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5630e1dda7a0 0x5630e1dec050 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3ba1ffb700 0 client.16992 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:40.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.796+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 >> 172.21.15.139:0/2708587008 conn(0x5630e1d4f260 msgr2=0x5630e1ddd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 shutdown_connections 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bcc79eb80 1 -- 172.21.15.139:0/2708587008 wait complete. 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bcc79eb80 20 client.16992 trim_cache size 0 max 16384 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:33:40.810 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:33:40.811 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 msgr2=0x7f3ba40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 0x7f3ba40a3ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b2e0 tx=0x7f3ba8005960 comp rx=0 tx=0).stop 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 msgr2=0x7f3bb81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400e9a0 tx=0x7f3bb400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 shutdown_connections 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f3ba40a15f0 0x7f3ba40a3ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bb8105630 0x7f3bb8101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bb80ff640 0x7f3bb81011f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 --2- 172.21.15.139:0/2593963253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb8100000 0x7f3bb8101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:40.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 >> 172.21.15.139:0/2593963253 conn(0x7f3bb8076790 msgr2=0x7f3bb8103490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:40.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 shutdown_connections 2023-10-08T13:33:40.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:33:40.797+0000 7f3bc05b5700 1 -- 172.21.15.139:0/2593963253 wait complete. 2023-10-08T13:33:40.815 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:33:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:41 smithi155 ceph-mon[103467]: pgmap v487: 129 pgs: 129 active+clean; 109 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.4 MiB/s wr, 540 op/s 2023-10-08T13:33:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:41 smithi139 ceph-mon[99506]: pgmap v487: 129 pgs: 129 active+clean; 109 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.4 MiB/s wr, 540 op/s 2023-10-08T13:33:41.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:41 smithi187 ceph-mon[104336]: pgmap v487: 129 pgs: 129 active+clean; 109 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 1.4 MiB/s wr, 540 op/s 2023-10-08T13:33:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 -- 172.21.15.139:0/937206646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2181056a0 msgr2=0x7fb218105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 --2- 172.21.15.139:0/937206646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2181056a0 0x7fb218105a80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb214009990 tx=0x7fb214009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 -- 172.21.15.139:0/937206646 shutdown_connections 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 --2- 172.21.15.139:0/937206646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180fffc0 0x7fb21810c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 --2- 172.21.15.139:0/937206646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2181056a0 0x7fb218105a80 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 --2- 172.21.15.139:0/937206646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2180ff600 0x7fb2180ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 -- 172.21.15.139:0/937206646 >> 172.21.15.139:0/937206646 conn(0x7fb2180fb0b0 msgr2=0x7fb2180fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 -- 172.21.15.139:0/937206646 shutdown_connections 2023-10-08T13:33:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.303+0000 7fb21fad2700 1 -- 172.21.15.139:0/937206646 wait complete. 2023-10-08T13:33:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 Processor -- start 2023-10-08T13:33:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 -- start start 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180ff600 0x7fb21819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 0x7fb21819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 0x7fb2181958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb218195f10 con 0x7fb2180fffc0 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb218196080 con 0x7fb2181056a0 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21fad2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb218196240 con 0x7fb2180ff600 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21d06d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 0x7fb21819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21e06f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 0x7fb2181958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21d06d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 0x7fb21819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43080/0 (socket says 172.21.15.139:43080) 2023-10-08T13:33:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21d06d700 1 -- 172.21.15.139:0/435822810 learned_addr learned my addr 172.21.15.139:0/435822810 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.304+0000 7fb21d86e700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180ff600 0x7fb21819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 -- 172.21.15.139:0/435822810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180ff600 msgr2=0x7fb21819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180ff600 0x7fb21819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 -- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 msgr2=0x7fb21819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 0x7fb21819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 -- 172.21.15.139:0/435822810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140095f0 con 0x7fb2181056a0 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21e06f700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 0x7fb2181958a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb21000efc0 tx=0x7fb21000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb20effd700 1 -- 172.21.15.139:0/435822810 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004bb0 con 0x7fb2181056a0 2023-10-08T13:33:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb20effd700 1 -- 172.21.15.139:0/435822810 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb210004d10 con 0x7fb2181056a0 2023-10-08T13:33:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb20effd700 1 -- 172.21.15.139:0/435822810 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210004280 con 0x7fb2181056a0 2023-10-08T13:33:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb218196520 con 0x7fb2181056a0 2023-10-08T13:33:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.305+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2180690b0 con 0x7fb2181056a0 2023-10-08T13:33:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.310+0000 7fb20effd700 1 -- 172.21.15.139:0/435822810 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb210003a00 con 0x7fb2181056a0 2023-10-08T13:33:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.310+0000 7fb22bcbbb80 1 Processor -- start 2023-10-08T13:33:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 -- start start 2023-10-08T13:33:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a47b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a48510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db29b0400 con 0x558db2a480b0 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db29a1bc0 con 0x558db2a4d880 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db299f4e0 con 0x558db2a4e1a0 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.311+0000 7fb21d06d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33370/0 (socket says 172.21.15.139:33370) 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 -- 172.21.15.139:0/1625115236 learned_addr learned my addr 172.21.15.139:0/1625115236 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a48510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 -- 172.21.15.139:0/1625115236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 msgr2=0x558db2a47b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a47b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 -- 172.21.15.139:0/1625115236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 msgr2=0x558db2a48510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a48510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.312+0000 7fb21d06d700 1 -- 172.21.15.139:0/1625115236 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558db27c5d80 con 0x558db2a4d880 2023-10-08T13:33:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb21d06d700 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2080046e0 tx=0x7fb208004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c10cf1816d5628cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb20effd700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 0x7fb2040b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb203fff700 1 -- 172.21.15.139:0/1625115236 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208004830 con 0x558db2a4d880 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb203fff700 1 -- 172.21.15.139:0/1625115236 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb208004e50 con 0x558db2a4d880 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb203fff700 1 -- 172.21.15.139:0/1625115236 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20801e3f0 con 0x558db2a4d880 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb21d86e700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 0x7fb2040b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.313+0000 7fb20effd700 1 -- 172.21.15.139:0/435822810 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb2100cd3e0 con 0x7fb2181056a0 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.314+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/1625115236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 msgr2=0x558db2a4dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.314+0000 7fb21d86e700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 0x7fb2040b4b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x558db2a4e600 tx=0x7fb21401e040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.314+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2080046e0 tx=0x7fb208004750 comp rx=0 tx=0).stop 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/1625115236 shutdown_connections 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a48510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a4dc60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/1625115236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a47b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/1625115236 >> 172.21.15.139:0/1625115236 conn(0x558db29bc200 msgr2=0x558db2a42b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/1625115236 shutdown_connections 2023-10-08T13:33:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.315+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/1625115236 wait complete. 2023-10-08T13:33:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.316+0000 7fb22bcbbb80 1 -- start start 2023-10-08T13:33:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.316+0000 7fb22bcbbb80 1 Processor -- start 2023-10-08T13:33:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.316+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.316+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a51b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.316+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4e1a0 0x558db2a52060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db299add0 con 0x558db2a480b0 2023-10-08T13:33:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db29376b0 con 0x558db2a4e1a0 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2937350 con 0x558db2a4d880 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb22bcbbb80 10 client.0 _ll_register_callbacks cb 0x558db27947a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43090/0 (socket says 172.21.15.139:43090) 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 -- 172.21.15.139:0/4274838539 learned_addr learned my addr 172.21.15.139:0/4274838539 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21e06f700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4e1a0 0x558db2a52060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 -- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 msgr2=0x558db2a51b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a51b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 -- 172.21.15.139:0/4274838539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4e1a0 msgr2=0x558db2a52060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4e1a0 0x558db2a52060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 -- 172.21.15.139:0/4274838539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb208019040 con 0x558db2a480b0 2023-10-08T13:33:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb21d86e700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb214015000 tx=0x7fb214009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1a46a605c0b4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb2017fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214004b20 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb214004c80 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.317+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558db2962e50 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb214004e40 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 10 client.17004 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558db27aec00 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558db2962e50 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb21400f580 con 0x558db2a480b0 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 10 client.17004 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 20 client.17004 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2a61e30 0x558db2a64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 4 client.17004 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558db2993db0 con 0x558db2a61e30 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.318+0000 7fb21d06d700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2a61e30 0x558db2a64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.319+0000 7fb21d06d700 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2a61e30 0x558db2a64250 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee77ced43d7b472 server_cookie=bed9809f77b39d8f in_seq=0 out_seq=0 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.319+0000 7fb2017fa700 10 client.17004 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.319+0000 7fb2017fa700 1 -- 172.21.15.139:0/4274838539 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558db2993db0 con 0x558db2a61e30 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.319+0000 7fb2017fa700 10 client.17004 handle_command_reply: tid=0 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.319+0000 7fb22bcbbb80 1 client.17004 shutdown 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 msgr2=0x558db2a515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb214015000 tx=0x7fb214009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 shutdown_connections 2023-10-08T13:33:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2a61e30 0x558db2a64250 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4e1a0 0x558db2a52060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a515e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb2017fa700 0 client.17004 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4274838539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a51b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 >> 172.21.15.139:0/4274838539 conn(0x558db29bc200 msgr2=0x558db2a42010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 shutdown_connections 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4274838539 wait complete. 2023-10-08T13:33:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.320+0000 7fb22bcbbb80 20 client.17004 trim_cache size 0 max 16384 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 Processor -- start 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 -- start start 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a42790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a42cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a4b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db281b8c0 con 0x558db2a480b0 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2a4f640 con 0x558db2a4d880 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.338+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2a3d2b0 con 0x558db2a4e1a0 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a42790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a42790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43098/0 (socket says 172.21.15.139:43098) 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d86e700 1 -- 172.21.15.139:0/700131528 learned_addr learned my addr 172.21.15.139:0/700131528 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a42cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 -- 172.21.15.139:0/700131528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 msgr2=0x558db2a4b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a4b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 -- 172.21.15.139:0/700131528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 msgr2=0x558db2a42790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a42790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 -- 172.21.15.139:0/700131528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558db27ec1f0 con 0x558db2a4d880 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.339+0000 7fb21d06d700 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a42cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb208009f70 tx=0x7fb2080095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7010483039a72911 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.340+0000 7fb20cd82700 1 -- 172.21.15.139:0/700131528 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208023040 con 0x558db2a4d880 2023-10-08T13:33:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.340+0000 7fb20cd82700 1 -- 172.21.15.139:0/700131528 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb20802c070 con 0x558db2a4d880 2023-10-08T13:33:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.340+0000 7fb20cd82700 1 -- 172.21.15.139:0/700131528 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2080044e0 con 0x558db2a4d880 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.341+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/700131528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 msgr2=0x558db2a42cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.341+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a42cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb208009f70 tx=0x7fb2080095c0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/700131528 shutdown_connections 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4e1a0 0x558db2a4b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a480b0 0x558db2a42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/700131528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a4d880 0x558db2a42cd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.348 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/700131528 >> 172.21.15.139:0/700131528 conn(0x558db29bc200 msgr2=0x558db2a48490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/700131528 shutdown_connections 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/700131528 wait complete. 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 -- start start 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.342+0000 7fb22bcbbb80 1 Processor -- start 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 0x558db2a56c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a57140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2ab4d60 con 0x558db2a4e1a0 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2ab4ea0 con 0x558db2a480b0 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db2ab5060 con 0x558db2a4d880 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 10 client.0 _ll_register_callbacks cb 0x7fb21400b750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:43.349 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 0x558db2a56c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43108/0 (socket says 172.21.15.139:43108) 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21d86e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 0x558db2a56c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33392/0 (socket says 172.21.15.139:33392) 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 -- 172.21.15.139:0/4065804808 learned_addr learned my addr 172.21.15.139:0/4065804808 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21d06d700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a57140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 -- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 msgr2=0x558db2a57140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a57140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 -- 172.21.15.139:0/4065804808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 msgr2=0x558db2a56c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 0x558db2a56c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 -- 172.21.15.139:0/4065804808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558db27c5d80 con 0x558db2a4e1a0 2023-10-08T13:33:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb21e06f700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb21000ef90 tx=0x7fb210099a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a8b6b6b845e4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb2017fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21009a4e0 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7fb21009a080 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.343+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb208004e50 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb21009e1d0 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 10 client.17010 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558db27c4250 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb208004e50 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb2100a1f80 con 0x558db2a4e1a0 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 10 client.17010 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 10 client.17010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 20 client.17010 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2ab6870 0x558db2ab8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 4 client.17010 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.344+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558db2993ad0 con 0x558db2ab6870 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.345+0000 7fb21d86e700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2ab6870 0x558db2ab8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.346+0000 7fb2017fa700 10 client.17010 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.346+0000 7fb21d86e700 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2ab6870 0x558db2ab8c60 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa5f5fdf2dc7450 server_cookie=3de161bf382c02a1 in_seq=0 out_seq=0 2023-10-08T13:33:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.368+0000 7fb2017fa700 1 -- 172.21.15.139:0/4065804808 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558db2993ad0 con 0x558db2ab6870 2023-10-08T13:33:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.368+0000 7fb2017fa700 10 client.17010 handle_command_reply: tid=0 2023-10-08T13:33:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.368+0000 7fb22bcbbb80 1 client.17010 shutdown 2023-10-08T13:33:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.368+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 msgr2=0x558db2a57680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.370 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.369+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb21000ef90 tx=0x7fb210099a50 comp rx=0 tx=0).stop 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 shutdown_connections 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558db2a4e1a0 0x558db2a57680 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x558db2ab6870 0x558db2ab8c60 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558db2a480b0 0x558db2a56c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 --2- 172.21.15.139:0/4065804808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558db2a4d880 0x558db2a57140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb2017fa700 0 client.17010 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 >> 172.21.15.139:0/4065804808 conn(0x558db29bc200 msgr2=0x558db2a4fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 shutdown_connections 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 1 -- 172.21.15.139:0/4065804808 wait complete. 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.371+0000 7fb22bcbbb80 20 client.17010 trim_cache size 0 max 16384 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:33:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:33:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 msgr2=0x7fb2040b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 0x7fb2040b4b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x558db2a4e600 tx=0x7fb21401e040 comp rx=0 tx=0).stop 2023-10-08T13:33:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 msgr2=0x7fb2181958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 0x7fb2181958a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb21000efc0 tx=0x7fb21000d3b0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 shutdown_connections 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2040b2680 0x7fb2040b4b40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2181056a0 0x7fb2181958a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2180ff600 0x7fb21819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 --2- 172.21.15.139:0/435822810 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2180fffc0 0x7fb21819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 >> 172.21.15.139:0/435822810 conn(0x7fb2180fb0b0 msgr2=0x7fb2180fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 shutdown_connections 2023-10-08T13:33:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:43.372+0000 7fb21fad2700 1 -- 172.21.15.139:0/435822810 wait complete. 2023-10-08T13:33:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:43 smithi155 ceph-mon[103467]: pgmap v488: 129 pgs: 129 active+clean; 106 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.7 MiB/s wr, 687 op/s 2023-10-08T13:33:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:43 smithi139 ceph-mon[99506]: pgmap v488: 129 pgs: 129 active+clean; 106 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.7 MiB/s wr, 687 op/s 2023-10-08T13:33:44.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:43 smithi187 ceph-mon[104336]: pgmap v488: 129 pgs: 129 active+clean; 106 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 1.7 MiB/s wr, 687 op/s 2023-10-08T13:33:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:45 smithi155 ceph-mon[103467]: pgmap v489: 129 pgs: 129 active+clean; 103 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 542 op/s 2023-10-08T13:33:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:45 smithi139 ceph-mon[99506]: pgmap v489: 129 pgs: 129 active+clean; 103 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 542 op/s 2023-10-08T13:33:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:45 smithi187 ceph-mon[104336]: pgmap v489: 129 pgs: 129 active+clean; 103 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 542 op/s 2023-10-08T13:33:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:47 smithi155 ceph-mon[103467]: pgmap v490: 129 pgs: 129 active+clean; 98 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 698 op/s 2023-10-08T13:33:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:47 smithi139 ceph-mon[99506]: pgmap v490: 129 pgs: 129 active+clean; 98 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 698 op/s 2023-10-08T13:33:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:47 smithi187 ceph-mon[104336]: pgmap v490: 129 pgs: 129 active+clean; 98 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 1.7 MiB/s wr, 698 op/s 2023-10-08T13:33:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:49 smithi155 ceph-mon[103467]: pgmap v491: 129 pgs: 129 active+clean; 101 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 586 op/s 2023-10-08T13:33:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:49 smithi139 ceph-mon[99506]: pgmap v491: 129 pgs: 129 active+clean; 101 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 586 op/s 2023-10-08T13:33:50.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:49 smithi187 ceph-mon[104336]: pgmap v491: 129 pgs: 129 active+clean; 101 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 1.3 MiB/s wr, 586 op/s 2023-10-08T13:33:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:51 smithi155 ceph-mon[103467]: pgmap v492: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 569 op/s 2023-10-08T13:33:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:51 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:33:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:51 smithi139 ceph-mon[99506]: pgmap v492: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 569 op/s 2023-10-08T13:33:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:51 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:33:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:51 smithi187 ceph-mon[104336]: pgmap v492: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 1.2 MiB/s wr, 569 op/s 2023-10-08T13:33:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:51 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:33:52.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:33:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:33:52.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:33:52.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:33:52.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:33:52.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:33:52.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:33:52.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:33:52.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:33:53.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:53 smithi155 ceph-mon[103467]: pgmap v493: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.6 MiB/s wr, 700 op/s 2023-10-08T13:33:53.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:53 smithi139 ceph-mon[99506]: pgmap v493: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.6 MiB/s wr, 700 op/s 2023-10-08T13:33:53.980 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:53 smithi187 ceph-mon[104336]: pgmap v493: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.6 MiB/s wr, 700 op/s 2023-10-08T13:33:54.230 INFO:tasks.workunit.client.0.smithi139.stdout:All 50000 operations completed A-OK! 2023-10-08T13:33:54.241 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-08T13:33:54.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-08T13:33:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:55 smithi155 ceph-mon[103467]: pgmap v494: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.2 MiB/s wr, 529 op/s 2023-10-08T13:33:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:55 smithi139 ceph-mon[99506]: pgmap v494: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.2 MiB/s wr, 529 op/s 2023-10-08T13:33:56.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:55 smithi187 ceph-mon[104336]: pgmap v494: 129 pgs: 129 active+clean; 97 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 1.2 MiB/s wr, 529 op/s 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 -- 172.21.15.139:0/926534831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1006e0 msgr2=0x7f174c100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 --2- 172.21.15.139:0/926534831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1006e0 0x7f174c100b60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1734009990 tx=0x7f1734009ca0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 -- 172.21.15.139:0/926534831 shutdown_connections 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 --2- 172.21.15.139:0/926534831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 0x7f174c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 --2- 172.21.15.139:0/926534831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1066f0 0x7f174c106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 --2- 172.21.15.139:0/926534831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1006e0 0x7f174c100b60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 -- 172.21.15.139:0/926534831 >> 172.21.15.139:0/926534831 conn(0x7f174c0fc1b0 msgr2=0x7f174c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 -- 172.21.15.139:0/926534831 shutdown_connections 2023-10-08T13:33:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.485+0000 7f17521be700 1 -- 172.21.15.139:0/926534831 wait complete. 2023-10-08T13:33:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 Processor -- start 2023-10-08T13:33:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 -- start start 2023-10-08T13:33:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 0x7f174c19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 0x7f174c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c197010 con 0x7f174c1066f0 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c197180 con 0x7f174c1006e0 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f17521be700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c197340 con 0x7f174c1010a0 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 0x7f174c19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43122/0 (socket says 172.21.15.139:43122) 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f174bfff700 1 -- 172.21.15.139:0/3751804989 learned_addr learned my addr 172.21.15.139:0/3751804989 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.486+0000 7f174affd700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 0x7f174c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 -- 172.21.15.139:0/3751804989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 msgr2=0x7f174c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 0x7f174c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 -- 172.21.15.139:0/3751804989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 msgr2=0x7f174c19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 0x7f174c19c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 -- 172.21.15.139:0/3751804989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340095f0 con 0x7f174c1066f0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 0x7f174c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f174bfff700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f174400ef30 tx=0x7f174400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f1748ff9700 1 -- 172.21.15.139:0/3751804989 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744018070 con 0x7f174c1066f0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c1975c0 con 0x7f174c1066f0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f1748ff9700 1 -- 172.21.15.139:0/3751804989 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174400f040 con 0x7f174c1066f0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f1748ff9700 1 -- 172.21.15.139:0/3751804989 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400cd00 con 0x7f174c1066f0 2023-10-08T13:33:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.487+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c1a3870 con 0x7f174c1066f0 2023-10-08T13:33:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.489+0000 7f1748ff9700 1 -- 172.21.15.139:0/3751804989 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f1744003a00 con 0x7f174c1066f0 2023-10-08T13:33:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.489+0000 7f1748ff9700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 0x7f17380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.490+0000 7f1748ff9700 1 -- 172.21.15.139:0/3751804989 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f17440ccfc0 con 0x7f174c1066f0 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.490+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 0x7f17380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.490+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 0x7f17380a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f173c009fd0 tx=0x7f173c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.490+0000 7f175e3a7b80 1 Processor -- start 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.490+0000 7f175e3a7b80 1 -- start start 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 0x560cda353550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 0x560cda3582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda2b7400 con 0x560cda353a90 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda2a8bc0 con 0x560cda357e60 2023-10-08T13:33:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda2a64e0 con 0x560cda353170 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 0x560cda353550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174bfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 0x560cda3582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43128/0 (socket says 172.21.15.139:43128) 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 -- 172.21.15.139:0/1850562999 learned_addr learned my addr 172.21.15.139:0/1850562999 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 0x560cda353550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42842/0 (socket says 172.21.15.139:42842) 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 -- 172.21.15.139:0/1850562999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 msgr2=0x560cda353550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 0x560cda353550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 -- 172.21.15.139:0/1850562999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 msgr2=0x560cda3582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 0x560cda3582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 -- 172.21.15.139:0/1850562999 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cda0ccd80 con 0x560cda353a90 2023-10-08T13:33:56.499 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174bfff700 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 0x560cda3582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f174affd700 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1734005ec0 tx=0x7f1734005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3c8ead5a85bff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f1741ffb700 1 -- 172.21.15.139:0/1850562999 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173401d070 con 0x560cda353a90 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f1741ffb700 1 -- 172.21.15.139:0/1850562999 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f173401e040 con 0x560cda353a90 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.491+0000 7f1741ffb700 1 -- 172.21.15.139:0/1850562999 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734004880 con 0x560cda353a90 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- 172.21.15.139:0/1850562999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 msgr2=0x560cda357920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1734005ec0 tx=0x7f1734005ef0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- 172.21.15.139:0/1850562999 shutdown_connections 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda357e60 0x560cda3582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353170 0x560cda353550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/1850562999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353a90 0x560cda357920 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- 172.21.15.139:0/1850562999 >> 172.21.15.139:0/1850562999 conn(0x560cda2c3200 msgr2=0x560cda349b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- 172.21.15.139:0/1850562999 shutdown_connections 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- 172.21.15.139:0/1850562999 wait complete. 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.492+0000 7f175e3a7b80 1 -- start start 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 Processor -- start 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353a90 0x560cda35c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda357e60 0x560cda35cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda2a1dd0 con 0x560cda353170 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda23e6b0 con 0x560cda353a90 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda23e350 con 0x560cda357e60 2023-10-08T13:33:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f175e3a7b80 10 client.0 _ll_register_callbacks cb 0x560cda09b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43132/0 (socket says 172.21.15.139:43132) 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174affd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353a90 0x560cda35c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 -- 172.21.15.139:0/3319040629 learned_addr learned my addr 172.21.15.139:0/3319040629 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174bfff700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda357e60 0x560cda35cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 -- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda357e60 msgr2=0x560cda35cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda357e60 0x560cda35cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 -- 172.21.15.139:0/3319040629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353a90 msgr2=0x560cda35c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353a90 0x560cda35c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 -- 172.21.15.139:0/3319040629 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440b9040 con 0x560cda353170 2023-10-08T13:33:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f174b7fe700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f173c00ec90 tx=0x7f173c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80a33c72b757c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.493+0000 7f172affd700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c004520 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f173c01f890 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cda269e50 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f173c01fa50 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 10 client.17022 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x7f174c10deb0 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560cda269e50 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f173c00f3c0 con 0x560cda353170 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 10 client.17022 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 10 client.17022 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 20 client.17022 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda36cfd0 0x560cda36f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 4 client.17022 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cda29adb0 con 0x560cda36cfd0 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.494+0000 7f174affd700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda36cfd0 0x560cda36f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f172affd700 10 client.17022 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f174affd700 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda36cfd0 0x560cda36f3f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61147ff58d69494a server_cookie=6116874397bc4fd8 in_seq=0 out_seq=0 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f172affd700 1 -- 172.21.15.139:0/3319040629 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560cda29adb0 con 0x560cda36cfd0 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f172affd700 10 client.17022 handle_command_reply: tid=0 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f175e3a7b80 1 client.17022 shutdown 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 msgr2=0x560cda35f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.504 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.495+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f173c00ec90 tx=0x7f173c0047c0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 shutdown_connections 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda357e60 0x560cda35cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda353170 0x560cda35f5d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda36cfd0 0x560cda36f3f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/3319040629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353a90 0x560cda35c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f172affd700 0 client.17022 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 >> 172.21.15.139:0/3319040629 conn(0x560cda2c3200 msgr2=0x560cda34db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 shutdown_connections 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 1 -- 172.21.15.139:0/3319040629 wait complete. 2023-10-08T13:33:56.505 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.496+0000 7f175e3a7b80 20 client.17022 trim_cache size 0 max 16384 2023-10-08T13:33:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.510+0000 7f175e3a7b80 1 Processor -- start 2023-10-08T13:33:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.510+0000 7f175e3a7b80 1 -- start start 2023-10-08T13:33:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda35c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda359250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda1228c0 con 0x560cda357e60 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda34b350 con 0x560cda353170 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda35dec0 con 0x560cda353a90 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda35c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43144/0 (socket says 172.21.15.139:43144) 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 -- 172.21.15.139:0/2835363063 learned_addr learned my addr 172.21.15.139:0/2835363063 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda359250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 -- 172.21.15.139:0/2835363063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 msgr2=0x560cda359250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda359250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 -- 172.21.15.139:0/2835363063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 msgr2=0x560cda35c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda35c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 -- 172.21.15.139:0/2835363063 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cda0b5c00 con 0x560cda357e60 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f174bfff700 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f17440ca480 tx=0x7f1744095910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ab69a790a09b24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f17427fc700 1 -- 172.21.15.139:0/2835363063 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174401b320 con 0x560cda357e60 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f17427fc700 1 -- 172.21.15.139:0/2835363063 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174409a3f0 con 0x560cda357e60 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.511+0000 7f17427fc700 1 -- 172.21.15.139:0/2835363063 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440a1ff0 con 0x560cda357e60 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2835363063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 msgr2=0x560cda349790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f17440ca480 tx=0x7f1744095910 comp rx=0 tx=0).stop 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2835363063 shutdown_connections 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda349790 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.515 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda35c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2835363063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda359250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2835363063 >> 172.21.15.139:0/2835363063 conn(0x560cda2c3200 msgr2=0x560cda35c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2835363063 shutdown_connections 2023-10-08T13:33:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2835363063 wait complete. 2023-10-08T13:33:56.516 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.512+0000 7f175e3a7b80 1 -- start start 2023-10-08T13:33:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 Processor -- start 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda3641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda358f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda348960 con 0x560cda357e60 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda348ad0 con 0x560cda353170 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cda348c90 con 0x560cda353a90 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f175e3a7b80 10 client.0 _ll_register_callbacks cb 0x7f173c00ea50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda3641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda358f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43150/0 (socket says 172.21.15.139:43150) 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174b7fe700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda3641e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33434/0 (socket says 172.21.15.139:33434) 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174bfff700 1 -- 172.21.15.139:0/2581185311 learned_addr learned my addr 172.21.15.139:0/2581185311 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 -- 172.21.15.139:0/2581185311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 msgr2=0x560cda3641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda3641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 -- 172.21.15.139:0/2581185311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 msgr2=0x560cda3594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 -- 172.21.15.139:0/2581185311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c1a3870 con 0x560cda353a90 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174bfff700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f174affd700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda358f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1734005320 tx=0x7f173400b310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76363ca2ecb6b19e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:33:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.513+0000 7f172affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734032050 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f173401e040 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 9351+0+0 (secure 0 0 0) 0x7f1734034430 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f173401d040 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 10 client.26443 fetch_fsmap learned FSMap version 39 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x560cda0f31f0 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f173401e040 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 39) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1734034930 con 0x560cda353a90 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 10 client.26443 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 10 client.26443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 20 client.26443 populate_metadata read hostname 'smithi139' 2023-10-08T13:33:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda3c1740 0x560cda3c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:33:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 4 client.26443 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:33:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560cda29aad0 con 0x560cda3c1740 2023-10-08T13:33:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.514+0000 7f174b7fe700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda3c1740 0x560cda3c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:33:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.515+0000 7f172affd700 10 client.26443 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:56.522 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.515+0000 7f174b7fe700 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda3c1740 0x560cda3c3b30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0ce7f46c6e8e2b server_cookie=2b61e91a24965f50 in_seq=0 out_seq=0 2023-10-08T13:33:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.542+0000 7f172affd700 1 -- 172.21.15.139:0/2581185311 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560cda29aad0 con 0x560cda3c1740 2023-10-08T13:33:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.542+0000 7f172affd700 10 client.26443 handle_command_reply: tid=0 2023-10-08T13:33:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.542+0000 7f175e3a7b80 1 client.26443 shutdown 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 msgr2=0x560cda358f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda358f60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1734005320 tx=0x7f173400b310 comp rx=0 tx=0).stop 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 shutdown_connections 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560cda357e60 0x560cda3594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x560cda3c1740 0x560cda3c3b30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560cda353170 0x560cda3641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 --2- 172.21.15.139:0/2581185311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560cda353a90 0x560cda358f60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f172affd700 0 client.26443 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 >> 172.21.15.139:0/2581185311 conn(0x560cda2c3200 msgr2=0x560cda356f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 shutdown_connections 2023-10-08T13:33:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 1 -- 172.21.15.139:0/2581185311 wait complete. 2023-10-08T13:33:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f175e3a7b80 20 client.26443 trim_cache size 0 max 16384 2023-10-08T13:33:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:33:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:33:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:33:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 msgr2=0x7f17380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 0x7f17380a3ab0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f173c009fd0 tx=0x7f173c009260 comp rx=0 tx=0).stop 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 msgr2=0x7f174c1969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.543+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f174400ef30 tx=0x7f174400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 shutdown_connections 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f17380a15f0 0x7f17380a3ab0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f174c1066f0 0x7f174c1969b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174c1006e0 0x7f174c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 --2- 172.21.15.139:0/3751804989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f174c1010a0 0x7f174c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:33:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 >> 172.21.15.139:0/3751804989 conn(0x7f174c0fc1b0 msgr2=0x7f174c0fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:33:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 shutdown_connections 2023-10-08T13:33:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:33:56.544+0000 7f17521be700 1 -- 172.21.15.139:0/3751804989 wait complete. 2023-10-08T13:33:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:57 smithi155 ceph-mon[103467]: pgmap v495: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 624 op/s 2023-10-08T13:33:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:57 smithi139 ceph-mon[99506]: pgmap v495: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 624 op/s 2023-10-08T13:33:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:57 smithi187 ceph-mon[104336]: pgmap v495: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 1.6 MiB/s wr, 624 op/s 2023-10-08T13:33:59.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:58 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:33:59.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:58 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:33:59.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:58 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:33:59.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:58 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:33:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:58 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:33:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:58 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:00.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:33:59 smithi155 ceph-mon[103467]: pgmap v496: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2023-10-08T13:34:00.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:33:59 smithi139 ceph-mon[99506]: pgmap v496: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2023-10-08T13:34:00.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:33:59 smithi187 ceph-mon[104336]: pgmap v496: 129 pgs: 129 active+clean; 100 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 1.2 MiB/s wr, 467 op/s 2023-10-08T13:34:01.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:00 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:01.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:00 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:01.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:00 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:01 smithi155 ceph-mon[103467]: pgmap v497: 129 pgs: 129 active+clean; 102 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.3 MiB/s wr, 446 op/s 2023-10-08T13:34:02.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:01 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:02.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:01 smithi139 ceph-mon[99506]: pgmap v497: 129 pgs: 129 active+clean; 102 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.3 MiB/s wr, 446 op/s 2023-10-08T13:34:02.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:01 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:01 smithi187 ceph-mon[104336]: pgmap v497: 129 pgs: 129 active+clean; 102 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.3 MiB/s wr, 446 op/s 2023-10-08T13:34:02.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:01 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:03 smithi155 ceph-mon[103467]: pgmap v498: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2023-10-08T13:34:04.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:03 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:03 smithi139 ceph-mon[99506]: pgmap v498: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2023-10-08T13:34:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:03 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:03 smithi187 ceph-mon[104336]: pgmap v498: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 1.6 MiB/s wr, 496 op/s 2023-10-08T13:34:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:03 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:05.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:04 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:05.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:04 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:05.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:04 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:06.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:05 smithi139 ceph-mon[99506]: scrub summary: active paths [/] 2023-10-08T13:34:06.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:05 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:06.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:05 smithi139 ceph-mon[99506]: pgmap v499: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T13:34:06.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:05 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:05 smithi187 ceph-mon[104336]: scrub summary: active paths [/] 2023-10-08T13:34:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:05 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:05 smithi187 ceph-mon[104336]: pgmap v499: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T13:34:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:05 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:06.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:05 smithi155 ceph-mon[103467]: scrub summary: active paths [/] 2023-10-08T13:34:06.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:05 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:06.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:05 smithi155 ceph-mon[103467]: pgmap v499: 129 pgs: 129 active+clean; 103 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 349 op/s 2023-10-08T13:34:06.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:05 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:07.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:06 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:07.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:06 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:07.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:06 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:07 smithi139 ceph-mon[99506]: pgmap v500: 129 pgs: 129 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 433 op/s 2023-10-08T13:34:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:07 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:07 smithi139 ceph-mon[99506]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:34:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:07 smithi187 ceph-mon[104336]: pgmap v500: 129 pgs: 129 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 433 op/s 2023-10-08T13:34:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:07 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:08.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:07 smithi187 ceph-mon[104336]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:34:08.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:07 smithi155 ceph-mon[103467]: pgmap v500: 129 pgs: 129 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.7 MiB/s wr, 433 op/s 2023-10-08T13:34:08.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:07 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:07 smithi155 ceph-mon[103467]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T13:34:09.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:08 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:08 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:09.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:08 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 -- 172.21.15.139:0/1837314470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c4100d50 msgr2=0x7f92c4104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 --2- 172.21.15.139:0/1837314470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c4100d50 0x7f92c4104280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009990 tx=0x7f92b8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 -- 172.21.15.139:0/1837314470 shutdown_connections 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 --2- 172.21.15.139:0/1837314470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c41049b0 0x7f92c410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 --2- 172.21.15.139:0/1837314470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 0x7f92c4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 --2- 172.21.15.139:0/1837314470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c4100d50 0x7f92c4104280 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 -- 172.21.15.139:0/1837314470 >> 172.21.15.139:0/1837314470 conn(0x7f92c4074970 msgr2=0x7f92c4074d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 -- 172.21.15.139:0/1837314470 shutdown_connections 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.655+0000 7f92c981e700 1 -- 172.21.15.139:0/1837314470 wait complete. 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 Processor -- start 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 -- start start 2023-10-08T13:34:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 0x7f92c4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c419d6a0 0x7f92c419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c419e120 con 0x7f92c41049b0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c419e290 con 0x7f92c419d6a0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c981e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c419e450 con 0x7f92c41003a0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43164/0 (socket says 172.21.15.139:43164) 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 -- 172.21.15.139:0/1120757741 learned_addr learned my addr 172.21.15.139:0/1120757741 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c37fe700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c419d6a0 0x7f92c419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 0x7f92c4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 -- 172.21.15.139:0/1120757741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 msgr2=0x7f92c4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 0x7f92c4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 -- 172.21.15.139:0/1120757741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c419d6a0 msgr2=0x7f92c419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c419d6a0 0x7f92c419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.656+0000 7f92c27fc700 1 -- 172.21.15.139:0/1120757741 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80095f0 con 0x7f92c41049b0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f92b80059d0 tx=0x7f92b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c881c700 1 -- 172.21.15.139:0/1120757741 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b801d070 con 0x7f92c41049b0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c881c700 1 -- 172.21.15.139:0/1120757741 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92b8022470 con 0x7f92c41049b0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c41a5950 con 0x7f92c41049b0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c881c700 1 -- 172.21.15.139:0/1120757741 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8017650 con 0x7f92c41049b0 2023-10-08T13:34:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.657+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c41a5d70 con 0x7f92c41049b0 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.659+0000 7f92c881c700 1 -- 172.21.15.139:0/1120757741 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f92b80225e0 con 0x7f92c41049b0 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.659+0000 7f92c881c700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 0x7f92ac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.659+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 0x7f92ac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.659+0000 7f92c881c700 1 -- 172.21.15.139:0/1120757741 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f92b80ce750 con 0x7f92c41049b0 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.660+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 0x7f92ac0a3ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009c60 tx=0x7f92b4009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.660+0000 7f92d5a07b80 1 Processor -- start 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.660+0000 7f92d5a07b80 1 -- start start 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3b63400 con 0x556fb3c00880 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3b54bc0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3b524e0 con 0x556fb3c011a0 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43170/0 (socket says 172.21.15.139:43170) 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c2ffd700 1 -- 172.21.15.139:0/122932402 learned_addr learned my addr 172.21.15.139:0/122932402 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c37fe700 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 -- 172.21.15.139:0/122932402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 msgr2=0x556fb3bfb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 -- 172.21.15.139:0/122932402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 msgr2=0x556fb3c00c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 -- 172.21.15.139:0/122932402 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb3978d80 con 0x556fb3c011a0 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92c27fc700 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfab70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cbab0 tx=0x7f92b8009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7c743bf5750fb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92a9ffb700 1 -- 172.21.15.139:0/122932402 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b809ad30 con 0x556fb3c011a0 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92a9ffb700 1 -- 172.21.15.139:0/122932402 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92b809bad0 con 0x556fb3c011a0 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.661+0000 7f92a9ffb700 1 -- 172.21.15.139:0/122932402 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b809f340 con 0x556fb3c011a0 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- 172.21.15.139:0/122932402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 msgr2=0x556fb3bfab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfab70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cbab0 tx=0x7f92b8009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- 172.21.15.139:0/122932402 shutdown_connections 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3c00c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/122932402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfab70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- 172.21.15.139:0/122932402 >> 172.21.15.139:0/122932402 conn(0x556fb3b6f200 msgr2=0x556fb3bf5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- 172.21.15.139:0/122932402 shutdown_connections 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- 172.21.15.139:0/122932402 wait complete. 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.662+0000 7f92d5a07b80 1 -- start start 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 Processor -- start 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c00880 0x556fb3c04420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3c04ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3b4ddd0 con 0x556fb3c011a0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3aea6b0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3aea350 con 0x556fb3c00880 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92d5a07b80 10 client.0 _ll_register_callbacks cb 0x556fb39477a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33464/0 (socket says 172.21.15.139:33464) 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 -- 172.21.15.139:0/3147811655 learned_addr learned my addr 172.21.15.139:0/3147811655 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c27fc700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c00880 0x556fb3c04420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c37fe700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3c04ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 -- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c00880 msgr2=0x556fb3c04420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c00880 0x556fb3c04420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 -- 172.21.15.139:0/3147811655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 msgr2=0x556fb3c04ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3c04ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.663+0000 7f92c2ffd700 1 -- 172.21.15.139:0/3147811655 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b4017070 con 0x556fb3bfb0b0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005c50 tx=0x7f92b40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511becddbc496bf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4022070 con 0x556fb3bfb0b0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fb3b15e50 con 0x556fb3bfb0b0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f92b401d6e0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b401d8a0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 10 client.26462 fetch_fsmap learned FSMap version 49 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f92c41a5d70 con 0x556fb3bfb0b0 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556fb3b15e50 con 0x556fb3bfb0b0 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 49) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f92b4027b50 con 0x556fb3bfb0b0 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 10 client.26462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 20 client.26462 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.664+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c149e0 0x556fb3c16e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.665+0000 7f92d5a07b80 4 client.26462 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.665+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fb3b46db0 con 0x556fb3c149e0 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.665+0000 7f92c27fc700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c149e0 0x556fb3c16e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.665+0000 7f92a2ffd700 10 client.26462 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.665+0000 7f92c27fc700 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c149e0 0x556fb3c16e00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371b460162b5bcc2 server_cookie=71b16b44a72ecc2a in_seq=0 out_seq=0 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92a2ffd700 1 -- 172.21.15.139:0/3147811655 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556fb3b46db0 con 0x556fb3c149e0 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92a2ffd700 10 client.26462 handle_command_reply: tid=0 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 client.26462 shutdown 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 msgr2=0x556fb3c07130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005c50 tx=0x7f92b40047c0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 shutdown_connections 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3c04ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c149e0 0x556fb3c16e00 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3c07130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/3147811655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c00880 0x556fb3c04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92a2ffd700 0 client.26462 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 >> 172.21.15.139:0/3147811655 conn(0x556fb3b6f200 msgr2=0x556fb3bf5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 shutdown_connections 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 1 -- 172.21.15.139:0/3147811655 wait complete. 2023-10-08T13:34:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.666+0000 7f92d5a07b80 20 client.26462 trim_cache size 0 max 16384 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.681+0000 7f92d5a07b80 1 Processor -- start 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.681+0000 7f92d5a07b80 1 -- start start 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3bf5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb39ce8c0 con 0x556fb3c011a0 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3c053d0 con 0x556fb3c00880 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3bf72d0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33474/0 (socket says 172.21.15.139:33474) 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 -- 172.21.15.139:0/1065835909 learned_addr learned my addr 172.21.15.139:0/1065835909 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c37fe700 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3bf5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 -- 172.21.15.139:0/1065835909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3bfb0b0 msgr2=0x556fb3bfab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 -- 172.21.15.139:0/1065835909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 msgr2=0x556fb3bf5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3bf5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 -- 172.21.15.139:0/1065835909 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fb3961c00 con 0x556fb3c00880 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92c27fc700 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cc0b0 tx=0x7f92b801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0cbdb4aac64b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.682+0000 7f92aa7fc700 1 -- 172.21.15.139:0/1065835909 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8097710 con 0x556fb3c00880 2023-10-08T13:34:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92aa7fc700 1 -- 172.21.15.139:0/1065835909 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92b809f520 con 0x556fb3c00880 2023-10-08T13:34:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92aa7fc700 1 -- 172.21.15.139:0/1065835909 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b809b630 con 0x556fb3c00880 2023-10-08T13:34:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 -- 172.21.15.139:0/1065835909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 msgr2=0x556fb3c0b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cc0b0 tx=0x7f92b801a040 comp rx=0 tx=0).stop 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 -- 172.21.15.139:0/1065835909 shutdown_connections 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c011a0 0x556fb3bf5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/1065835909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3c00880 0x556fb3c0b950 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 -- 172.21.15.139:0/1065835909 >> 172.21.15.139:0/1065835909 conn(0x556fb3b6f200 msgr2=0x556fb3bfb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 -- 172.21.15.139:0/1065835909 shutdown_connections 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.683+0000 7f92d5a07b80 1 -- 172.21.15.139:0/1065835909 wait complete. 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 -- start start 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 Processor -- start 2023-10-08T13:34:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3bfc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3bfd4c0 con 0x556fb3c00880 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3bfd630 con 0x556fb3bfb0b0 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fb3bfd7f0 con 0x556fb3c011a0 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92d5a07b80 10 client.0 _ll_register_callbacks cb 0x7f92b40044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3bfc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c2ffd700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33478/0 (socket says 172.21.15.139:33478) 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c27fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3bfc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43192/0 (socket says 172.21.15.139:43192) 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c2ffd700 1 -- 172.21.15.139:0/2491435690 learned_addr learned my addr 172.21.15.139:0/2491435690 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.684+0000 7f92c37fe700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 -- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 msgr2=0x556fb3bfcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 -- 172.21.15.139:0/2491435690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 msgr2=0x556fb3bfc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3bfc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 -- 172.21.15.139:0/2491435690 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fb3978d80 con 0x556fb3bfb0b0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c37fe700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92c2ffd700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92b401c5b0 tx=0x7f92b401cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2b364afd4639d4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4022040 con 0x556fb3bfb0b0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7f92b4009e50 con 0x556fb3bfb0b0 2023-10-08T13:34:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92b809bad0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b40092d0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92d5a07b80 10 client.26468 fetch_fsmap learned FSMap version 49 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.685+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x556fb399f1f0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92b809bad0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 49) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f92b40278f0 con 0x556fb3bfb0b0 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 10 client.26468 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 10 client.26468 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 20 client.26468 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c69450 0x556fb3c6b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 4 client.26468 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-10-08T13:34:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556fb3b46ad0 con 0x556fb3c69450 2023-10-08T13:34:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.686+0000 7f92c27fc700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c69450 0x556fb3c6b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.687+0000 7f92a2ffd700 10 client.26468 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.687+0000 7f92c27fc700 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c69450 0x556fb3c6b870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3899e1fd1b4da9a server_cookie=f920d8cbd272e0a6 in_seq=0 out_seq=0 2023-10-08T13:34:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92a2ffd700 1 -- 172.21.15.139:0/2491435690 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556fb3b46ad0 con 0x556fb3c69450 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92a2ffd700 10 client.26468 handle_command_reply: tid=0 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 client.26468 shutdown 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 msgr2=0x556fb3bfc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92b401c5b0 tx=0x7f92b401cf90 comp rx=0 tx=0).stop 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 shutdown_connections 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556fb3c011a0 0x556fb3bfcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x556fb3c69450 0x556fb3c6b870 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fb3bfb0b0 0x556fb3bfc2c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92a2ffd700 0 client.26468 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 --2- 172.21.15.139:0/2491435690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fb3c00880 0x556fb3bfc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 >> 172.21.15.139:0/2491435690 conn(0x556fb3b6f200 msgr2=0x556fb3c02c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 shutdown_connections 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.718+0000 7f92d5a07b80 1 -- 172.21.15.139:0/2491435690 wait complete. 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92d5a07b80 20 client.26468 trim_cache size 0 max 16384 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:{ 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "message": "", 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout: "return_code": 0 2023-10-08T13:34:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stdout:} 2023-10-08T13:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 msgr2=0x7f92ac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 0x7f92ac0a3ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009c60 tx=0x7f92b4009260 comp rx=0 tx=0).stop 2023-10-08T13:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 msgr2=0x7f92c4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f92b80059d0 tx=0x7f92b8004730 comp rx=0 tx=0).stop 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 shutdown_connections 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f92ac0a15f0 0x7f92ac0a3ab0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92c419d6a0 0x7f92c419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92c41003a0 0x7f92c4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 --2- 172.21.15.139:0/1120757741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92c41049b0 0x7f92c4199300 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.719+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 >> 172.21.15.139:0/1120757741 conn(0x7f92c4074970 msgr2=0x7f92c410ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.720+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 shutdown_connections 2023-10-08T13:34:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi139.front.sepia.ceph.com.smithi139.stderr:2023-10-08T13:34:09.720+0000 7f92c981e700 1 -- 172.21.15.139:0/1120757741 wait complete. 2023-10-08T13:34:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:09 smithi139 ceph-mon[99506]: pgmap v502: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2023-10-08T13:34:10.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:09 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:09 smithi187 ceph-mon[104336]: pgmap v502: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2023-10-08T13:34:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:09 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:10.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:09 smithi155 ceph-mon[103467]: pgmap v502: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 110 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 406 op/s 2023-10-08T13:34:10.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:09 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:10.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:34:10.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 -- 172.21.15.139:0/1835543326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109ab0 msgr2=0x7eff8c112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:10.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 --2- 172.21.15.139:0/1835543326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109ab0 0x7eff8c112200 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7eff80009990 tx=0x7eff80009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 -- 172.21.15.139:0/1835543326 shutdown_connections 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 --2- 172.21.15.139:0/1835543326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c112740 0x7eff8c114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 --2- 172.21.15.139:0/1835543326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c109190 0x7eff8c109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 --2- 172.21.15.139:0/1835543326 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109ab0 0x7eff8c112200 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.979+0000 7eff90ccc700 1 -- 172.21.15.139:0/1835543326 >> 172.21.15.139:0/1835543326 conn(0x7eff8c06bc80 msgr2=0x7eff8c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:10.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.980+0000 7eff90ccc700 1 -- 172.21.15.139:0/1835543326 shutdown_connections 2023-10-08T13:34:10.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.982+0000 7eff90ccc700 1 -- 172.21.15.139:0/1835543326 wait complete. 2023-10-08T13:34:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 Processor -- start 2023-10-08T13:34:10.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 -- start start 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109190 0x7eff8c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c109ab0 0x7eff8c10e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1b1be0 con 0x7eff8c109190 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1b1d20 con 0x7eff8c109ab0 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.983+0000 7eff90ccc700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1b1eb0 con 0x7eff8c112740 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42920/0 (socket says 172.21.15.139:42920) 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 -- 172.21.15.139:0/3627356921 learned_addr learned my addr 172.21.15.139:0/3627356921 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff89d9b700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c109ab0 0x7eff8c10e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.985 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8a59c700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109190 0x7eff8c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 -- 172.21.15.139:0/3627356921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c109ab0 msgr2=0x7eff8c10e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c109ab0 0x7eff8c10e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 -- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109190 msgr2=0x7eff8c10e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109190 0x7eff8c10e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 -- 172.21.15.139:0/3627356921 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800095f0 con 0x7eff8c112740 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff8401ff70 tx=0x7eff8400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff7b7fe700 1 -- 172.21.15.139:0/3627356921 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840092e0 con 0x7eff8c112740 2023-10-08T13:34:10.986 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff7b7fe700 1 -- 172.21.15.139:0/3627356921 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff84004bb0 con 0x7eff8c112740 2023-10-08T13:34:10.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.984+0000 7eff7b7fe700 1 -- 172.21.15.139:0/3627356921 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84004020 con 0x7eff8c112740 2023-10-08T13:34:10.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.985+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c1a13e0 con 0x7eff8c112740 2023-10-08T13:34:10.987 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.985+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c1a1870 con 0x7eff8c112740 2023-10-08T13:34:10.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.990+0000 7eff7b7fe700 1 -- 172.21.15.139:0/3627356921 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7eff84004d20 con 0x7eff8c112740 2023-10-08T13:34:10.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.991+0000 7eff9ceb5b80 1 Processor -- start 2023-10-08T13:34:10.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.991+0000 7eff7b7fe700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 0x7eff740a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.991+0000 7eff7b7fe700 1 -- 172.21.15.139:0/3627356921 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7eff840de020 con 0x7eff8c112740 2023-10-08T13:34:10.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.991+0000 7eff89d9b700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 0x7eff740a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 -- start start 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f549a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f4a5460 con 0x55833f53be80 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f496c20 con 0x55833f547650 2023-10-08T13:34:10.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f494540 con 0x55833f53c7a0 2023-10-08T13:34:10.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.992+0000 7eff89d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.993 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42932/0 (socket says 172.21.15.139:42932) 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 -- 172.21.15.139:0/2280488648 learned_addr learned my addr 172.21.15.139:0/2280488648 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f549a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 0x7eff740a3bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff8000b2e0 tx=0x7eff80005300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 -- 172.21.15.139:0/2280488648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 msgr2=0x55833f549a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f549a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 -- 172.21.15.139:0/2280488648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 msgr2=0x55833f53c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 -- 172.21.15.139:0/2280488648 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55833f2bade0 con 0x55833f53c7a0 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f549a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:10.994 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.993+0000 7eff89d9b700 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff80009990 tx=0x7eff80028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb4611cf7d64b8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.994+0000 7eff78ff9700 1 -- 172.21.15.139:0/2280488648 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80004840 con 0x55833f53c7a0 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.994+0000 7eff78ff9700 1 -- 172.21.15.139:0/2280488648 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff8001e040 con 0x55833f53c7a0 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.994+0000 7eff78ff9700 1 -- 172.21.15.139:0/2280488648 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8002fd00 con 0x55833f53c7a0 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2280488648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 msgr2=0x55833f547110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff80009990 tx=0x7eff80028000 comp rx=0 tx=0).stop 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2280488648 shutdown_connections 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f549a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2280488648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f547110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2280488648 >> 172.21.15.139:0/2280488648 conn(0x55833f4b1260 msgr2=0x55833f5382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2280488648 shutdown_connections 2023-10-08T13:34:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.995+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2280488648 wait complete. 2023-10-08T13:34:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 -- start start 2023-10-08T13:34:10.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 Processor -- start 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f5470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f544380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f48fe30 con 0x55833f53be80 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f42c710 con 0x55833f547650 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f42c3b0 con 0x55833f53c7a0 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.996+0000 7eff9ceb5b80 10 client.0 _ll_register_callbacks cb 0x55833f289800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:33508/0 (socket says 172.21.15.139:33508) 2023-10-08T13:34:10.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 -- 172.21.15.139:0/2936339760 learned_addr learned my addr 172.21.15.139:0/2936339760 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 -- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 msgr2=0x55833f544380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f544380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 -- 172.21.15.139:0/2936339760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 msgr2=0x55833f5470b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f5470b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.997+0000 7eff8ad9d700 1 -- 172.21.15.139:0/2936339760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c108240 con 0x55833f547650 2023-10-08T13:34:10.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.999+0000 7eff8ad9d700 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c6f0 tx=0x7eff840db880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ec5c86b1abc5963 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:10.999+0000 7eff71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2023-10-08T13:34:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.000+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840c2070 con 0x55833f547650 2023-10-08T13:34:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.000+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7eff84095040 con 0x55833f547650 2023-10-08T13:34:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.000+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55833f457eb0 con 0x55833f547650 2023-10-08T13:34:11.000 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.000+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff840aed00 con 0x55833f547650 2023-10-08T13:34:11.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.002+0000 7eff9ceb5b80 10 client.26480 fetch_fsmap learned FSMap version 51 2023-10-08T13:34:11.002 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.002+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55833f2a3c60 con 0x55833f547650 2023-10-08T13:34:11.003 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.003+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff8408d020 con 0x55833f547650 2023-10-08T13:34:11.006 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.006+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 51) v1 ==== 7958+0+0 (secure 0 0 0) 0x7eff840b2ab0 con 0x55833f547650 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.006+0000 7eff9ceb5b80 10 client.26480 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.006+0000 7eff9ceb5b80 10 client.26480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.006+0000 7eff9ceb5b80 20 client.26480 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.007+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f557090 0x55833f5594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.007+0000 7eff9ceb5b80 4 client.26480 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:11.007 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.007+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55833f488e10 con 0x55833f557090 2023-10-08T13:34:11.008 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.008+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f557090 0x55833f5594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:11.008 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.008+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f557090 0x55833f5594b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9778304c49b4079 server_cookie=c8852b8e1bcb9f38 in_seq=0 out_seq=0 2023-10-08T13:34:11.008 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.008+0000 7eff71ffb700 10 client.26480 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.013+0000 7eff71ffb700 1 -- 172.21.15.139:0/2936339760 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55833f488e10 con 0x55833f557090 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.013+0000 7eff71ffb700 10 client.26480 handle_command_reply: tid=0 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.013+0000 7eff9ceb5b80 1 client.26480 shutdown 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 msgr2=0x55833f544ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c6f0 tx=0x7eff840db880 comp rx=0 tx=0).stop 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 shutdown_connections 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f557090 0x55833f5594b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f547650 0x55833f544ac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f5470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.015 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2936339760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f544380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 >> 172.21.15.139:0/2936339760 conn(0x55833f4b1260 msgr2=0x55833f537ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:11.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff71ffb700 0 client.26480 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:11.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 shutdown_connections 2023-10-08T13:34:11.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2936339760 wait complete. 2023-10-08T13:34:11.016 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.014+0000 7eff9ceb5b80 20 client.26480 trim_cache size 0 max 16384 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.043+0000 7eff9ceb5b80 1 Processor -- start 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.043+0000 7eff9ceb5b80 1 -- start start 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53c7a0 0x55833f54e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f547650 0x55833f543c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f310920 con 0x55833f53be80 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f53da00 con 0x55833f53c7a0 2023-10-08T13:34:11.044 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f545790 con 0x55833f547650 2023-10-08T13:34:11.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:11.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43224/0 (socket says 172.21.15.139:43224) 2023-10-08T13:34:11.045 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 -- 172.21.15.139:0/2447378211 learned_addr learned my addr 172.21.15.139:0/2447378211 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 -- 172.21.15.139:0/2447378211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f547650 msgr2=0x55833f543c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f547650 0x55833f543c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 -- 172.21.15.139:0/2447378211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53c7a0 msgr2=0x55833f54e040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53c7a0 0x55833f54e040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 -- 172.21.15.139:0/2447378211 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55833f2e1250 con 0x55833f53be80 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.044+0000 7eff8a59c700 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006d00 tx=0x7eff7c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d3d1dd5b9f5eac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.045+0000 7eff797fa700 1 -- 172.21.15.139:0/2447378211 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c016820 con 0x55833f53be80 2023-10-08T13:34:11.046 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.045+0000 7eff797fa700 1 -- 172.21.15.139:0/2447378211 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff7c01e070 con 0x55833f53be80 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.045+0000 7eff797fa700 1 -- 172.21.15.139:0/2447378211 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c022d70 con 0x55833f53be80 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2447378211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 msgr2=0x55833f53ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006d00 tx=0x7eff7c009190 comp rx=0 tx=0).stop 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2447378211 shutdown_connections 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f547650 0x55833f543c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f53be80 0x55833f53ed50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/2447378211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53c7a0 0x55833f54e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2447378211 >> 172.21.15.139:0/2447378211 conn(0x55833f4b1260 msgr2=0x55833f53f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:11.047 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2447378211 shutdown_connections 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/2447378211 wait complete. 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.046+0000 7eff9ceb5b80 1 -- start start 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 Processor -- start 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53be80 0x55833f54de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f547650 0x55833f54c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f54cdf0 con 0x55833f547650 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f54cf60 con 0x55833f53be80 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55833f5aaef0 con 0x55833f53c7a0 2023-10-08T13:34:11.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff9ceb5b80 10 client.0 _ll_register_callbacks cb 0x7eff840aa730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff89d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff89d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.139:42946/0 (socket says 172.21.15.139:42946) 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.047+0000 7eff89d9b700 1 -- 172.21.15.139:0/214116561 learned_addr learned my addr 172.21.15.139:0/214116561 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 -- 172.21.15.139:0/214116561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53be80 msgr2=0x55833f54de20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53be80 0x55833f54de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 -- 172.21.15.139:0/214116561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f547650 msgr2=0x55833f54c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f547650 0x55833f54c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 -- 172.21.15.139:0/214116561 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c009700 con 0x55833f53c7a0 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff89d9b700 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff800098e0 tx=0x7eff80004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274125eeaf3eae01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-10-08T13:34:11.050 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8002f470 con 0x55833f53c7a0 2023-10-08T13:34:11.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mon.1 v2:172.21.15.187:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 9527+0+0 (secure 0 0 0) 0x7eff8002f5d0 con 0x55833f53c7a0 2023-10-08T13:34:11.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.048+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff8001e040 con 0x55833f53c7a0 2023-10-08T13:34:11.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.049+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff8002f790 con 0x55833f53c7a0 2023-10-08T13:34:11.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.050+0000 7eff9ceb5b80 10 client.26470 fetch_fsmap learned FSMap version 51 2023-10-08T13:34:11.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.050+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55833f2b92b0 con 0x55833f53c7a0 2023-10-08T13:34:11.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mon.1 v2:172.21.15.187:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff8001e040 con 0x55833f53c7a0 2023-10-08T13:34:11.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mon.1 v2:172.21.15.187:3300/0 5 ==== fsmap(e 51) v1 ==== 7958+0+0 (secure 0 0 0) 0x7eff80039450 con 0x55833f53c7a0 2023-10-08T13:34:11.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 10 client.26470 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T13:34:11.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 10 client.26470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:11.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 20 client.26470 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:11.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f5ac140 0x55833f5ae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:11.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 4 client.26470 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:34:11.054 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.053+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55833f488b30 con 0x55833f5ac140 2023-10-08T13:34:11.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.055+0000 7eff8a59c700 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f5ac140 0x55833f5ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:11.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff71ffb700 10 client.26470 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:11.055 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff8a59c700 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f5ac140 0x55833f5ae560 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ec3fa468dbac9dd server_cookie=cfc1516efa90bcae in_seq=0 out_seq=0 2023-10-08T13:34:11.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff71ffb700 1 -- 172.21.15.139:0/214116561 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55833f488b30 con 0x55833f5ac140 2023-10-08T13:34:11.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff71ffb700 10 client.26470 handle_command_reply: tid=0 2023-10-08T13:34:11.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff9ceb5b80 1 client.26470 shutdown 2023-10-08T13:34:11.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 msgr2=0x55833f54c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:11.056 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.056+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff800098e0 tx=0x7eff80004b40 comp rx=0 tx=0).stop 2023-10-08T13:34:11.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 shutdown_connections 2023-10-08T13:34:11.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55833f547650 0x55833f54c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55833f5ac140 0x55833f5ae560 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.059 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55833f53be80 0x55833f54de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 --2- 172.21.15.139:0/214116561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55833f53c7a0 0x55833f54c1c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff71ffb700 0 client.26470 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:11.060 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 >> 172.21.15.139:0/214116561 conn(0x55833f4b1260 msgr2=0x55833f537bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:11.062 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.059+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 shutdown_connections 2023-10-08T13:34:11.062 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.060+0000 7eff9ceb5b80 1 -- 172.21.15.139:0/214116561 wait complete. 2023-10-08T13:34:11.063 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:34:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T13:34:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": { 2023-10-08T13:34:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "6c16b2ee-27ab-4997-ae12-cfba13953147": { 2023-10-08T13:34:11.063 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/", 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "tag": "6c16b2ee-27ab-4997-ae12-cfba13953147", 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: "options": "recursive,force" 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:34:11.064 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.063+0000 7eff9ceb5b80 20 client.26470 trim_cache size 0 max 16384 2023-10-08T13:34:11.065 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 msgr2=0x7eff740a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 0x7eff740a3bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff8000b2e0 tx=0x7eff80005300 comp rx=0 tx=0).stop 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 msgr2=0x7eff8c10ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff8401ff70 tx=0x7eff8400c3a0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 shutdown_connections 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7eff740a16f0 0x7eff740a3bb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff8c112740 0x7eff8c10ed30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7eff8c109190 0x7eff8c10e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.066 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 --2- 172.21.15.139:0/3627356921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff8c109ab0 0x7eff8c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:11.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 >> 172.21.15.139:0/3627356921 conn(0x7eff8c06bc80 msgr2=0x7eff8c112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:11.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 shutdown_connections 2023-10-08T13:34:11.067 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:11.066+0000 7eff90ccc700 1 -- 172.21.15.139:0/3627356921 wait complete. 2023-10-08T13:34:11.085 INFO:tasks.cephfs.filesystem:scrub status for tag:6c16b2ee-27ab-4997-ae12-cfba13953147 - {'path': '/', 'tag': '6c16b2ee-27ab-4997-ae12-cfba13953147', 'options': 'recursive,force'} 2023-10-08T13:34:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:10 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:10 smithi139 ceph-mon[99506]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:10 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:10 smithi187 ceph-mon[104336]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:11.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:10 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:11.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:10 smithi155 ceph-mon[103467]: scrub summary: idle+waiting paths [/] 2023-10-08T13:34:11.701 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2023-10-08T13:34:11.702 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-08T13:34:12.058 DEBUG:teuthology.parallel:result is None 2023-10-08T13:34:12.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T13:34:12.119 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-08T13:34:12.119 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-10-08T13:34:12.130 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:34:12.140 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-08T13:34:12.191 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-08T13:34:12.191 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T13:34:12.191 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:34:12.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-08T13:34:12.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:11 smithi139 ceph-mon[99506]: pgmap v503: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 112 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 446 op/s 2023-10-08T13:34:12.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:11 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:12.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-08T13:34:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:11 smithi187 ceph-mon[104336]: pgmap v503: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 112 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 446 op/s 2023-10-08T13:34:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:11 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:12.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:11 smithi155 ceph-mon[103467]: pgmap v503: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 112 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 446 op/s 2023-10-08T13:34:12.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:11 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:13 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:13.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:13 smithi155 ceph-mon[103467]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 405 op/s 2023-10-08T13:34:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:13 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:13.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:13 smithi139 ceph-mon[99506]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 405 op/s 2023-10-08T13:34:13.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:13 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:34:13.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:13 smithi187 ceph-mon[104336]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 119 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 405 op/s 2023-10-08T13:34:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:15 smithi155 ceph-mon[103467]: pgmap v505: 129 pgs: 129 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2023-10-08T13:34:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:15 smithi155 ceph-mon[103467]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:34:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:15 smithi139 ceph-mon[99506]: pgmap v505: 129 pgs: 129 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2023-10-08T13:34:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:15 smithi139 ceph-mon[99506]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:34:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:15 smithi187 ceph-mon[104336]: pgmap v505: 129 pgs: 129 active+clean; 117 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 400 op/s 2023-10-08T13:34:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:15 smithi187 ceph-mon[104336]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T13:34:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:17 smithi155 ceph-mon[103467]: pgmap v507: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 813 KiB/s wr, 323 op/s 2023-10-08T13:34:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:17 smithi139 ceph-mon[99506]: pgmap v507: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 813 KiB/s wr, 323 op/s 2023-10-08T13:34:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:17 smithi187 ceph-mon[104336]: pgmap v507: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 813 KiB/s wr, 323 op/s 2023-10-08T13:34:20.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:19 smithi155 ceph-mon[103467]: pgmap v508: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 797 KiB/s wr, 251 op/s 2023-10-08T13:34:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:19 smithi139 ceph-mon[99506]: pgmap v508: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 797 KiB/s wr, 251 op/s 2023-10-08T13:34:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:19 smithi187 ceph-mon[104336]: pgmap v508: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 797 KiB/s wr, 251 op/s 2023-10-08T13:34:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:21 smithi155 ceph-mon[103467]: pgmap v509: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 664 KiB/s wr, 164 op/s 2023-10-08T13:34:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:21 smithi139 ceph-mon[99506]: pgmap v509: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 664 KiB/s wr, 164 op/s 2023-10-08T13:34:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:21 smithi187 ceph-mon[104336]: pgmap v509: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 664 KiB/s wr, 164 op/s 2023-10-08T13:34:22.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:22 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:34:22.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:22 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:34:22.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:22 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:34:22.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:22 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:34:22.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:22 smithi155 ceph-mon[103467]: scrub summary: idle 2023-10-08T13:34:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:22 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:34:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:22 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:34:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:22 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:34:22.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:22 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:34:22.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:22 smithi139 ceph-mon[99506]: scrub summary: idle 2023-10-08T13:34:22.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:22 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:34:22.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:22 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:34:22.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:22 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:34:22.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:22 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:34:22.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:22 smithi187 ceph-mon[104336]: scrub summary: idle 2023-10-08T13:34:23.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:23 smithi155 ceph-mon[103467]: pgmap v510: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 315 KiB/s wr, 91 op/s 2023-10-08T13:34:23.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:23 smithi139 ceph-mon[99506]: pgmap v510: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 315 KiB/s wr, 91 op/s 2023-10-08T13:34:23.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:23 smithi187 ceph-mon[104336]: pgmap v510: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 315 KiB/s wr, 91 op/s 2023-10-08T13:34:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:25 smithi155 ceph-mon[103467]: pgmap v511: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 57 op/s 2023-10-08T13:34:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:25 smithi139 ceph-mon[99506]: pgmap v511: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 57 op/s 2023-10-08T13:34:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:25 smithi187 ceph-mon[104336]: pgmap v511: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 305 KiB/s wr, 57 op/s 2023-10-08T13:34:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:27 smithi155 ceph-mon[103467]: pgmap v512: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-10-08T13:34:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:27 smithi139 ceph-mon[99506]: pgmap v512: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-10-08T13:34:28.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:27 smithi187 ceph-mon[104336]: pgmap v512: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 26 op/s 2023-10-08T13:34:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:29 smithi155 ceph-mon[103467]: pgmap v513: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2023-10-08T13:34:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:29 smithi139 ceph-mon[99506]: pgmap v513: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2023-10-08T13:34:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:29 smithi187 ceph-mon[104336]: pgmap v513: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 14 op/s 2023-10-08T13:34:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:31 smithi155 ceph-mon[103467]: pgmap v514: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:34:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:31 smithi139 ceph-mon[99506]: pgmap v514: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:34:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:31 smithi187 ceph-mon[104336]: pgmap v514: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2023-10-08T13:34:34.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:33 smithi155 ceph-mon[103467]: pgmap v515: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2023-10-08T13:34:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:33 smithi139 ceph-mon[99506]: pgmap v515: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2023-10-08T13:34:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:33 smithi187 ceph-mon[104336]: pgmap v515: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 13 op/s 2023-10-08T13:34:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:35 smithi155 ceph-mon[103467]: pgmap v516: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2023-10-08T13:34:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:35 smithi139 ceph-mon[99506]: pgmap v516: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2023-10-08T13:34:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:35 smithi187 ceph-mon[104336]: pgmap v516: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 KiB/s wr, 11 op/s 2023-10-08T13:34:38.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:37 smithi155 ceph-mon[103467]: pgmap v517: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2023-10-08T13:34:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:37 smithi139 ceph-mon[99506]: pgmap v517: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2023-10-08T13:34:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:37 smithi187 ceph-mon[104336]: pgmap v517: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 KiB/s wr, 12 op/s 2023-10-08T13:34:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:39 smithi155 ceph-mon[103467]: pgmap v518: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2023-10-08T13:34:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:39 smithi139 ceph-mon[99506]: pgmap v518: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2023-10-08T13:34:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:39 smithi187 ceph-mon[104336]: pgmap v518: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2023-10-08T13:34:41.086 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T13:34:41.222 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- 172.21.15.139:0/3155500159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19800ffdd0 msgr2=0x7f1980100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 --2- 172.21.15.139:0/3155500159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19800ffdd0 0x7f1980100250 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1970009990 tx=0x7f1970009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- 172.21.15.139:0/3155500159 shutdown_connections 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 --2- 172.21.15.139:0/3155500159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1980100790 0x7f198010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 --2- 172.21.15.139:0/3155500159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 0x7f19801049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 --2- 172.21.15.139:0/3155500159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f19800ffdd0 0x7f1980100250 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- 172.21.15.139:0/3155500159 >> 172.21.15.139:0/3155500159 conn(0x7f1980075c20 msgr2=0x7f19800fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- 172.21.15.139:0/3155500159 shutdown_connections 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- 172.21.15.139:0/3155500159 wait complete. 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 Processor -- start 2023-10-08T13:34:41.223 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.221+0000 7f19866b0700 1 -- start start 2023-10-08T13:34:41.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19800ffdd0 0x7f1980197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 0x7f19801984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801a2d00 con 0x7f1980100790 2023-10-08T13:34:41.225 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801a2e70 con 0x7f1980104610 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f19866b0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19801a3030 con 0x7f19800ffdd0 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43244/0 (socket says 172.21.15.139:43244) 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 -- 172.21.15.139:0/2181875671 learned_addr learned my addr 172.21.15.139:0/2181875671 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f1984c4d700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 0x7f19801984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197ffff700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19800ffdd0 0x7f1980197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 -- 172.21.15.139:0/2181875671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19800ffdd0 msgr2=0x7f1980197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19800ffdd0 0x7f1980197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 -- 172.21.15.139:0/2181875671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 msgr2=0x7f19801984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 0x7f19801984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.226 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.222+0000 7f197f7fe700 1 -- 172.21.15.139:0/2181875671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700095f0 con 0x7f1980100790 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f197f7fe700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f197000b2e0 tx=0x7f1970004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f197d7fa700 1 -- 172.21.15.139:0/2181875671 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197001d070 con 0x7f1980100790 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f197d7fa700 1 -- 172.21.15.139:0/2181875671 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1970021410 con 0x7f1980100790 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19801a32b0 con 0x7f1980100790 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f197d7fa700 1 -- 172.21.15.139:0/2181875671 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970017650 con 0x7f1980100790 2023-10-08T13:34:41.227 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.223+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19801a36d0 con 0x7f1980100790 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.225+0000 7f197d7fa700 1 -- 172.21.15.139:0/2181875671 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f1970021580 con 0x7f1980100790 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.225+0000 7f197d7fa700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 0x7f19680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.225+0000 7f197ffff700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 0x7f19680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.225+0000 7f197d7fa700 1 -- 172.21.15.139:0/2181875671 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f19700ce6d0 con 0x7f1980100790 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f197ffff700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 0x7f19680a3ab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1974009c60 tx=0x7f1974009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 Processor -- start 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 -- start start 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79be80 0x55632f79c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 0x55632f7a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f705460 con 0x55632f7a7650 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f6f6c20 con 0x55632f79c7a0 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.226+0000 7f1992899b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f6f4540 con 0x55632f79be80 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43254/0 (socket says 172.21.15.139:43254) 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 -- 172.21.15.139:0/1300460995 learned_addr learned my addr 172.21.15.139:0/1300460995 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f197ffff700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79be80 0x55632f79c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 0x55632f7a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 -- 172.21.15.139:0/1300460995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79be80 msgr2=0x55632f79c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79be80 0x55632f79c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 -- 172.21.15.139:0/1300460995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 msgr2=0x55632f7a7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 0x55632f7a7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 -- 172.21.15.139:0/1300460995 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55632f51ade0 con 0x55632f7a7650 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 0x55632f7a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1978003f60 tx=0x7f1978003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d0e53733b1145b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f19667fc700 1 -- 172.21.15.139:0/1300460995 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978019070 con 0x55632f7a7650 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f19667fc700 1 -- 172.21.15.139:0/1300460995 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f197800f040 con 0x55632f7a7650 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.227+0000 7f19667fc700 1 -- 172.21.15.139:0/1300460995 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007a40 con 0x55632f7a7650 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- 172.21.15.139:0/1300460995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 msgr2=0x55632f7a9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1978003f60 tx=0x7f1978003f90 comp rx=0 tx=0).stop 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- 172.21.15.139:0/1300460995 shutdown_connections 2023-10-08T13:34:41.236 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7a9a40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79be80 0x55632f79c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 --2- 172.21.15.139:0/1300460995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79c7a0 0x55632f7a7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- 172.21.15.139:0/1300460995 >> 172.21.15.139:0/1300460995 conn(0x55632f711260 msgr2=0x55632f7982d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- 172.21.15.139:0/1300460995 shutdown_connections 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- 172.21.15.139:0/1300460995 wait complete. 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.228+0000 7f1992899b80 1 -- start start 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 Processor -- start 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f7a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f7a7650 0x55632f7a4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f6efe30 con 0x55632f79c7a0 2023-10-08T13:34:41.237 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f68c710 con 0x55632f79be80 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f68c3b0 con 0x55632f7a7650 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1992899b80 10 client.0 _ll_register_callbacks cb 0x55632f4e9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43258/0 (socket says 172.21.15.139:43258) 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 -- 172.21.15.139:0/450304744 learned_addr learned my addr 172.21.15.139:0/450304744 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197ffff700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f7a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f1984c4d700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f7a7650 0x55632f7a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 -- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f7a7650 msgr2=0x55632f7a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f7a7650 0x55632f7a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 -- 172.21.15.139:0/450304744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 msgr2=0x55632f7a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f7a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.238 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.229+0000 7f197f7fe700 1 -- 172.21.15.139:0/450304744 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1978003b90 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f197f7fe700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1970012040 tx=0x7f197009b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800e0abab38ed84e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197009f320 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f197009bab0 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55632f6b7eb0 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f197009b3b0 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 10 client.17070 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55632f503c60 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55632f6b7eb0 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f197009a8a0 con 0x55632f79c7a0 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 10 client.17070 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:41.239 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 20 client.17070 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f7b6df0 0x55632f7b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 4 client.17070 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.230+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55632f6e8e10 con 0x55632f7b6df0 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.231+0000 7f197ffff700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f7b6df0 0x55632f7b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.231+0000 7f195f7fe700 10 client.17070 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.231+0000 7f197ffff700 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f7b6df0 0x55632f7b9210 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75142c012a5afba0 server_cookie=547f1757f5b024b5 in_seq=0 out_seq=0 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f195f7fe700 1 -- 172.21.15.139:0/450304744 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55632f6e8e10 con 0x55632f7b6df0 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f195f7fe700 10 client.17070 handle_command_reply: tid=0 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 client.17070 shutdown 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 msgr2=0x55632f7a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.240 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1970012040 tx=0x7f197009b000 comp rx=0 tx=0).stop 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 shutdown_connections 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f7a7650 0x55632f7a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f7b6df0 0x55632f7b9210 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f7a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f195f7fe700 0 client.17070 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 --2- 172.21.15.139:0/450304744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79c7a0 0x55632f7a42b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 >> 172.21.15.139:0/450304744 conn(0x55632f711260 msgr2=0x55632f797ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 shutdown_connections 2023-10-08T13:34:41.241 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 1 -- 172.21.15.139:0/450304744 wait complete. 2023-10-08T13:34:41.242 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.232+0000 7f1992899b80 20 client.17070 trim_cache size 0 max 16384 2023-10-08T13:34:41.251 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 Processor -- start 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 -- start start 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f79ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f798480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f570920 con 0x55632f7a7650 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f792570 con 0x55632f79be80 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1992899b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f7ae6e0 con 0x55632f79c7a0 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1984c4d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1984c4d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43268/0 (socket says 172.21.15.139:43268) 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1984c4d700 1 -- 172.21.15.139:0/1427778806 learned_addr learned my addr 172.21.15.139:0/1427778806 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f197ffff700 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f79ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.249+0000 7f1984c4d700 1 -- 172.21.15.139:0/1427778806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 msgr2=0x55632f798480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f798480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f798480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1984c4d700 1 -- 172.21.15.139:0/1427778806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 msgr2=0x55632f79ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f79ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1984c4d700 1 -- 172.21.15.139:0/1427778806 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55632f541250 con 0x55632f7a7650 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1978003f60 tx=0x7f1978009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa4c1a982ba147a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1966ffd700 1 -- 172.21.15.139:0/1427778806 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978019040 con 0x55632f7a7650 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1966ffd700 1 -- 172.21.15.139:0/1427778806 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1978007e70 con 0x55632f7a7650 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1966ffd700 1 -- 172.21.15.139:0/1427778806 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978015480 con 0x55632f7a7650 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 -- 172.21.15.139:0/1427778806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 msgr2=0x55632f7ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1978003f60 tx=0x7f1978009460 comp rx=0 tx=0).stop 2023-10-08T13:34:41.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 -- 172.21.15.139:0/1427778806 shutdown_connections 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f7a7650 0x55632f7ae1a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f79be80 0x55632f79ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 --2- 172.21.15.139:0/1427778806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f798480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 -- 172.21.15.139:0/1427778806 >> 172.21.15.139:0/1427778806 conn(0x55632f711260 msgr2=0x55632f797d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.250+0000 7f1992899b80 1 -- 172.21.15.139:0/1427778806 shutdown_connections 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 -- 172.21.15.139:0/1427778806 wait complete. 2023-10-08T13:34:41.254 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 -- start start 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 Processor -- start 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f7acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 0x55632f80abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f7ad770 con 0x55632f79be80 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f7ad8e0 con 0x55632f7a7650 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.251+0000 7f1992899b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55632f80b1b0 con 0x55632f79c7a0 2023-10-08T13:34:41.261 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1992899b80 10 client.0 _ll_register_callbacks cb 0x7f197009b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43270/0 (socket says 172.21.15.139:43270) 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 -- 172.21.15.139:0/1949916558 learned_addr learned my addr 172.21.15.139:0/1949916558 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 0x55632f80abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f7acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 -- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 msgr2=0x55632f7acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f7acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 -- 172.21.15.139:0/1949916558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 msgr2=0x55632f80abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 0x55632f80abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 -- 172.21.15.139:0/1949916558 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55632f51ade0 con 0x55632f79be80 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f7acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:41.262 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1984c4d700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 0x55632f80abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f197ffff700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1974013010 tx=0x7f1974013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2c57becbbbedfd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f195f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974023040 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f1974028510 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f197800f040 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1974004000 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1992899b80 10 client.17076 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55632f5192b0 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.252+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f197800f040 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f197402e020 con 0x55632f79be80 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 10 client.17076 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.263 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 20 client.17076 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f80cae0 0x55632f80ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 4 client.17076 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55632f6e8b30 con 0x55632f80cae0 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f80cae0 0x55632f80ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f195f7fe700 10 client.17076 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f197f7fe700 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f80cae0 0x55632f80ef00 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9b30c15ecf41fbe server_cookie=3499d499ec42fbc5 in_seq=0 out_seq=0 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f195f7fe700 1 -- 172.21.15.139:0/1949916558 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55632f6e8b30 con 0x55632f80cae0 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.253+0000 7f195f7fe700 10 client.17076 handle_command_reply: tid=0 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 client.17076 shutdown 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 msgr2=0x55632f7aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.264 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1974013010 tx=0x7f1974013040 comp rx=0 tx=0).stop 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 shutdown_connections 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x55632f80cae0 0x55632f80ef00 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55632f7a7650 0x55632f80abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f195f7fe700 0 client.17076 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55632f79be80 0x55632f7aca30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 --2- 172.21.15.139:0/1949916558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55632f79c7a0 0x55632f7acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 >> 172.21.15.139:0/1949916558 conn(0x55632f711260 msgr2=0x55632f7a3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 shutdown_connections 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 1 -- 172.21.15.139:0/1949916558 wait complete. 2023-10-08T13:34:41.265 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f1992899b80 20 client.17076 trim_cache size 0 max 16384 2023-10-08T13:34:41.266 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:34:41.266 INFO:teuthology.orchestra.run.smithi139.stdout: "status": "no active scrubs running", 2023-10-08T13:34:41.266 INFO:teuthology.orchestra.run.smithi139.stdout: "scrubs": {} 2023-10-08T13:34:41.266 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:34:41.266 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 msgr2=0x7f19680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 0x7f19680a3ab0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1974009c60 tx=0x7f1974009260 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 msgr2=0x7f1980197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f197000b2e0 tx=0x7f1970004730 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 shutdown_connections 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f19680a15f0 0x7f19680a3ab0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1980104610 0x7f19801984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19800ffdd0 0x7f1980197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 --2- 172.21.15.139:0/2181875671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1980100790 0x7f1980197f50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.254+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 >> 172.21.15.139:0/2181875671 conn(0x7f1980075c20 msgr2=0x7f1980102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.255+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 shutdown_connections 2023-10-08T13:34:41.267 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.255+0000 7f19866b0700 1 -- 172.21.15.139:0/2181875671 wait complete. 2023-10-08T13:34:41.268 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T13:34:41.269 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:34:41.396 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 -- 172.21.15.139:0/3783212396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564102130 msgr2=0x7f956410a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 --2- 172.21.15.139:0/3783212396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564102130 0x7f956410a610 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9554009990 tx=0x7f9554009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 -- 172.21.15.139:0/3783212396 shutdown_connections 2023-10-08T13:34:41.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 --2- 172.21.15.139:0/3783212396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f956410ac30 0x7f956410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 --2- 172.21.15.139:0/3783212396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 0x7f9564101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.397 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 --2- 172.21.15.139:0/3783212396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9564102130 0x7f956410a610 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 -- 172.21.15.139:0/3783212396 >> 172.21.15.139:0/3783212396 conn(0x7f95640fb050 msgr2=0x7f95640fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 -- 172.21.15.139:0/3783212396 shutdown_connections 2023-10-08T13:34:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.389+0000 7f9569478700 1 -- 172.21.15.139:0/3783212396 wait complete. 2023-10-08T13:34:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 Processor -- start 2023-10-08T13:34:41.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 -- start start 2023-10-08T13:34:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 0x7f95640ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 0x7f95640ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95641a4e80 con 0x7f956410ac30 2023-10-08T13:34:41.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95641a4ff0 con 0x7f9564102130 2023-10-08T13:34:41.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f9569478700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95641a51b0 con 0x7f9564101810 2023-10-08T13:34:41.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f95637fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f95637fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43286/0 (socket says 172.21.15.139:43286) 2023-10-08T13:34:41.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.390+0000 7f95637fe700 1 -- 172.21.15.139:0/166953556 learned_addr learned my addr 172.21.15.139:0/166953556 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.400 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95627fc700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 0x7f95640ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f9562ffd700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 0x7f95640ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 -- 172.21.15.139:0/166953556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 msgr2=0x7f95640ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 0x7f95640ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 -- 172.21.15.139:0/166953556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 msgr2=0x7f95640ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.401 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 0x7f95640ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 -- 172.21.15.139:0/166953556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540095f0 con 0x7f956410ac30 2023-10-08T13:34:41.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95627fc700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 0x7f95640ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:34:41.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f95637fe700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f955c007ee0 tx=0x7f955c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c017070 con 0x7f956410ac30 2023-10-08T13:34:41.402 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f955c00f040 con 0x7f956410ac30 2023-10-08T13:34:41.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95641a5490 con 0x7f956410ac30 2023-10-08T13:34:41.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c005580 con 0x7f956410ac30 2023-10-08T13:34:41.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.391+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95641a5920 con 0x7f956410ac30 2023-10-08T13:34:41.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.392+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9564105d00 con 0x7f956410ac30 2023-10-08T13:34:41.403 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.393+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f955c00db20 con 0x7f956410ac30 2023-10-08T13:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.394+0000 7f955bfff700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 0x7f95500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.394+0000 7f9562ffd700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 0x7f95500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.394+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f955c0ccbc0 con 0x7f956410ac30 2023-10-08T13:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.394+0000 7f9562ffd700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 0x7f95500a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f954c005950 tx=0x7f954c00b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.398+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f955c095b50 con 0x7f956410ac30 2023-10-08T13:34:41.643 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.642+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9564069530 con 0x7f956410ac30 2023-10-08T13:34:41.644 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.643+0000 7f955bfff700 1 -- 172.21.15.139:0/166953556 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+11428 (secure 0 0 0) 0x7f955c099170 con 0x7f956410ac30 2023-10-08T13:34:41.644 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:34:41.644 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":52,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:34:11.550786+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_26153":{"gid":26153,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3686588084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3686588084},{"type":"v1","addr":"172.21.15.155:6835","nonce":3686588084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:34:41.646 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 msgr2=0x7f95500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.646 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 0x7f95500a3ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f954c005950 tx=0x7f954c00b410 comp rx=0 tx=0).stop 2023-10-08T13:34:41.646 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 msgr2=0x7f95640ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f955c007ee0 tx=0x7f955c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 shutdown_connections 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f95500a15f0 0x7f95500a3ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f956410ac30 0x7f95640ffee0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9564101810 0x7f95640ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 --2- 172.21.15.139:0/166953556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9564102130 0x7f95640ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 >> 172.21.15.139:0/166953556 conn(0x7f95640fb050 msgr2=0x7f95640fbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 shutdown_connections 2023-10-08T13:34:41.647 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.645+0000 7f9569478700 1 -- 172.21.15.139:0/166953556 wait complete. 2023-10-08T13:34:41.648 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 52 2023-10-08T13:34:41.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T13:34:41.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.781+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2484123820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 msgr2=0x7fbefc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.781+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2484123820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc0ffaa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009990 tx=0x7fbef0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2484123820 shutdown_connections 2023-10-08T13:34:41.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2484123820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 0x7fbefc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2484123820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 0x7fbefc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2484123820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc0ffaa0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2484123820 >> 172.21.15.139:0/2484123820 conn(0x7fbefc076780 msgr2=0x7fbefc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2484123820 shutdown_connections 2023-10-08T13:34:41.784 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2484123820 wait complete. 2023-10-08T13:34:41.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 Processor -- start 2023-10-08T13:34:41.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.782+0000 7fbf00e7c700 1 -- start start 2023-10-08T13:34:41.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 0x7fbefc19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 0x7fbefc1969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc197010 con 0x7fbefc0ff620 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc197180 con 0x7fbefc1056b0 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc197340 con 0x7fbefc0fffe0 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43296/0 (socket says 172.21.15.139:43296) 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 -- 172.21.15.139:0/2301669082 learned_addr learned my addr 172.21.15.139:0/2301669082 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 0x7fbefc19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefad9d700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 0x7fbefc1969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 -- 172.21.15.139:0/2301669082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 msgr2=0x7fbefc19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 0x7fbefc19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 -- 172.21.15.139:0/2301669082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 msgr2=0x7fbefc1969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 0x7fbefc1969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 -- 172.21.15.139:0/2301669082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00095f0 con 0x7fbefc0ff620 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d980 tx=0x7fbeec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbeeb7fe700 1 -- 172.21.15.139:0/2301669082 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00b950 con 0x7fbefc0ff620 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbeeb7fe700 1 -- 172.21.15.139:0/2301669082 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeec007620 con 0x7fbefc0ff620 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc197620 con 0x7fbefc0ff620 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.783+0000 7fbeeb7fe700 1 -- 172.21.15.139:0/2301669082 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00f3c0 con 0x7fbefc0ff620 2023-10-08T13:34:41.788 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.784+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc1a3870 con 0x7fbefc0ff620 2023-10-08T13:34:41.794 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.786+0000 7fbeeb7fe700 1 -- 172.21.15.139:0/2301669082 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fbeec010640 con 0x7fbefc0ff620 2023-10-08T13:34:41.794 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.786+0000 7fbeeb7fe700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.794 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.786+0000 7fbeeb7fe700 1 -- 172.21.15.139:0/2301669082 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fbeec0cd2c0 con 0x7fbefc0ff620 2023-10-08T13:34:41.794 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.786+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 0x7fbee40a3ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbefc197b70 tx=0x7fbef0005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 Processor -- start 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 -- start start 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4075110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4077a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3fd3460 con 0x55b0b4069e80 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3fc4c20 con 0x55b0b406a7a0 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.787+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3fc2540 con 0x55b0b4075650 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.795 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43304/0 (socket says 172.21.15.139:43304) 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 -- 172.21.15.139:0/384213914 learned_addr learned my addr 172.21.15.139:0/384213914 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4075110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 -- 172.21.15.139:0/384213914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 msgr2=0x55b0b4077a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 -- 172.21.15.139:0/384213914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 msgr2=0x55b0b4075110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4075110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 -- 172.21.15.139:0/384213914 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b3de8de0 con 0x55b0b4069e80 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbefa59c700 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbeec096410 tx=0x7fbeec0104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec360f57f196153 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbee8ff9700 1 -- 172.21.15.139:0/384213914 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec09e060 con 0x55b0b4069e80 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbee8ff9700 1 -- 172.21.15.139:0/384213914 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeec0a22a0 con 0x55b0b4069e80 2023-10-08T13:34:41.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.788+0000 7fbee8ff9700 1 -- 172.21.15.139:0/384213914 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec099660 con 0x55b0b4069e80 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- 172.21.15.139:0/384213914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 msgr2=0x55b0b406a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbeec096410 tx=0x7fbeec0104b0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- 172.21.15.139:0/384213914 shutdown_connections 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4077a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b406a260 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/384213914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4075110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- 172.21.15.139:0/384213914 >> 172.21.15.139:0/384213914 conn(0x55b0b3fdf260 msgr2=0x55b0b40662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- 172.21.15.139:0/384213914 shutdown_connections 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- 172.21.15.139:0/384213914 wait complete. 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 -- start start 2023-10-08T13:34:41.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.789+0000 7fbf0d065b80 1 Processor -- start 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4069e80 0x55b0b4074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b4075650 0x55b0b4072960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3fbde30 con 0x55b0b406a7a0 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3f5a710 con 0x55b0b4075650 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3f5a3b0 con 0x55b0b4069e80 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 10 client.0 _ll_register_callbacks cb 0x55b0b3db7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43312/0 (socket says 172.21.15.139:43312) 2023-10-08T13:34:41.798 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 -- 172.21.15.139:0/1125666840 learned_addr learned my addr 172.21.15.139:0/1125666840 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbefa59c700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4069e80 0x55b0b4074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbefad9d700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b4075650 0x55b0b4072960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 -- 172.21.15.139:0/1125666840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4069e80 msgr2=0x55b0b4074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4069e80 0x55b0b4074ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 -- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b4075650 msgr2=0x55b0b4072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b4075650 0x55b0b4072960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 -- 172.21.15.139:0/1125666840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc1a3870 con 0x55b0b406a7a0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbef00095c0 tx=0x7fbef001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7124576a4e9ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbee1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0004dc0 con 0x55b0b406a7a0 2023-10-08T13:34:41.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fbef000f460 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.790+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0b3f85eb0 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbef000f620 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 10 client.17094 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55b0b3dd1c60 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0b3f85eb0 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fbef002f6f0 con 0x55b0b406a7a0 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 10 client.17094 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 10 client.17094 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 20 client.17094 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b4085000 0x55b0b4087420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 4 client.17094 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0b3fb6e10 con 0x55b0b4085000 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.791+0000 7fbefa59c700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b4085000 0x55b0b4087420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbee1ffb700 10 client.17094 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbefa59c700 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b4085000 0x55b0b4087420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=67479d6d80443c56 server_cookie=5ae5b306d103b8dc in_seq=0 out_seq=0 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbee1ffb700 1 -- 172.21.15.139:0/1125666840 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0b3fb6e10 con 0x55b0b4085000 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbee1ffb700 10 client.17094 handle_command_reply: tid=0 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 client.17094 shutdown 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 msgr2=0x55b0b4072330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbef00095c0 tx=0x7fbef001a050 comp rx=0 tx=0).stop 2023-10-08T13:34:41.801 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 shutdown_connections 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b4085000 0x55b0b4087420 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b4075650 0x55b0b4072960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbee1ffb700 0 client.17094 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4069e80 0x55b0b4074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/1125666840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b406a7a0 0x55b0b4072330 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.792+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 >> 172.21.15.139:0/1125666840 conn(0x55b0b3fdf260 msgr2=0x55b0b4065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.793+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 shutdown_connections 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.793+0000 7fbf0d065b80 1 -- 172.21.15.139:0/1125666840 wait complete. 2023-10-08T13:34:41.802 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.793+0000 7fbf0d065b80 20 client.17094 trim_cache size 0 max 16384 2023-10-08T13:34:41.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.805+0000 7fbf0d065b80 1 Processor -- start 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.805+0000 7fbf0d065b80 1 -- start start 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b3e3e920 con 0x55b0b4069e80 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b406b9c0 con 0x55b0b406a7a0 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b406ab80 con 0x55b0b4075650 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43318/0 (socket says 172.21.15.139:43318) 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 -- 172.21.15.139:0/3793340231 learned_addr learned my addr 172.21.15.139:0/3793340231 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefad9d700 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 -- 172.21.15.139:0/3793340231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 msgr2=0x55b0b4071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 -- 172.21.15.139:0/3793340231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 msgr2=0x55b0b4070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 -- 172.21.15.139:0/3793340231 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0b3e0f250 con 0x55b0b4069e80 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbefa59c700 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbeec099ea0 tx=0x7fbeec0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e41113a6abf008 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbee97fa700 1 -- 172.21.15.139:0/3793340231 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0b6070 con 0x55b0b4069e80 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbee97fa700 1 -- 172.21.15.139:0/3793340231 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeec063070 con 0x55b0b4069e80 2023-10-08T13:34:41.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.806+0000 7fbee97fa700 1 -- 172.21.15.139:0/3793340231 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec09a170 con 0x55b0b4069e80 2023-10-08T13:34:41.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- 172.21.15.139:0/3793340231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 msgr2=0x55b0b4072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.813 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbeec099ea0 tx=0x7fbeec0074f0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- 172.21.15.139:0/3793340231 shutdown_connections 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b4075650 0x55b0b4071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4069e80 0x55b0b4072920 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/3793340231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b406a7a0 0x55b0b4070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- 172.21.15.139:0/3793340231 >> 172.21.15.139:0/3793340231 conn(0x55b0b3fdf260 msgr2=0x55b0b406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- 172.21.15.139:0/3793340231 shutdown_connections 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- 172.21.15.139:0/3793340231 wait complete. 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 -- start start 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.807+0000 7fbf0d065b80 1 Processor -- start 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b406a7a0 0x55b0b407b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.814 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 0x55b0b40d8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b407c160 con 0x55b0b4075650 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b40d8750 con 0x55b0b40d5e20 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0b40d8890 con 0x55b0b406a7a0 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 10 client.0 _ll_register_callbacks cb 0x7fbef000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43326/0 (socket says 172.21.15.139:43326) 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 -- 172.21.15.139:0/2519687239 learned_addr learned my addr 172.21.15.139:0/2519687239 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbefad9d700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 0x55b0b40d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b406a7a0 0x55b0b407b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 -- 172.21.15.139:0/2519687239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b406a7a0 msgr2=0x55b0b407b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.815 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b406a7a0 0x55b0b407b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 -- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 msgr2=0x55b0b40d8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 0x55b0b40d8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 -- 172.21.15.139:0/2519687239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec0b1040 con 0x55b0b4075650 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbefad9d700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 0x55b0b40d8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbef9d9b700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbef0005f50 tx=0x7fbef00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e802d3ba8349159 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbee1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef002f610 con 0x55b0b4075650 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fbef002f770 con 0x55b0b4075650 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.808+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbeec0a22a0 con 0x55b0b4075650 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbef0048470 con 0x55b0b4075650 2023-10-08T13:34:41.816 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 10 client.17100 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55b0b3de72b0 con 0x55b0b4075650 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeec0a22a0 con 0x55b0b4075650 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fbef0004500 con 0x55b0b4075650 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 10 client.17100 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 10 client.17100 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 20 client.17100 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b40d9be0 0x55b0b40dc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 4 client.17100 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 --> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b0b3fb6b30 con 0x55b0b40d9be0 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.809+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b40d9be0 0x55b0b40dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.817 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbee1ffb700 10 client.17100 ms_handle_connect on v2:172.21.15.155:6836/4218841185 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbefa59c700 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b40d9be0 0x55b0b40dc000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ebbe6099907a3cd2 server_cookie=811c8408e9d0d3ef in_seq=0 out_seq=0 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbee1ffb700 1 -- 172.21.15.139:0/2519687239 <== mds.4 v2:172.21.15.155:6836/4218841185 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+8269 (crc 0 0 0) 0x55b0b3fb6b30 con 0x55b0b40d9be0 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbee1ffb700 10 client.17100 handle_command_reply: tid=0 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 client.17100 shutdown 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 msgr2=0x55b0b407ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbef0005f50 tx=0x7fbef00057b0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 shutdown_connections 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:6836/4218841185,v1:172.21.15.155:6837/4218841185] conn(0x55b0b40d9be0 0x55b0b40dc000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b0b40d5e20 0x55b0b40d8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbee1ffb700 0 client.17100 ms_handle_reset on v2:172.21.15.155:6836/4218841185 2023-10-08T13:34:41.818 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0b406a7a0 0x55b0b407b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 --2- 172.21.15.139:0/2519687239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0b4075650 0x55b0b407ba80 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 >> 172.21.15.139:0/2519687239 conn(0x55b0b3fdf260 msgr2=0x55b0b4070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 shutdown_connections 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 1 -- 172.21.15.139:0/2519687239 wait complete. 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.810+0000 7fbf0d065b80 20 client.17100 trim_cache size 0 max 16384 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.819 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1257815, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628835, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out" 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 479853129, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628857, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out" 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.820 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 790081681, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628943, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out" 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 802583395, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629208, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out" 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.821 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 960587314, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628316, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out" 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1256067091, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629586, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out" 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.822 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1377104057, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629404, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out" 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1505368164, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629726, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out" 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.823 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1525295135, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630000, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out" 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1540720638, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628841, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out" 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.824 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1645870298, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629944, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out" 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1671156165, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628867, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out" 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.825 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1852797461, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629868, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out" 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1910154527, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628230, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out" 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1954323012, 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628258, 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out" 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2112877908, 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629546, 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out" 2023-10-08T13:34:41.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2209312573, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629039, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs" 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2235742864, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629372, 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out" 2023-10-08T13:34:41.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2395101064, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629402, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out" 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2653917512, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628885, 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out" 2023-10-08T13:34:41.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2708780047, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628314, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out" 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2907210122, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628822, 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg" 2023-10-08T13:34:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3087674753, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629498, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out" 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3124524153, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629420, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out" 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3158112586, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630086, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out" 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3158529048, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628318, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out" 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.832 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3166111214, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628959, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out" 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3291255889, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629168, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out" 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3489174970, 2023-10-08T13:34:41.833 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628348, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out" 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3663543598, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628853, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out" 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3755394709, 2023-10-08T13:34:41.834 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628330, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out" 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3790817424, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629714, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out" 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4024421630, 2023-10-08T13:34:41.835 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629288, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out" 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4060663980, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629264, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out" 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4084057255, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628865, 2023-10-08T13:34:41.836 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out" 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4086043851, 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628881, 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out" 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:41.837 INFO:teuthology.orchestra.run.smithi139.stdout:] 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 msgr2=0x7fbee40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 0x7fbee40a3ab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbefc197b70 tx=0x7fbef0005fd0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 msgr2=0x7fbefc19c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d980 tx=0x7fbeec00dc90 comp rx=0 tx=0).stop 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 shutdown_connections 2023-10-08T13:34:41.838 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fbee40a15f0 0x7fbee40a3ab0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbefc1056b0 0x7fbefc1969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbefc0ff620 0x7fbefc19c880 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 --2- 172.21.15.139:0/2301669082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbefc0fffe0 0x7fbefc19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 >> 172.21.15.139:0/2301669082 conn(0x7fbefc076780 msgr2=0x7fbefc103800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 shutdown_connections 2023-10-08T13:34:41.839 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.811+0000 7fbf00e7c700 1 -- 172.21.15.139:0/2301669082 wait complete. 2023-10-08T13:34:41.839 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:41 smithi139 ceph-mon[99506]: pgmap v519: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2023-10-08T13:34:41.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T13:34:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:41 smithi155 ceph-mon[103467]: pgmap v519: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- 172.21.15.139:0/2606061371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8105630 msgr2=0x7f69f8105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 --2- 172.21.15.139:0/2606061371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8105630 0x7f69f8105a10 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009990 tx=0x7f69ec009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- 172.21.15.139:0/2606061371 shutdown_connections 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 --2- 172.21.15.139:0/2606061371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f8100000 0x7f69f810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 --2- 172.21.15.139:0/2606061371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8105630 0x7f69f8105a10 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 --2- 172.21.15.139:0/2606061371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f80ff640 0x7f69f80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- 172.21.15.139:0/2606061371 >> 172.21.15.139:0/2606061371 conn(0x7f69f8076790 msgr2=0x7f69f8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- 172.21.15.139:0/2606061371 shutdown_connections 2023-10-08T13:34:41.966 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- 172.21.15.139:0/2606061371 wait complete. 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 Processor -- start 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.963+0000 7f69fec97700 1 -- start start 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f80ff640 0x7f69f819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 0x7f69f81969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8197050 con 0x7f69f8100000 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f81971c0 con 0x7f69f8105630 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8197380 con 0x7f69f80ff640 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43340/0 (socket says 172.21.15.139:43340) 2023-10-08T13:34:41.967 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 -- 172.21.15.139:0/726776761 learned_addr learned my addr 172.21.15.139:0/726776761 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fca33700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f80ff640 0x7f69f819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fd234700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 0x7f69f81969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 -- 172.21.15.139:0/726776761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f80ff640 msgr2=0x7f69f819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f80ff640 0x7f69f819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 -- 172.21.15.139:0/726776761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 msgr2=0x7f69f81969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 0x7f69f81969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 -- 172.21.15.139:0/726776761 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec0095f0 con 0x7f69f8100000 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fd234700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 0x7f69f81969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f7fff700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9a0 tx=0x7f69e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f5ffb700 1 -- 172.21.15.139:0/726776761 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4009790 con 0x7f69f8100000 2023-10-08T13:34:41.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f5ffb700 1 -- 172.21.15.139:0/726776761 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69e400cbd0 con 0x7f69f8100000 2023-10-08T13:34:41.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69f5ffb700 1 -- 172.21.15.139:0/726776761 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4018680 con 0x7f69f8100000 2023-10-08T13:34:41.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.964+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8197660 con 0x7f69f8100000 2023-10-08T13:34:41.969 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.965+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f81a38b0 con 0x7f69f8100000 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.967+0000 7f69f5ffb700 1 -- 172.21.15.139:0/726776761 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f69e400cd40 con 0x7f69f8100000 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.967+0000 7f69f5ffb700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 0x7f69e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.967+0000 7f69fca33700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 0x7f69e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.967+0000 7f69f5ffb700 1 -- 172.21.15.139:0/726776761 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f69e4014070 con 0x7f69f8100000 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f69fca33700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 0x7f69e80a3ab0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00b2e0 tx=0x7f69ec005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 Processor -- start 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 -- start start 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.975 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f154b460 con 0x55e3f15ed650 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f153cc20 con 0x55e3f15e27a0 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f153a540 con 0x55e3f15e1e80 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f69fd234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f69fd234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43350/0 (socket says 172.21.15.139:43350) 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.968+0000 7f69fd234700 1 -- 172.21.15.139:0/1278326516 learned_addr learned my addr 172.21.15.139:0/1278326516 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69f7fff700 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fca33700 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 -- 172.21.15.139:0/1278326516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 msgr2=0x55e3f15e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.976 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 -- 172.21.15.139:0/1278326516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 msgr2=0x55e3f15ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 -- 172.21.15.139:0/1278326516 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f1360de0 con 0x55e3f15ed650 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69fd234700 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009cd0 tx=0x7f69f0007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9c502020323a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69e2ffd700 1 -- 172.21.15.139:0/1278326516 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0014400 con 0x55e3f15ed650 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69e2ffd700 1 -- 172.21.15.139:0/1278326516 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69f0014a20 con 0x55e3f15ed650 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.969+0000 7f69e2ffd700 1 -- 172.21.15.139:0/1278326516 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0013a20 con 0x55e3f15ed650 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1278326516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 msgr2=0x55e3f15efa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009cd0 tx=0x7f69f0007500 comp rx=0 tx=0).stop 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1278326516 shutdown_connections 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15efa40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.977 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1278326516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1278326516 >> 172.21.15.139:0/1278326516 conn(0x55e3f1557260 msgr2=0x55e3f15de2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1278326516 shutdown_connections 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1278326516 wait complete. 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 -- start start 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.970+0000 7f6a0ae80b80 1 Processor -- start 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15ed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f1535e30 con 0x55e3f15ed650 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f14d2710 con 0x55e3f15e27a0 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f14d23b0 con 0x55e3f15e1e80 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 10 client.0 _ll_register_callbacks cb 0x55e3f132f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43356/0 (socket says 172.21.15.139:43356) 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 -- 172.21.15.139:0/412717156 learned_addr learned my addr 172.21.15.139:0/412717156 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69f7fff700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fca33700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 -- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 msgr2=0x55e3f15ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15ed000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 -- 172.21.15.139:0/412717156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 msgr2=0x55e3f15ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.979 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 -- 172.21.15.139:0/412717156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f0009900 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69fd234700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69f0008fd0 tx=0x7f69f0009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507767ab5c921336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0004ad0 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f69f0004c30 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f14fdeb0 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69f0004df0 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 10 client.17112 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.971+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55e3f1349c60 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3f14fdeb0 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f69f0005280 con 0x55e3f15ed650 2023-10-08T13:34:41.980 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 10 client.17112 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 10 client.17112 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 20 client.17112 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f15fd120 0x55e3f15ff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 4 client.17112 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3f152ee10 con 0x55e3f15fd120 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.972+0000 7f69fca33700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f15fd120 0x55e3f15ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f69d7fff700 10 client.17112 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f69fca33700 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f15fd120 0x55e3f15ff540 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=544d7c5805085682 server_cookie=e3f99dbda1e34d42 in_seq=0 out_seq=0 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f69d7fff700 1 -- 172.21.15.139:0/412717156 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e3f152ee10 con 0x55e3f15fd120 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f69d7fff700 10 client.17112 handle_command_reply: tid=0 2023-10-08T13:34:41.981 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 client.17112 shutdown 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 msgr2=0x55e3f15ea920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69f0008fd0 tx=0x7f69f0009890 comp rx=0 tx=0).stop 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 shutdown_connections 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f15fd120 0x55e3f15ff540 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15ed650 0x55e3f15ea920 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f69d7fff700 0 client.17112 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/412717156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 >> 172.21.15.139:0/412717156 conn(0x55e3f1557260 msgr2=0x55e3f15ddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.982 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 shutdown_connections 2023-10-08T13:34:41.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.973+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/412717156 wait complete. 2023-10-08T13:34:41.983 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.974+0000 7f6a0ae80b80 20 client.17112 trim_cache size 0 max 16384 2023-10-08T13:34:41.983 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:41 smithi187 ceph-mon[104336]: pgmap v519: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2023-10-08T13:34:41.989 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 Processor -- start 2023-10-08T13:34:41.989 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 -- start start 2023-10-08T13:34:41.989 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.989 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.989 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 0x55e3f15e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f13b6920 con 0x55e3f15e1e80 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f15e9640 con 0x55e3f15e27a0 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.986+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f15d8570 con 0x55e3f15ed650 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43360/0 (socket says 172.21.15.139:43360) 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 -- 172.21.15.139:0/1791752750 learned_addr learned my addr 172.21.15.139:0/1791752750 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fd234700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 0x55e3f15e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69f7fff700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 -- 172.21.15.139:0/1791752750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 msgr2=0x55e3f15e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 0x55e3f15e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.990 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 -- 172.21.15.139:0/1791752750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 msgr2=0x55e3f15e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15e8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 -- 172.21.15.139:0/1791752750 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f1387250 con 0x55e3f15e1e80 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fd234700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 0x55e3f15e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69f7fff700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69fca33700 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f69ec015000 tx=0x7f69ec020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cff413a202b40d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69e37fe700 1 -- 172.21.15.139:0/1791752750 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0339b0 con 0x55e3f15e1e80 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69e37fe700 1 -- 172.21.15.139:0/1791752750 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69ec01e040 con 0x55e3f15e1e80 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.987+0000 7f69e37fe700 1 -- 172.21.15.139:0/1791752750 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec004ca0 con 0x55e3f15e1e80 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1791752750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 msgr2=0x55e3f15ea840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f69ec015000 tx=0x7f69ec020000 comp rx=0 tx=0).stop 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1791752750 shutdown_connections 2023-10-08T13:34:41.991 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15ed650 0x55e3f15e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e1e80 0x55e3f15ea840 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/1791752750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15e27a0 0x55e3f15e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1791752750 >> 172.21.15.139:0/1791752750 conn(0x55e3f1557260 msgr2=0x55e3f15e5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1791752750 shutdown_connections 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/1791752750 wait complete. 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- start start 2023-10-08T13:34:41.992 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 Processor -- start 2023-10-08T13:34:41.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 0x55e3f15f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f15f2b10 con 0x55e3f15e27a0 2023-10-08T13:34:41.995 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f15f2c80 con 0x55e3f15ed650 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.988+0000 7f6a0ae80b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f15f2e40 con 0x55e3f15e1e80 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f6a0ae80b80 10 client.0 _ll_register_callbacks cb 0x7f69e4095fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43368/0 (socket says 172.21.15.139:43368) 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 -- 172.21.15.139:0/2864455981 learned_addr learned my addr 172.21.15.139:0/2864455981 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69fd234700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 0x55e3f15f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69fca33700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 -- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 msgr2=0x55e3f15f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.996 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 -- 172.21.15.139:0/2864455981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 msgr2=0x55e3f15f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 0x55e3f15f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 -- 172.21.15.139:0/2864455981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec02c040 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69fd234700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 0x55e3f15f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69f7fff700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f69e409a320 tx=0x7f69e409abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca005ab512883703 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e409a7f0 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f69e40a2720 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69f0014a20 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69e4099880 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f6a0ae80b80 10 client.17118 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55e3f135f2b0 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.989+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69f0014a20 con 0x55e3f15e27a0 2023-10-08T13:34:41.997 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f69e40b1070 con 0x55e3f15e27a0 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 10 client.17118 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 10 client.17118 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 20 client.17118 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f1652420 0x55e3f1654840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 4 client.17118 mds_command: new command op to 24595 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 --> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e3f152eb30 con 0x55e3f1652420 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f69fca33700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f1652420 0x55e3f1654840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f69d7fff700 10 client.17118 ms_handle_connect on v2:172.21.15.187:6834/3167078820 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.990+0000 7f69fca33700 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f1652420 0x55e3f1654840 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=48ce4b531c2e9045 server_cookie=873d1753da9acee6 in_seq=0 out_seq=0 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f69d7fff700 1 -- 172.21.15.139:0/2864455981 <== mds.3 v2:172.21.15.187:6834/3167078820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+14716 (crc 0 0 0) 0x55e3f152eb30 con 0x55e3f1652420 2023-10-08T13:34:41.998 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f69d7fff700 10 client.17118 handle_command_reply: tid=0 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 client.17118 shutdown 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 msgr2=0x55e3f15f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f69e409a320 tx=0x7f69e409abc0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 shutdown_connections 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:6834/3167078820,v1:172.21.15.187:6835/3167078820] conn(0x55e3f1652420 0x55e3f1654840 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3f15ed650 0x55e3f15f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3f15e1e80 0x55e3f15f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 --2- 172.21.15.139:0/2864455981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e3f15e27a0 0x55e3f15f4370 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f69d7fff700 0 client.17118 ms_handle_reset on v2:172.21.15.187:6834/3167078820 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 >> 172.21.15.139:0/2864455981 conn(0x55e3f1557260 msgr2=0x55e3f15e88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 shutdown_connections 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 1 -- 172.21.15.139:0/2864455981 wait complete. 2023-10-08T13:34:41.999 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.991+0000 7f6a0ae80b80 20 client.17118 trim_cache size 0 max 16384 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 136160446, 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629450, 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out" 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.000 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 215826735, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629942, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out" 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 262605626, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629664, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out" 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 293823456, 2023-10-08T13:34:42.001 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629013, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out" 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 353184186, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629422, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out" 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 366989941, 2023-10-08T13:34:42.002 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628875, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out" 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 452931766, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630028, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out" 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 504329648, 2023-10-08T13:34:42.003 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628270, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out" 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 518550442, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628843, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out" 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 556346581, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628907, 2023-10-08T13:34:42.004 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out" 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 707658861, 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629998, 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out" 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 843534983, 2023-10-08T13:34:42.005 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629828, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out" 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 858759399, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629166, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out" 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1021341226, 2023-10-08T13:34:42.006 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629958, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out" 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1114603228, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628977, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out" 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1126310918, 2023-10-08T13:34:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628354, 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out" 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1155642915, 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628306, 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out" 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1180696439, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628280, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out" 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1309717912, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628260, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out" 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1471432323, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629216, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out" 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1488742236, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630002, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out" 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1569006581, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628244, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out" 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1580373396, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629684, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out" 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1609572519, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629188, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out" 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1643087860, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629236, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out" 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1688130646, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629730, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out" 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1798068011, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628871, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out" 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1895439319, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628957, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out" 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1918339571, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629206, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out" 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1972840053, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629984, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out" 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2213980080, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629490, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out" 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2278416786, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629862, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out" 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2295287734, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629112, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out" 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2322894311, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629150, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out" 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2326390597, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629015, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out" 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2342717976, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628953, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out" 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2383219929, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629186, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out" 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2383969730, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629268, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out" 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2547153099, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628264, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out" 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2594993905, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629126, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out" 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2597312975, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628995, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out" 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2640245450, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628869, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out" 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2819386186, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628949, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out" 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2936692123, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628322, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out" 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2959982778, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628352, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out" 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3006608110, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629744, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out" 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3034604831, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629342, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out" 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3151196276, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629816, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out" 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3392926828, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628282, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out" 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3518348549, 2023-10-08T13:34:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629444, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out" 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3584443046, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628851, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out" 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3637074260, 2023-10-08T13:34:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629190, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out" 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3677323260, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628873, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out" 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3804854062, 2023-10-08T13:34:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629682, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out" 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3871640168, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628342, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out" 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4015981233, 2023-10-08T13:34:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628206, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out" 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4029454824, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628268, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out" 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4104129431, 2023-10-08T13:34:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628304, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out" 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4163986813, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629005, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out" 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4188812450, 2023-10-08T13:34:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629430, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out" 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4210842160, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629148, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out" 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4231164238, 2023-10-08T13:34:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629298, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out" 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4250526889, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629934, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out" 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4275611577, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629364, 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out" 2023-10-08T13:34:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:42.032 INFO:teuthology.orchestra.run.smithi139.stdout:] 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 msgr2=0x7f69e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 0x7f69e80a3ab0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00b2e0 tx=0x7f69ec005960 comp rx=0 tx=0).stop 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 msgr2=0x7f69f819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9a0 tx=0x7f69e400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 shutdown_connections 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f69e80a15f0 0x7f69e80a3ab0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f69f8105630 0x7f69f81969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69f80ff640 0x7f69f819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.033 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 --2- 172.21.15.139:0/726776761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69f8100000 0x7f69f819ce00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 >> 172.21.15.139:0/726776761 conn(0x7f69f8076790 msgr2=0x7f69f80fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 shutdown_connections 2023-10-08T13:34:42.034 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:41.992+0000 7f69fec97700 1 -- 172.21.15.139:0/726776761 wait complete. 2023-10-08T13:34:42.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.156+0000 7fdecbfff700 1 -- 172.21.15.139:0/204943823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec40ff620 msgr2=0x7fdec40ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.156+0000 7fdecbfff700 1 --2- 172.21.15.139:0/204943823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec40ff620 0x7fdec40ffaa0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009990 tx=0x7fdec0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.156+0000 7fdecbfff700 1 -- 172.21.15.139:0/204943823 shutdown_connections 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.156+0000 7fdecbfff700 1 --2- 172.21.15.139:0/204943823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 0x7fdec410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 --2- 172.21.15.139:0/204943823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec41056b0 0x7fdec4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 --2- 172.21.15.139:0/204943823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec40ff620 0x7fdec40ffaa0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.158 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- 172.21.15.139:0/204943823 >> 172.21.15.139:0/204943823 conn(0x7fdec4076780 msgr2=0x7fdec4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.159 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- 172.21.15.139:0/204943823 shutdown_connections 2023-10-08T13:34:42.159 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- 172.21.15.139:0/204943823 wait complete. 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 Processor -- start 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- start start 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec40ff620 0x7fdec419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 0x7fdec419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4195e20 con 0x7fdec41056b0 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4195f90 con 0x7fdec40fffe0 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.157+0000 7fdecbfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4196150 con 0x7fdec40ff620 2023-10-08T13:34:42.161 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43384/0 (socket says 172.21.15.139:43384) 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 -- 172.21.15.139:0/1027408794 learned_addr learned my addr 172.21.15.139:0/1027408794 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdec959a700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 0x7fdec419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec40ff620 0x7fdec419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 -- 172.21.15.139:0/1027408794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec40ff620 msgr2=0x7fdec419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec40ff620 0x7fdec419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 -- 172.21.15.139:0/1027408794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 msgr2=0x7fdec419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 0x7fdec419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 -- 172.21.15.139:0/1027408794 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00095f0 con 0x7fdec41056b0 2023-10-08T13:34:42.162 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdeca59c700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00ef30 tx=0x7fdebc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdebaffd700 1 -- 172.21.15.139:0/1027408794 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc018070 con 0x7fdec41056b0 2023-10-08T13:34:42.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdebaffd700 1 -- 172.21.15.139:0/1027408794 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdebc00f040 con 0x7fdec41056b0 2023-10-08T13:34:42.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec41963d0 con 0x7fdec41056b0 2023-10-08T13:34:42.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdebaffd700 1 -- 172.21.15.139:0/1027408794 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00cdb0 con 0x7fdec41056b0 2023-10-08T13:34:42.163 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.158+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41a2670 con 0x7fdec41056b0 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.160+0000 7fdebaffd700 1 -- 172.21.15.139:0/1027408794 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fdebc003a00 con 0x7fdec41056b0 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.161+0000 7fdebaffd700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 0x7fdeb00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.161+0000 7fdebaffd700 1 -- 172.21.15.139:0/1027408794 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fdebc0cd090 con 0x7fdec41056b0 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.161+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 0x7fdeb00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.161+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 0x7fdeb00a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005fd0 tx=0x7fdeb4005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 Processor -- start 2023-10-08T13:34:42.169 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 -- start start 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x56493570c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564935717650 0x564935719a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564935675460 con 0x56493570c7a0 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564935666c20 con 0x56493570be80 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fded81e8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564935664540 con 0x564935717650 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43390/0 (socket says 172.21.15.139:43390) 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec9d9b700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x56493570c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 -- 172.21.15.139:0/2145366922 learned_addr learned my addr 172.21.15.139:0/2145366922 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564935717650 0x564935719a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 -- 172.21.15.139:0/2145366922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564935717650 msgr2=0x564935719a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564935717650 0x564935719a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 -- 172.21.15.139:0/2145366922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 msgr2=0x56493570c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x56493570c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.162+0000 7fdec959a700 1 -- 172.21.15.139:0/2145366922 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56493548ade0 con 0x56493570c7a0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fdec959a700 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009990 tx=0x7fdec000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f44e0648d6d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fdeaffff700 1 -- 172.21.15.139:0/2145366922 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec001d070 con 0x56493570c7a0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fdeaffff700 1 -- 172.21.15.139:0/2145366922 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec001e040 con 0x56493570c7a0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fdeaffff700 1 -- 172.21.15.139:0/2145366922 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec0004920 con 0x56493570c7a0 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fded81e8b80 1 -- 172.21.15.139:0/2145366922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 msgr2=0x564935717110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.171 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.163+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009990 tx=0x7fdec000b690 comp rx=0 tx=0).stop 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 -- 172.21.15.139:0/2145366922 shutdown_connections 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564935717650 0x564935719a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x56493570c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2145366922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717110 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 -- 172.21.15.139:0/2145366922 >> 172.21.15.139:0/2145366922 conn(0x564935681260 msgr2=0x5649357082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 -- 172.21.15.139:0/2145366922 shutdown_connections 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 -- 172.21.15.139:0/2145366922 wait complete. 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 -- start start 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 Processor -- start 2023-10-08T13:34:42.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.164+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x564935716f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570c7a0 0x564935714270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493565fe30 con 0x564935717650 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649355fc710 con 0x56493570be80 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649355fc3b0 con 0x56493570c7a0 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 10 client.0 _ll_register_callbacks cb 0x564935459800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43398/0 (socket says 172.21.15.139:43398) 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 -- 172.21.15.139:0/156305246 learned_addr learned my addr 172.21.15.139:0/156305246 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x564935716f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdec959a700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570c7a0 0x564935714270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 -- 172.21.15.139:0/156305246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570c7a0 msgr2=0x564935714270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570c7a0 0x564935714270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 -- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 msgr2=0x564935716f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x564935716f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 -- 172.21.15.139:0/156305246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec410cde0 con 0x564935717650 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdeca59c700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdebc099a70 tx=0x7fdebc0996d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a995da06b3ef14d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc09a1d0 con 0x564935717650 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fdebc01b320 con 0x564935717650 2023-10-08T13:34:42.174 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564935627eb0 con 0x564935717650 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdebc09a470 con 0x564935717650 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.165+0000 7fded81e8b80 10 client.17130 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x564935473c60 con 0x564935717650 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564935627eb0 con 0x564935717650 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdebc099260 con 0x564935717650 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 10 client.17130 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 20 client.17130 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5649357271a0 0x5649357295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 4 client.17130 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564935658e10 con 0x5649357271a0 2023-10-08T13:34:42.175 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5649357271a0 0x5649357295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fdead7fa700 10 client.17130 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.166+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5649357271a0 0x5649357295c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22b5607058c7d746 server_cookie=aab7684b336542fb in_seq=0 out_seq=0 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fdead7fa700 1 -- 172.21.15.139:0/156305246 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564935658e10 con 0x5649357271a0 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fdead7fa700 10 client.17130 handle_command_reply: tid=0 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 client.17130 shutdown 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 msgr2=0x564935714830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fdebc099a70 tx=0x7fdebc0996d0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 shutdown_connections 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x5649357271a0 0x5649357295c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.176 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935714830 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570be80 0x564935716f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 --2- 172.21.15.139:0/156305246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570c7a0 0x564935714270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fdead7fa700 0 client.17130 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 >> 172.21.15.139:0/156305246 conn(0x564935681260 msgr2=0x564935707ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 shutdown_connections 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.167+0000 7fded81e8b80 1 -- 172.21.15.139:0/156305246 wait complete. 2023-10-08T13:34:42.177 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.168+0000 7fded81e8b80 20 client.17130 trim_cache size 0 max 16384 2023-10-08T13:34:42.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 Processor -- start 2023-10-08T13:34:42.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 -- start start 2023-10-08T13:34:42.183 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x56493571e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570c7a0 0x5649357147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649354e0920 con 0x564935717650 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649356ffb10 con 0x56493570c7a0 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.180+0000 7fded81e8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564935729c20 con 0x56493570be80 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43406/0 (socket says 172.21.15.139:43406) 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 -- 172.21.15.139:0/2166808017 learned_addr learned my addr 172.21.15.139:0/2166808017 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x56493571e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.184 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdec959a700 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570c7a0 0x5649357147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 -- 172.21.15.139:0/2166808017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 msgr2=0x56493571e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x56493571e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 -- 172.21.15.139:0/2166808017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570c7a0 msgr2=0x5649357147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570c7a0 0x5649357147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 -- 172.21.15.139:0/2166808017 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649354b1250 con 0x564935717650 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c7a0 tx=0x7fdebc098320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2a5cfe1dd62e18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeb8ff9700 1 -- 172.21.15.139:0/2166808017 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc01b320 con 0x564935717650 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeb8ff9700 1 -- 172.21.15.139:0/2166808017 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdebc09d030 con 0x564935717650 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.181+0000 7fdeb8ff9700 1 -- 172.21.15.139:0/2166808017 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc09dec0 con 0x564935717650 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- 172.21.15.139:0/2166808017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 msgr2=0x564935707d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.185 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c7a0 tx=0x7fdebc098320 comp rx=0 tx=0).stop 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- 172.21.15.139:0/2166808017 shutdown_connections 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564935717650 0x564935707d70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x56493571e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2166808017 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56493570c7a0 0x5649357147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- 172.21.15.139:0/2166808017 >> 172.21.15.139:0/2166808017 conn(0x564935681260 msgr2=0x564935712b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- 172.21.15.139:0/2166808017 shutdown_connections 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- 172.21.15.139:0/2166808017 wait complete. 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 -- start start 2023-10-08T13:34:42.186 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.182+0000 7fded81e8b80 1 Processor -- start 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x5649357196b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 0x564935718210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x564935718920 con 0x56493570c7a0 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493577cfb0 con 0x564935717650 2023-10-08T13:34:42.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56493577d0f0 con 0x56493570be80 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 10 client.0 _ll_register_callbacks cb 0x7fdebc099b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43410/0 (socket says 172.21.15.139:43410) 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 -- 172.21.15.139:0/2714446850 learned_addr learned my addr 172.21.15.139:0/2714446850 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 0x564935718210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x5649357196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 -- 172.21.15.139:0/2714446850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 msgr2=0x5649357196b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x5649357196b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 -- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 msgr2=0x564935718210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 0x564935718210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 -- 172.21.15.139:0/2714446850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564935473c60 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdeca59c700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 0x564935718210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdec959a700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdec00098e0 tx=0x7fdec000ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b6ae19d9e864ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec001d040 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fdec0004770 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.183+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdec001e040 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdec0004930 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 10 client.17136 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5649354892b0 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdec001e040 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7fdec0036b80 con 0x56493570c7a0 2023-10-08T13:34:42.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 10 client.17136 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 10 client.17136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 20 client.17136 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56493577e510 0x564935780930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 4 client.17136 mds_command: new command op to 24599 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 --> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564935658b30 con 0x56493577e510 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.184+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56493577e510 0x564935780930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fdead7fa700 10 client.17136 ms_handle_connect on v2:172.21.15.155:6838/4212065890 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fdec9d9b700 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56493577e510 0x564935780930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2fea1176a0d109f server_cookie=5ac62f7b27974fe9 in_seq=0 out_seq=0 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fdead7fa700 1 -- 172.21.15.139:0/2714446850 <== mds.2 v2:172.21.15.155:6838/4212065890 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17300 (crc 0 0 0) 0x564935658b30 con 0x56493577e510 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fdead7fa700 10 client.17136 handle_command_reply: tid=0 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 client.17136 shutdown 2023-10-08T13:34:42.193 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 msgr2=0x564935717ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdec00098e0 tx=0x7fdec000ba30 comp rx=0 tx=0).stop 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 shutdown_connections 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:6838/4212065890,v1:172.21.15.155:6839/4212065890] conn(0x56493577e510 0x564935780930 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564935717650 0x564935718210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fdead7fa700 0 client.17136 ms_handle_reset on v2:172.21.15.155:6838/4212065890 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56493570be80 0x5649357196b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 --2- 172.21.15.139:0/2714446850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56493570c7a0 0x564935717ad0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 >> 172.21.15.139:0/2714446850 conn(0x564935681260 msgr2=0x564935707d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.185+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 shutdown_connections 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fded81e8b80 1 -- 172.21.15.139:0/2714446850 wait complete. 2023-10-08T13:34:42.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fded81e8b80 20 client.17136 trim_cache size 0 max 16384 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 124810917, 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629086, 2023-10-08T13:34:42.195 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out" 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 294370859, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630128, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out" 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 340997727, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628234, 2023-10-08T13:34:42.196 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out" 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 354298249, 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630124, 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out" 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 371924592, 2023-10-08T13:34:42.197 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629732, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out" 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 437114954, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629270, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out" 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 450890871, 2023-10-08T13:34:42.198 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628320, 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out" 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 466519302, 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627843, 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD" 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.199 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 485968549, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629476, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out" 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 521219147, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627845, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master" 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.200 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 563795504, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629278, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out" 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 616051553, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630156, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out" 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.201 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 740881096, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629928, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out" 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 768333504, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628999, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out" 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.202 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 838491795, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629736, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out" 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 838938777, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628238, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out" 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.203 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 895048760, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629080, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out" 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 979001577, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628246, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out" 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.204 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1020887321, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629912, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out" 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1134265549, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629698, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out" 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.205 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1134464522, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629774, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out" 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1242015952, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628987, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out" 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.206 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1318537642, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629067, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out" 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1602232635, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629114, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out" 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.207 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1672697710, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630010, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out" 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1726547561, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629394, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out" 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.208 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1859260440, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627837, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes" 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1875732264, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629500, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out" 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.209 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1886864661, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629292, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out" 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1910849451, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628222, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out" 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.210 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1938713158, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629132, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out" 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1946715993, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627839, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD" 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.211 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2003165179, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628334, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out" 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2117907706, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627836, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs" 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2128645573, 2023-10-08T13:34:42.212 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627838, 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin" 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2203029734, 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629844, 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out" 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.213 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2212412370, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629768, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out" 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2213934774, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629576, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out" 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.214 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2249879220, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629742, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out" 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2270120314, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629059, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out" 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.215 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2368131612, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629508, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out" 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2440449738, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629968, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out" 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.216 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2456128077, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629918, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out" 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2457543978, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629824, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out" 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.217 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2521450079, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628837, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out" 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2534297808, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628895, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out" 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.218 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2588571062, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628298, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out" 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2624291517, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629864, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out" 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.219 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2702022638, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629424, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out" 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2727615623, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627844, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads" 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.220 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2783453885, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629138, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out" 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2814427279, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629238, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out" 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.221 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2868318498, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628945, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out" 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2993063012, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629750, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out" 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3056878919, 2023-10-08T13:34:42.222 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628248, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out" 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3065188648, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629666, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out" 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3069733774, 2023-10-08T13:34:42.223 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629276, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out" 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3116315931, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629708, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out" 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3122952478, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630092, 2023-10-08T13:34:42.224 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out" 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3317219061, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627793, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude" 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3635173179, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630044, 2023-10-08T13:34:42.225 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out" 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3638865059, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629632, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out" 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3640877298, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629524, 2023-10-08T13:34:42.226 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out" 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3662223323, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629228, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out" 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3692822922, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629038, 2023-10-08T13:34:42.227 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default" 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3808388774, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629234, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out" 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3814924378, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629082, 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out" 2023-10-08T13:34:42.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3834540248, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629990, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out" 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3855421065, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629065, 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out" 2023-10-08T13:34:42.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3944533094, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629440, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out" 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4097364178, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629936, 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out" 2023-10-08T13:34:42.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4135793842, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628266, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out" 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4213560154, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629142, 2023-10-08T13:34:42.231 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out" 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4256586274, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629882, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out" 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4294957871, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629256, 2023-10-08T13:34:42.232 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out" 2023-10-08T13:34:42.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:42.233 INFO:teuthology.orchestra.run.smithi139.stdout:] 2023-10-08T13:34:42.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 msgr2=0x7fdeb00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 0x7fdeb00a3ab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4005fd0 tx=0x7fdeb4005e50 comp rx=0 tx=0).stop 2023-10-08T13:34:42.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 msgr2=0x7fdec41957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00ef30 tx=0x7fdebc00c3a0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.234 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 shutdown_connections 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fdeb00a15f0 0x7fdeb00a3ab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdec41056b0 0x7fdec41957b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdec40ff620 0x7fdec419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 --2- 172.21.15.139:0/1027408794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdec40fffe0 0x7fdec419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 >> 172.21.15.139:0/1027408794 conn(0x7fdec4076780 msgr2=0x7fdec40fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 shutdown_connections 2023-10-08T13:34:42.235 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.186+0000 7fdecbfff700 1 -- 172.21.15.139:0/1027408794 wait complete. 2023-10-08T13:34:42.235 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T13:34:42.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 -- 172.21.15.139:0/1864914380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200ffff0 msgr2=0x7f982010c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 --2- 172.21.15.139:0/1864914380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200ffff0 0x7f982010c500 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f981800b0a0 tx=0x7f981800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.361 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 -- 172.21.15.139:0/1864914380 shutdown_connections 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 --2- 172.21.15.139:0/1864914380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98200ffff0 0x7f982010c500 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 --2- 172.21.15.139:0/1864914380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9820105640 0x7f9820105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 --2- 172.21.15.139:0/1864914380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ff630 0x7f98200ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 -- 172.21.15.139:0/1864914380 >> 172.21.15.139:0/1864914380 conn(0x7f98200767f0 msgr2=0x7f9820076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 -- 172.21.15.139:0/1864914380 shutdown_connections 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.358+0000 7f9825675700 1 -- 172.21.15.139:0/1864914380 wait complete. 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 Processor -- start 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 -- start start 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 0x7f9820197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ffff0 0x7f9820197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.362 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820198710 con 0x7f9820105640 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201a2f20 con 0x7f98200ffff0 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f9825675700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98201a3060 con 0x7f98200ff630 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43426/0 (socket says 172.21.15.139:43426) 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 -- 172.21.15.139:0/3552779965 learned_addr learned my addr 172.21.15.139:0/3552779965 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981e7fc700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ffff0 0x7f9820197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981effd700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 0x7f9820197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 -- 172.21.15.139:0/3552779965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 msgr2=0x7f9820197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 0x7f9820197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 -- 172.21.15.139:0/3552779965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ffff0 msgr2=0x7f9820197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.363 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ffff0 0x7f9820197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.359+0000 7f981f7fe700 1 -- 172.21.15.139:0/3552779965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818009d00 con 0x7f9820105640 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f981effd700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 0x7f9820197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f981f7fe700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f981800b070 tx=0x7f9818007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f9807fff700 1 -- 172.21.15.139:0/3552779965 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800e040 con 0x7f9820105640 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98201a3290 con 0x7f9820105640 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f9807fff700 1 -- 172.21.15.139:0/3552779965 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9818012dc0 con 0x7f9820105640 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f9807fff700 1 -- 172.21.15.139:0/3552779965 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981801b450 con 0x7f9820105640 2023-10-08T13:34:42.364 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.360+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98201a3760 con 0x7f9820105640 2023-10-08T13:34:42.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.362+0000 7f9807fff700 1 -- 172.21.15.139:0/3552779965 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f981801d680 con 0x7f9820105640 2023-10-08T13:34:42.370 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.362+0000 7f9807fff700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 0x7f98080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.362+0000 7f9807fff700 1 -- 172.21.15.139:0/3552779965 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f98180cf340 con 0x7f9820105640 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.363+0000 7f981effd700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 0x7f98080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.363+0000 7f981effd700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 0x7f98080a3ab0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9814005e10 tx=0x7f9814005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.363+0000 7f983185eb80 1 Processor -- start 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.363+0000 7f983185eb80 1 -- start start 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6513460 con 0x5580d65aa7a0 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6504c20 con 0x5580d65a9e80 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f983185eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6502540 con 0x5580d65b5650 2023-10-08T13:34:42.371 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43432/0 (socket says 172.21.15.139:43432) 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 -- 172.21.15.139:0/1596974690 learned_addr learned my addr 172.21.15.139:0/1596974690 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981effd700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981f7fe700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 -- 172.21.15.139:0/1596974690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 msgr2=0x5580d65b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 -- 172.21.15.139:0/1596974690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 msgr2=0x5580d65aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 -- 172.21.15.139:0/1596974690 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d6328de0 con 0x5580d65aa7a0 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981f7fe700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981effd700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:42.372 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f981e7fc700 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f981000bd30 tx=0x7f98100106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d423ca15a2c8ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f98057fa700 1 -- 172.21.15.139:0/1596974690 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810010ec0 con 0x5580d65aa7a0 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f98057fa700 1 -- 172.21.15.139:0/1596974690 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9810015070 con 0x5580d65aa7a0 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.364+0000 7f98057fa700 1 -- 172.21.15.139:0/1596974690 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810003e90 con 0x5580d65aa7a0 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- 172.21.15.139:0/1596974690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 msgr2=0x5580d65b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f981000bd30 tx=0x7f98100106b0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- 172.21.15.139:0/1596974690 shutdown_connections 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 --2- 172.21.15.139:0/1596974690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b5110 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- 172.21.15.139:0/1596974690 >> 172.21.15.139:0/1596974690 conn(0x5580d651f260 msgr2=0x5580d65a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- 172.21.15.139:0/1596974690 shutdown_connections 2023-10-08T13:34:42.373 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- 172.21.15.139:0/1596974690 wait complete. 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.365+0000 7f983185eb80 1 -- start start 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 Processor -- start 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d64fde30 con 0x5580d65aa7a0 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d649a710 con 0x5580d65a9e80 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d649a3b0 con 0x5580d65b5650 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f983185eb80 10 client.0 _ll_register_callbacks cb 0x5580d62f7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43438/0 (socket says 172.21.15.139:43438) 2023-10-08T13:34:42.374 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 -- 172.21.15.139:0/4000987027 learned_addr learned my addr 172.21.15.139:0/4000987027 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981effd700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981f7fe700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 -- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 msgr2=0x5580d65b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 -- 172.21.15.139:0/4000987027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 msgr2=0x5580d65b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 -- 172.21.15.139:0/4000987027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981000b960 con 0x5580d65aa7a0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f981e7fc700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f981000b930 tx=0x7f9810010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9560e99dc945d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.366+0000 7f9802ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810020070 con 0x5580d65aa7a0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9810017070 con 0x5580d65aa7a0 2023-10-08T13:34:42.375 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580d64c5eb0 con 0x5580d65aa7a0 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9810005250 con 0x5580d65aa7a0 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 10 client.17148 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5580d6311c60 con 0x5580d65aa7a0 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5580d64c5eb0 con 0x5580d65aa7a0 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f98100114d0 con 0x5580d65aa7a0 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 10 client.17148 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 10 client.17148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 20 client.17148 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d65c4f00 0x5580d65c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 4 client.17148 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580d64f6e10 con 0x5580d65c4f00 2023-10-08T13:34:42.376 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.367+0000 7f981effd700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d65c4f00 0x5580d65c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.368+0000 7f9802ff5700 10 client.17148 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.368+0000 7f981effd700 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d65c4f00 0x5580d65c7320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37d6ffcc290c5331 server_cookie=895df51e49998d1e in_seq=0 out_seq=0 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.368+0000 7f9802ff5700 1 -- 172.21.15.139:0/4000987027 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5580d64f6e10 con 0x5580d65c4f00 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.368+0000 7f9802ff5700 10 client.17148 handle_command_reply: tid=0 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.368+0000 7f983185eb80 1 client.17148 shutdown 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 msgr2=0x5580d65b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f981000b930 tx=0x7f9810010ef0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 shutdown_connections 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d65c4f00 0x5580d65c7320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f9802ff5700 0 client.17148 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:34:42.377 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 --2- 172.21.15.139:0/4000987027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b2290 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 >> 172.21.15.139:0/4000987027 conn(0x5580d651f260 msgr2=0x5580d65a5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 shutdown_connections 2023-10-08T13:34:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 1 -- 172.21.15.139:0/4000987027 wait complete. 2023-10-08T13:34:42.378 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.369+0000 7f983185eb80 20 client.17148 trim_cache size 0 max 16384 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 Processor -- start 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 -- start start 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65a9e80 0x5580d65bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65b5650 0x5580d65b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d637e920 con 0x5580d65aa7a0 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d65a2b40 con 0x5580d65b5650 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.381+0000 7f983185eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d65ab0d0 con 0x5580d65a9e80 2023-10-08T13:34:42.384 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43446/0 (socket says 172.21.15.139:43446) 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 -- 172.21.15.139:0/645111129 learned_addr learned my addr 172.21.15.139:0/645111129 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 -- 172.21.15.139:0/645111129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65a9e80 msgr2=0x5580d65bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65a9e80 0x5580d65bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 -- 172.21.15.139:0/645111129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65b5650 msgr2=0x5580d65b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65b5650 0x5580d65b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 -- 172.21.15.139:0/645111129 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d65a57a0 con 0x5580d65aa7a0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f981e7fc700 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9810011010 tx=0x7f981000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb3110a237db7ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f9805ffb700 1 -- 172.21.15.139:0/645111129 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810020040 con 0x5580d65aa7a0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f9805ffb700 1 -- 172.21.15.139:0/645111129 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9810005710 con 0x5580d65aa7a0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.382+0000 7f9805ffb700 1 -- 172.21.15.139:0/645111129 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810003ea0 con 0x5580d65aa7a0 2023-10-08T13:34:42.385 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- 172.21.15.139:0/645111129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 msgr2=0x5580d65b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9810011010 tx=0x7f981000b710 comp rx=0 tx=0).stop 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- 172.21.15.139:0/645111129 shutdown_connections 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65b5650 0x5580d65b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65a9e80 0x5580d65bc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- 172.21.15.139:0/645111129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65b0b60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- 172.21.15.139:0/645111129 >> 172.21.15.139:0/645111129 conn(0x5580d651f260 msgr2=0x5580d65ad5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- 172.21.15.139:0/645111129 shutdown_connections 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- 172.21.15.139:0/645111129 wait complete. 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- start start 2023-10-08T13:34:42.386 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 Processor -- start 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6618d50 con 0x5580d65aa7a0 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6618e90 con 0x5580d65a9e80 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d6619050 con 0x5580d65b5650 2023-10-08T13:34:42.390 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f983185eb80 10 client.0 _ll_register_callbacks cb 0x7f981000bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43452/0 (socket says 172.21.15.139:43452) 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f981e7fc700 1 -- 172.21.15.139:0/3557902507 learned_addr learned my addr 172.21.15.139:0/3557902507 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.383+0000 7f981f7fe700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981effd700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 -- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 msgr2=0x5580d65af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 -- 172.21.15.139:0/3557902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 msgr2=0x5580d65aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 -- 172.21.15.139:0/3557902507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580d6311c60 con 0x5580d65aa7a0 2023-10-08T13:34:42.391 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981effd700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f981e7fc700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f98100106f0 tx=0x7f98100116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d6c12b02ef9a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f9802ff5700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810020040 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9810017070 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9810015070 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9810003b00 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f983185eb80 10 client.17154 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5580d634f250 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.384+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9810015070 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f9810033c90 con 0x5580d65aa7a0 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 10 client.17154 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.392 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 10 client.17154 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.c 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 20 client.17154 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d661a5d0 0x5580d661c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 4 client.17154 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 --> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5580d64f6b30 con 0x5580d661a5d0 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f981effd700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d661a5d0 0x5580d661c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f9802ff5700 10 client.17154 ms_handle_connect on v2:172.21.15.187:6836/3566030950 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.385+0000 7f981effd700 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d661a5d0 0x5580d661c9f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=361f351b1d32e59e server_cookie=c415610c9edaccbc in_seq=0 out_seq=0 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f9802ff5700 1 -- 172.21.15.139:0/3557902507 <== mds.1 v2:172.21.15.187:6836/3566030950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26836 (crc 0 0 0) 0x5580d64f6b30 con 0x5580d661a5d0 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f9802ff5700 10 client.17154 handle_command_reply: tid=0 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 client.17154 shutdown 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 msgr2=0x5580d65af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f98100106f0 tx=0x7f98100116f0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 shutdown_connections 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:6836/3566030950,v1:172.21.15.187:6837/3566030950] conn(0x5580d661a5d0 0x5580d661c9f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5580d65b5650 0x5580d65af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f9802ff5700 0 client.17154 ms_handle_reset on v2:172.21.15.187:6836/3566030950 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5580d65a9e80 0x5580d65aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 --2- 172.21.15.139:0/3557902507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5580d65aa7a0 0x5580d65af360 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 >> 172.21.15.139:0/3557902507 conn(0x5580d651f260 msgr2=0x5580d65b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.386+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 shutdown_connections 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f983185eb80 1 -- 172.21.15.139:0/3557902507 wait complete. 2023-10-08T13:34:42.394 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f983185eb80 20 client.17154 trim_cache size 0 max 16384 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout:[ 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 19341033, 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627986, 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4" 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 57853211, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627939, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros" 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 68388851, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627800, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample" 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.396 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 144705888, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627998, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4" 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 172918853, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627954, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile" 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 185094706, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629224, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out" 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 275925510, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627959, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c" 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 284863606, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627809, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads" 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 397029977, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627810, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags" 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 430119477, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627808, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs" 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 435446515, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627984, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4" 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 560113471, 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627958, 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c" 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 579730807, 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627995, 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4" 2023-10-08T13:34:42.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 605872967, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627899, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest" 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 699500601, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627806, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample" 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 765998071, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627988, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4" 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 784182407, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627996, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4" 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 797285089, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629286, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out" 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 802629108, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627870, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile" 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 806858016, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627967, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c" 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 815718675, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627945, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh" 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 825284047, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627942, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h" 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 833464313, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627936, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile" 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 876235957, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627947, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h" 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 911565272, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627974, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h" 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 964439098, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627982, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4" 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 990040525, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627819, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack" 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1115590269, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628991, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out" 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1129547958, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627956, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c" 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.409 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1229704650, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627962, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c" 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1248676156, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627951, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h" 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1252865784, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627960, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c" 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1266666657, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630056, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out" 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1352657295, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627866, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile" 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1373600674, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627944, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h" 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1395712689, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627798, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample" 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1422801086, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630054, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out" 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1435489935, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629972, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out" 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1507644691, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627878, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2" 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1522778802, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630080, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out" 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1522885833, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629100, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out" 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.415 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1627169599, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629880, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out" 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1628955463, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627972, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c" 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.416 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1660892313, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627829, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow" 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1666619451, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627965, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c" 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1684918875, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630006, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out" 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1706679600, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511628973, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out" 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1708615122, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627993, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4" 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1789136527, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627827, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx" 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.419 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1850925135, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627943, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h" 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1888436196, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627794, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks" 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.420 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1888686243, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627902, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs" 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1892465955, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627987, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4" 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.421 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1896371655, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627847, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config" 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1903061767, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629850, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out" 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.422 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1909125262, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627807, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample" 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1958812348, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627904, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf" 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1990165345, 2023-10-08T13:34:42.423 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627790, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches" 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 1992788737, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627869, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar" 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2040517921, 2023-10-08T13:34:42.424 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627804, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample" 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2082976011, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627833, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin" 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2122750148, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627791, 2023-10-08T13:34:42.425 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description" 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2192999899, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627964, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c" 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2216599084, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627915, 2023-10-08T13:34:42.426 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names" 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2343903497, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627873, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile" 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2417956335, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627796, 2023-10-08T13:34:42.427 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample" 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2575158592, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627961, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c" 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2590911299, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627792, 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info" 2023-10-08T13:34:42.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2609556509, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627803, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample" 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2609830672, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627880, 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag" 2023-10-08T13:34:42.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2611488884, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627963, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c" 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2745758707, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627983, 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4" 2023-10-08T13:34:42.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2761983433, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627826, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack" 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2812850425, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627977, 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c" 2023-10-08T13:34:42.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2826609213, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629886, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out" 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2843282944, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627948, 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h" 2023-10-08T13:34:42.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2911531332, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629486, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out" 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2939309161, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627842, 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master" 2023-10-08T13:34:42.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2944525566, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627797, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample" 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2963605973, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627818, 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects" 2023-10-08T13:34:42.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2970529374, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627801, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample" 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2990276101, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627929, 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES" 2023-10-08T13:34:42.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 2995943157, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627940, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules" 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3008076195, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627865, 2023-10-08T13:34:42.436 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm" 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3012645858, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627831, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs" 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3026261627, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627955, 2023-10-08T13:34:42.437 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c" 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3203053607, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627799, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample" 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3204855407, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627927, 2023-10-08T13:34:42.438 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash" 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3238440577, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629502, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out" 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3266717277, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511630108, 2023-10-08T13:34:42.439 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out" 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3268073704, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627930, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt" 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3301778044, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627950, 2023-10-08T13:34:42.440 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h" 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3315054111, 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627966, 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c" 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3318164387, 2023-10-08T13:34:42.441 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627979, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh" 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3370662758, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627949, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h" 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3372302082, 2023-10-08T13:34:42.442 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627994, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4" 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3391443650, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627864, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile" 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3508567888, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629926, 2023-10-08T13:34:42.443 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out" 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3551549689, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627925, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README" 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3711819305, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627867, 2023-10-08T13:34:42.444 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template" 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3721095170, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627952, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h" 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3722318908, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627805, 2023-10-08T13:34:42.445 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample" 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3811740125, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627885, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk" 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3826870796, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627946, 2023-10-08T13:34:42.446 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h" 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3838120572, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627832, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes" 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3863084685, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627941, 2023-10-08T13:34:42.447 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h" 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3867050682, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629600, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out" 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3905247109, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627926, 2023-10-08T13:34:42.448 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit" 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3918945522, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627957, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c" 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3933236793, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627834, 2023-10-08T13:34:42.449 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD" 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3935825939, 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627985, 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4" 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3993162354, 2023-10-08T13:34:42.450 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627802, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample" 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 3997281936, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629334, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out" 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4146231741, 2023-10-08T13:34:42.451 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627835, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs" 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4191185079, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511629770, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out" 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4213656839, 2023-10-08T13:34:42.452 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627820, 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info" 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: "damage_type": "backtrace", 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4277558176, 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1099511627795, 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: "path": "/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample" 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:34:42.453 INFO:teuthology.orchestra.run.smithi139.stdout:] 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 msgr2=0x7f98080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 0x7f98080a3ab0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9814005e10 tx=0x7f9814005d60 comp rx=0 tx=0).stop 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 msgr2=0x7f98201a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f981800b070 tx=0x7f9818007b70 comp rx=0 tx=0).stop 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 shutdown_connections 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f98080a15f0 0x7f98080a3ab0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9820105640 0x7f98201a29e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98200ff630 0x7f9820197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 --2- 172.21.15.139:0/3552779965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98200ffff0 0x7f9820197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 >> 172.21.15.139:0/3552779965 conn(0x7f98200767f0 msgr2=0x7f9820102200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 shutdown_connections 2023-10-08T13:34:42.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.387+0000 7f9825675700 1 -- 172.21.15.139:0/3552779965 wait complete. 2023-10-08T13:34:42.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- 172.21.15.139:0/1493975100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9678100000 msgr2=0x7f967810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- 172.21.15.139:0/1493975100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9678100000 0x7f967810c510 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f967000b0a0 tx=0x7f967000b3b0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- 172.21.15.139:0/1493975100 shutdown_connections 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- 172.21.15.139:0/1493975100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9678100000 0x7f967810c510 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- 172.21.15.139:0/1493975100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678105650 0x7f9678105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- 172.21.15.139:0/1493975100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96780ff640 0x7f96780ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.585 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- 172.21.15.139:0/1493975100 >> 172.21.15.139:0/1493975100 conn(0x7f96780767c0 msgr2=0x7f9678076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- 172.21.15.139:0/1493975100 shutdown_connections 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- 172.21.15.139:0/1493975100 wait complete. 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 Processor -- start 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- start start 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 0x7f9678195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 0x7f96781961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.582+0000 7f967ed66700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781a4e60 con 0x7f96780ff640 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967ed66700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781a4fa0 con 0x7f9678105650 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967ed66700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96781a5160 con 0x7f9678100000 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.586 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43462/0 (socket says 172.21.15.139:43462) 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 -- 172.21.15.139:0/972331531 learned_addr learned my addr 172.21.15.139:0/972331531 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967d303700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 0x7f96781961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f9677fff700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 0x7f9678195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 -- 172.21.15.139:0/972331531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 msgr2=0x7f9678195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 0x7f9678195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 -- 172.21.15.139:0/972331531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 msgr2=0x7f96781961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 0x7f96781961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 -- 172.21.15.139:0/972331531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009d00 con 0x7f96780ff640 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f9677fff700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 0x7f9678195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967d303700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 0x7f96781961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:42.587 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967cb02700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f966c00d950 tx=0x7f966c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f9675ffb700 1 -- 172.21.15.139:0/972331531 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c009b40 con 0x7f96780ff640 2023-10-08T13:34:42.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f9675ffb700 1 -- 172.21.15.139:0/972331531 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f966c009ca0 con 0x7f96780ff640 2023-10-08T13:34:42.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96781a5440 con 0x7f96780ff640 2023-10-08T13:34:42.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.583+0000 7f9675ffb700 1 -- 172.21.15.139:0/972331531 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c00f620 con 0x7f96780ff640 2023-10-08T13:34:42.588 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.584+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96781a5950 con 0x7f96780ff640 2023-10-08T13:34:42.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.586+0000 7f9675ffb700 1 -- 172.21.15.139:0/972331531 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f966c010460 con 0x7f96780ff640 2023-10-08T13:34:42.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f9675ffb700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 0x7f96680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f9677fff700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 0x7f96680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.594 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f9675ffb700 1 -- 172.21.15.139:0/972331531 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f966c0cd810 con 0x7f96780ff640 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f9677fff700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 0x7f96680a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9664005fd0 tx=0x7f9664005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f968af4fb80 1 Processor -- start 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.587+0000 7f968af4fb80 1 -- start start 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e2b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e2da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d89460 con 0x5596b3e1fe80 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d7ac20 con 0x5596b3e2b650 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f968af4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d78540 con 0x5596b3e207a0 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.595 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43470/0 (socket says 172.21.15.139:43470) 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 -- 172.21.15.139:0/60367653 learned_addr learned my addr 172.21.15.139:0/60367653 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967d303700 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e2da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f9677fff700 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e2b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 -- 172.21.15.139:0/60367653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 msgr2=0x5596b3e2b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e2b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 -- 172.21.15.139:0/60367653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 msgr2=0x5596b3e2da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e2da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 -- 172.21.15.139:0/60367653 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b3b9ede0 con 0x5596b3e1fe80 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f967cb02700 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f966c0a2260 tx=0x7f966c09a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b396d8bf9a876b42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f9662ffd700 1 -- 172.21.15.139:0/60367653 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c09ab00 con 0x5596b3e1fe80 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f9662ffd700 1 -- 172.21.15.139:0/60367653 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f966c09a400 con 0x5596b3e1fe80 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.588+0000 7f9662ffd700 1 -- 172.21.15.139:0/60367653 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966c0cd620 con 0x5596b3e1fe80 2023-10-08T13:34:42.596 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- 172.21.15.139:0/60367653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 msgr2=0x5596b3e20260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f966c0a2260 tx=0x7f966c09a300 comp rx=0 tx=0).stop 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- 172.21.15.139:0/60367653 shutdown_connections 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e2da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e1fe80 0x5596b3e20260 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 --2- 172.21.15.139:0/60367653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e2b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- 172.21.15.139:0/60367653 >> 172.21.15.139:0/60367653 conn(0x5596b3d95260 msgr2=0x5596b3e1c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- 172.21.15.139:0/60367653 shutdown_connections 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- 172.21.15.139:0/60367653 wait complete. 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.589+0000 7f968af4fb80 1 -- start start 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 Processor -- start 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.597 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e28af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d73e30 con 0x5596b3e207a0 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d10710 con 0x5596b3e2b650 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3d103b0 con 0x5596b3e1fe80 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f968af4fb80 10 client.0 _ll_register_callbacks cb 0x5596b3b6d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43478/0 (socket says 172.21.15.139:43478) 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 -- 172.21.15.139:0/2447310256 learned_addr learned my addr 172.21.15.139:0/2447310256 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f967cb02700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f967d303700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e28af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 -- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 msgr2=0x5596b3e2b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e2b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 -- 172.21.15.139:0/2447310256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 msgr2=0x5596b3e28af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e28af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.590+0000 7f9677fff700 1 -- 172.21.15.139:0/2447310256 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96781a5950 con 0x5596b3e207a0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9677fff700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9664005bf0 tx=0x7f96640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d8214031811e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664004a30 con 0x5596b3e207a0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596b3d3beb0 con 0x5596b3e207a0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f9664004b90 con 0x5596b3e207a0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f966400eea0 con 0x5596b3e207a0 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 10 client.17166 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5596b3b87c60 con 0x5596b3e207a0 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5596b3d3beb0 con 0x5596b3e207a0 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f966401e880 con 0x5596b3e207a0 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 10 client.17166 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 20 client.17166 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e3b1a0 0x5596b3e3d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 4 client.17166 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.591+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596b3d6ce10 con 0x5596b3e3b1a0 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.592+0000 7f967cb02700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e3b1a0 0x5596b3e3d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.592+0000 7f9657fff700 10 client.17166 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:42.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.592+0000 7f967cb02700 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e3b1a0 0x5596b3e3d5c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6057712b9831a424 server_cookie=73c935c9eeb1a967 in_seq=0 out_seq=0 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.592+0000 7f9657fff700 1 -- 172.21.15.139:0/2447310256 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5596b3d6ce10 con 0x5596b3e3b1a0 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.592+0000 7f9657fff700 10 client.17166 handle_command_reply: tid=0 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 client.17166 shutdown 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 msgr2=0x5596b3e283b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9664005bf0 tx=0x7f96640047c0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 shutdown_connections 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e3b1a0 0x5596b3e3d5c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e28af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f9657fff700 0 client.17166 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2447310256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e283b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 >> 172.21.15.139:0/2447310256 conn(0x5596b3d95260 msgr2=0x5596b3e1bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 shutdown_connections 2023-10-08T13:34:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 1 -- 172.21.15.139:0/2447310256 wait complete. 2023-10-08T13:34:42.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.593+0000 7f968af4fb80 20 client.17166 trim_cache size 0 max 16384 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 Processor -- start 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 -- start start 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e3d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3bf4920 con 0x5596b3e207a0 2023-10-08T13:34:42.609 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3e29320 con 0x5596b3e2b650 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f968af4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3e32620 con 0x5596b3e1fe80 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f9677fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f9677fff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43484/0 (socket says 172.21.15.139:43484) 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.606+0000 7f9677fff700 1 -- 172.21.15.139:0/2066861357 learned_addr learned my addr 172.21.15.139:0/2066861357 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 -- 172.21.15.139:0/2066861357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 msgr2=0x5596b3e3d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e3d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 -- 172.21.15.139:0/2066861357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 msgr2=0x5596b3e236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f967d303700 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.610 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 -- 172.21.15.139:0/2066861357 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b3bc5250 con 0x5596b3e207a0 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f967d303700 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f9677fff700 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9664009410 tx=0x7f96640099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5203fa63be48e7a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f96637fe700 1 -- 172.21.15.139:0/2066861357 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400ee80 con 0x5596b3e207a0 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f96637fe700 1 -- 172.21.15.139:0/2066861357 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9664011d60 con 0x5596b3e207a0 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.607+0000 7f96637fe700 1 -- 172.21.15.139:0/2066861357 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640052a0 con 0x5596b3e207a0 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- 172.21.15.139:0/2066861357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 msgr2=0x5596b3e320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9664009410 tx=0x7f96640099e0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- 172.21.15.139:0/2066861357 shutdown_connections 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e2b650 0x5596b3e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e1fe80 0x5596b3e3d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2066861357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e207a0 0x5596b3e320e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.611 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- 172.21.15.139:0/2066861357 >> 172.21.15.139:0/2066861357 conn(0x5596b3d95260 msgr2=0x5596b3e17f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- 172.21.15.139:0/2066861357 shutdown_connections 2023-10-08T13:34:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- 172.21.15.139:0/2066861357 wait complete. 2023-10-08T13:34:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 -- start start 2023-10-08T13:34:42.612 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.608+0000 7f968af4fb80 1 Processor -- start 2023-10-08T13:34:42.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 0x5596b3e318c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.615 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e31e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3e30530 con 0x5596b3e2b650 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3e306a0 con 0x5596b3e1fe80 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b3e30860 con 0x5596b3e207a0 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 10 client.0 _ll_register_callbacks cb 0x7f966400ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43494/0 (socket says 172.21.15.139:43494) 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 -- 172.21.15.139:0/2217052194 learned_addr learned my addr 172.21.15.139:0/2217052194 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967cb02700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 0x5596b3e318c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f9677fff700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e31e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.616 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 -- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 msgr2=0x5596b3e31e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e31e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 -- 172.21.15.139:0/2217052194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 msgr2=0x5596b3e318c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 0x5596b3e318c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 -- 172.21.15.139:0/2217052194 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596b3b87c60 con 0x5596b3e2b650 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967cb02700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 0x5596b3e318c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f967d303700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f967000b0a0 tx=0x7f9670004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a504adff1ab6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f9657fff700 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670020070 con 0x5596b3e2b650 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f966c09a400 con 0x5596b3e2b650 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mon.0 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f96700076f0 con 0x5596b3e2b650 2023-10-08T13:34:42.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f967000e040 con 0x5596b3e2b650 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 10 client.17172 fetch_fsmap learned FSMap version 52 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.609+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5596b3b9d2b0 con 0x5596b3e2b650 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mon.0 v2:172.21.15.139:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f966c09a400 con 0x5596b3e2b650 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mon.0 v2:172.21.15.139:3300/0 5 ==== fsmap(e 52) v1 ==== 7970+0+0 (secure 0 0 0) 0x7f967000b0d0 con 0x5596b3e2b650 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 10 client.17172 fetch_fsmap finished waiting for FSMap version 52 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 20 client.17172 populate_metadata read hostname 'smithi139' 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e902c0 0x5596b3e926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 4 client.17172 mds_command: new command op to 24628 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 --> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5596b3d6cb30 con 0x5596b3e902c0 2023-10-08T13:34:42.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f967cb02700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e902c0 0x5596b3e926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f9657fff700 10 client.17172 ms_handle_connect on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.610+0000 7f967cb02700 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e902c0 0x5596b3e926e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad7abfc9f5a8b52 server_cookie=d2608eb138f17c18 in_seq=0 out_seq=0 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f9657fff700 1 -- 172.21.15.139:0/2217052194 <== mds.0 v2:172.21.15.187:6838/3909111900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5596b3d6cb30 con 0x5596b3e902c0 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f9657fff700 10 client.17172 handle_command_reply: tid=0 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 client.17172 shutdown 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 msgr2=0x5596b3e2ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f967000b0a0 tx=0x7f9670004e70 comp rx=0 tx=0).stop 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 shutdown_connections 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5596b3e2b650 0x5596b3e2ff60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:6838/3909111900,v1:172.21.15.187:6839/3909111900] conn(0x5596b3e902c0 0x5596b3e926e0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596b3e1fe80 0x5596b3e318c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f9657fff700 0 client.17172 ms_handle_reset on v2:172.21.15.187:6838/3909111900 2023-10-08T13:34:42.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 --2- 172.21.15.139:0/2217052194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596b3e207a0 0x5596b3e31e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 >> 172.21.15.139:0/2217052194 conn(0x5596b3d95260 msgr2=0x5596b3e236b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 shutdown_connections 2023-10-08T13:34:42.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 1 -- 172.21.15.139:0/2217052194 wait complete. 2023-10-08T13:34:42.620 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f968af4fb80 20 client.17172 trim_cache size 0 max 16384 2023-10-08T13:34:42.620 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 msgr2=0x7f96680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 0x7f96680a3ab0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9664005fd0 tx=0x7f9664005ee0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 msgr2=0x7f9678195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.611+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f966c00d950 tx=0x7f966c00dd10 comp rx=0 tx=0).stop 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 shutdown_connections 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f96680a15f0 0x7f96680a3ab0 secure :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9664005fd0 tx=0x7f9664005ee0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678105650 0x7f96781961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96780ff640 0x7f9678195750 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 --2- 172.21.15.139:0/972331531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9678100000 0x7f9678195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:34:42.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 >> 172.21.15.139:0/972331531 conn(0x7f96780767c0 msgr2=0x7f96780fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:34:42.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 shutdown_connections 2023-10-08T13:34:42.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:34:42.612+0000 7f967ed66700 1 -- 172.21.15.139:0/972331531 wait complete. 2023-10-08T13:34:42.625 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 1257815, 'ino': 1099511628835, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/006.out'}, {'damage_type': 'backtrace', 'id': 479853129, 'ino': 1099511628857, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/017.out'}, {'damage_type': 'backtrace', 'id': 790081681, 'ino': 1099511628943, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/271.out'}, {'damage_type': 'backtrace', 'id': 802583395, 'ino': 1099511629208, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/118.out'}, {'damage_type': 'backtrace', 'id': 960587314, 'ino': 1099511628316, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/056.out'}, {'damage_type': 'backtrace', 'id': 1256067091, 'ino': 1099511629586, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/307.out'}, {'damage_type': 'backtrace', 'id': 1377104057, 'ino': 1099511629404, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/216.out'}, {'damage_type': 'backtrace', 'id': 1505368164, 'ino': 1099511629726, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/377.out'}, {'damage_type': 'backtrace', 'id': 1525295135, 'ino': 1099511630000, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/514.out'}, {'damage_type': 'backtrace', 'id': 1540720638, 'ino': 1099511628841, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/009.out'}, {'damage_type': 'backtrace', 'id': 1645870298, 'ino': 1099511629944, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/486.out'}, {'damage_type': 'backtrace', 'id': 1671156165, 'ino': 1099511628867, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/022.out'}, {'damage_type': 'backtrace', 'id': 1852797461, 'ino': 1099511629868, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/448.out'}, {'damage_type': 'backtrace', 'id': 1910154527, 'ino': 1099511628230, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/013.out'}, {'damage_type': 'backtrace', 'id': 1954323012, 'ino': 1099511628258, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/027.out'}, {'damage_type': 'backtrace', 'id': 2112877908, 'ino': 1099511629546, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/287.out'}, {'damage_type': 'backtrace', 'id': 2209312573, 'ino': 1099511629039, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.nfs'}, {'damage_type': 'backtrace', 'id': 2235742864, 'ino': 1099511629372, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/200.out'}, {'damage_type': 'backtrace', 'id': 2395101064, 'ino': 1099511629402, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/215.out'}, {'damage_type': 'backtrace', 'id': 2653917512, 'ino': 1099511628885, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/031.out'}, {'damage_type': 'backtrace', 'id': 2708780047, 'ino': 1099511628314, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/055.out'}, {'damage_type': 'backtrace', 'id': 2907210122, 'ino': 1099511628822, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/001.cfg'}, {'damage_type': 'backtrace', 'id': 3087674753, 'ino': 1099511629498, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/263.out'}, {'damage_type': 'backtrace', 'id': 3124524153, 'ino': 1099511629420, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/224.out'}, {'damage_type': 'backtrace', 'id': 3158112586, 'ino': 1099511630086, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/557.out'}, {'damage_type': 'backtrace', 'id': 3158529048, 'ino': 1099511628318, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/057.out'}, {'damage_type': 'backtrace', 'id': 3166111214, 'ino': 1099511628959, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/308.out'}, {'damage_type': 'backtrace', 'id': 3291255889, 'ino': 1099511629168, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/098.out'}, {'damage_type': 'backtrace', 'id': 3489174970, 'ino': 1099511628348, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/072.out'}, {'damage_type': 'backtrace', 'id': 3663543598, 'ino': 1099511628853, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/015.out'}, {'damage_type': 'backtrace', 'id': 3755394709, 'ino': 1099511628330, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/063.out'}, {'damage_type': 'backtrace', 'id': 3790817424, 'ino': 1099511629714, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/371.out'}, {'damage_type': 'backtrace', 'id': 4024421630, 'ino': 1099511629288, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/158.out'}, {'damage_type': 'backtrace', 'id': 4060663980, 'ino': 1099511629264, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/146.out'}, {'damage_type': 'backtrace', 'id': 4084057255, 'ino': 1099511628865, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/021.out'}, {'damage_type': 'backtrace', 'id': 4086043851, 'ino': 1099511628881, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/029.out'}] 2023-10-08T13:34:42.625 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 136160446, 'ino': 1099511629450, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/239.out'}, {'damage_type': 'backtrace', 'id': 215826735, 'ino': 1099511629942, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/485.out'}, {'damage_type': 'backtrace', 'id': 262605626, 'ino': 1099511629664, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/346.out'}, {'damage_type': 'backtrace', 'id': 293823456, 'ino': 1099511629013, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/023.out'}, {'damage_type': 'backtrace', 'id': 353184186, 'ino': 1099511629422, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/225.out'}, {'damage_type': 'backtrace', 'id': 366989941, 'ino': 1099511628875, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/026.out'}, {'damage_type': 'backtrace', 'id': 452931766, 'ino': 1099511630028, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/528.out'}, {'damage_type': 'backtrace', 'id': 504329648, 'ino': 1099511628270, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/033.out'}, {'damage_type': 'backtrace', 'id': 518550442, 'ino': 1099511628843, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/010.out'}, {'damage_type': 'backtrace', 'id': 556346581, 'ino': 1099511628907, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/042.out'}, {'damage_type': 'backtrace', 'id': 707658861, 'ino': 1099511629998, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/513.out'}, {'damage_type': 'backtrace', 'id': 843534983, 'ino': 1099511629828, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/428.out'}, {'damage_type': 'backtrace', 'id': 858759399, 'ino': 1099511629166, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/097.out'}, {'damage_type': 'backtrace', 'id': 1021341226, 'ino': 1099511629958, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/493.out'}, {'damage_type': 'backtrace', 'id': 1114603228, 'ino': 1099511628977, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/005.out'}, {'damage_type': 'backtrace', 'id': 1126310918, 'ino': 1099511628354, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/075.out'}, {'damage_type': 'backtrace', 'id': 1155642915, 'ino': 1099511628306, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/051.out'}, {'damage_type': 'backtrace', 'id': 1180696439, 'ino': 1099511628280, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/038.out'}, {'damage_type': 'backtrace', 'id': 1309717912, 'ino': 1099511628260, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/028.out'}, {'damage_type': 'backtrace', 'id': 1471432323, 'ino': 1099511629216, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/122.out'}, {'damage_type': 'backtrace', 'id': 1488742236, 'ino': 1099511630002, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/515.out'}, {'damage_type': 'backtrace', 'id': 1569006581, 'ino': 1099511628244, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/020.out'}, {'damage_type': 'backtrace', 'id': 1580373396, 'ino': 1099511629684, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/356.out'}, {'damage_type': 'backtrace', 'id': 1609572519, 'ino': 1099511629188, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/108.out'}, {'damage_type': 'backtrace', 'id': 1643087860, 'ino': 1099511629236, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/132.out'}, {'damage_type': 'backtrace', 'id': 1688130646, 'ino': 1099511629730, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/379.out'}, {'damage_type': 'backtrace', 'id': 1798068011, 'ino': 1099511628871, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/024.out'}, {'damage_type': 'backtrace', 'id': 1895439319, 'ino': 1099511628957, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/307.out'}, {'damage_type': 'backtrace', 'id': 1918339571, 'ino': 1099511629206, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/117.out'}, {'damage_type': 'backtrace', 'id': 1972840053, 'ino': 1099511629984, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/506.out'}, {'damage_type': 'backtrace', 'id': 2213980080, 'ino': 1099511629490, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/259.out'}, {'damage_type': 'backtrace', 'id': 2278416786, 'ino': 1099511629862, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/445.out'}, {'damage_type': 'backtrace', 'id': 2295287734, 'ino': 1099511629112, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/070.out'}, {'damage_type': 'backtrace', 'id': 2322894311, 'ino': 1099511629150, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/089.out'}, {'damage_type': 'backtrace', 'id': 2326390597, 'ino': 1099511629015, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/024.out'}, {'damage_type': 'backtrace', 'id': 2342717976, 'ino': 1099511628953, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/305.out'}, {'damage_type': 'backtrace', 'id': 2383219929, 'ino': 1099511629186, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/107.out'}, {'damage_type': 'backtrace', 'id': 2383969730, 'ino': 1099511629268, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/148.out'}, {'damage_type': 'backtrace', 'id': 2547153099, 'ino': 1099511628264, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/030.out'}, {'damage_type': 'backtrace', 'id': 2594993905, 'ino': 1099511629126, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/077.out'}, {'damage_type': 'backtrace', 'id': 2597312975, 'ino': 1099511628995, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/014.out'}, {'damage_type': 'backtrace', 'id': 2640245450, 'ino': 1099511628869, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/023.out'}, {'damage_type': 'backtrace', 'id': 2819386186, 'ino': 1099511628949, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/303.out'}, {'damage_type': 'backtrace', 'id': 2936692123, 'ino': 1099511628322, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/059.out'}, {'damage_type': 'backtrace', 'id': 2959982778, 'ino': 1099511628352, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/074.out'}, {'damage_type': 'backtrace', 'id': 3006608110, 'ino': 1099511629744, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/386.out'}, {'damage_type': 'backtrace', 'id': 3034604831, 'ino': 1099511629342, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/185.out'}, {'damage_type': 'backtrace', 'id': 3151196276, 'ino': 1099511629816, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/422.out'}, {'damage_type': 'backtrace', 'id': 3392926828, 'ino': 1099511628282, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/039.out'}, {'damage_type': 'backtrace', 'id': 3518348549, 'ino': 1099511629444, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/236.out'}, {'damage_type': 'backtrace', 'id': 3584443046, 'ino': 1099511628851, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/014.out'}, {'damage_type': 'backtrace', 'id': 3637074260, 'ino': 1099511629190, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/109.out'}, {'damage_type': 'backtrace', 'id': 3677323260, 'ino': 1099511628873, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/025.out'}, {'damage_type': 'backtrace', 'id': 3804854062, 'ino': 1099511629682, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/355.out'}, {'damage_type': 'backtrace', 'id': 3871640168, 'ino': 1099511628342, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/069.out'}, {'damage_type': 'backtrace', 'id': 4015981233, 'ino': 1099511628206, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/001.out'}, {'damage_type': 'backtrace', 'id': 4029454824, 'ino': 1099511628268, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/032.out'}, {'damage_type': 'backtrace', 'id': 4104129431, 'ino': 1099511628304, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/050.out'}, {'damage_type': 'backtrace', 'id': 4163986813, 'ino': 1099511629005, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/019.out'}, {'damage_type': 'backtrace', 'id': 4188812450, 'ino': 1099511629430, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/229.out'}, {'damage_type': 'backtrace', 'id': 4210842160, 'ino': 1099511629148, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/088.out'}, {'damage_type': 'backtrace', 'id': 4231164238, 'ino': 1099511629298, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/163.out'}, {'damage_type': 'backtrace', 'id': 4250526889, 'ino': 1099511629934, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/481.out'}, {'damage_type': 'backtrace', 'id': 4275611577, 'ino': 1099511629364, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/196.out'}] 2023-10-08T13:34:42.625 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 124810917, 'ino': 1099511629086, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/057.out'}, {'damage_type': 'backtrace', 'id': 294370859, 'ino': 1099511630128, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/578.out'}, {'damage_type': 'backtrace', 'id': 340997727, 'ino': 1099511628234, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/015.out'}, {'damage_type': 'backtrace', 'id': 354298249, 'ino': 1099511630124, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/576.out'}, {'damage_type': 'backtrace', 'id': 371924592, 'ino': 1099511629732, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/380.out'}, {'damage_type': 'backtrace', 'id': 437114954, 'ino': 1099511629270, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/149.out'}, {'damage_type': 'backtrace', 'id': 450890871, 'ino': 1099511628320, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/058.out'}, {'damage_type': 'backtrace', 'id': 466519302, 'ino': 1099511627843, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/HEAD'}, {'damage_type': 'backtrace', 'id': 485968549, 'ino': 1099511629476, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/252.out'}, {'damage_type': 'backtrace', 'id': 521219147, 'ino': 1099511627845, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 563795504, 'ino': 1099511629278, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/153.out'}, {'damage_type': 'backtrace', 'id': 616051553, 'ino': 1099511630156, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/592.out'}, {'damage_type': 'backtrace', 'id': 740881096, 'ino': 1099511629928, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/478.out'}, {'damage_type': 'backtrace', 'id': 768333504, 'ino': 1099511628999, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/016.out'}, {'damage_type': 'backtrace', 'id': 838491795, 'ino': 1099511629736, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/382.out'}, {'damage_type': 'backtrace', 'id': 838938777, 'ino': 1099511628238, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/017.out'}, {'damage_type': 'backtrace', 'id': 895048760, 'ino': 1099511629080, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/054.out'}, {'damage_type': 'backtrace', 'id': 979001577, 'ino': 1099511628246, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/021.out'}, {'damage_type': 'backtrace', 'id': 1020887321, 'ino': 1099511629912, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/470.out'}, {'damage_type': 'backtrace', 'id': 1134265549, 'ino': 1099511629698, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/363.out'}, {'damage_type': 'backtrace', 'id': 1134464522, 'ino': 1099511629774, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/401.out'}, {'damage_type': 'backtrace', 'id': 1242015952, 'ino': 1099511628987, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/010.out'}, {'damage_type': 'backtrace', 'id': 1318537642, 'ino': 1099511629067, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/049.out'}, {'damage_type': 'backtrace', 'id': 1602232635, 'ino': 1099511629114, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/071.out'}, {'damage_type': 'backtrace', 'id': 1672697710, 'ino': 1099511630010, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/519.out'}, {'damage_type': 'backtrace', 'id': 1726547561, 'ino': 1099511629394, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/211.out'}, {'damage_type': 'backtrace', 'id': 1859260440, 'ino': 1099511627837, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes'}, {'damage_type': 'backtrace', 'id': 1875732264, 'ino': 1099511629500, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/264.out'}, {'damage_type': 'backtrace', 'id': 1886864661, 'ino': 1099511629292, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/160.out'}, {'damage_type': 'backtrace', 'id': 1910849451, 'ino': 1099511628222, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/009.out'}, {'damage_type': 'backtrace', 'id': 1938713158, 'ino': 1099511629132, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/080.out'}, {'damage_type': 'backtrace', 'id': 1946715993, 'ino': 1099511627839, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 2003165179, 'ino': 1099511628334, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/065.out'}, {'damage_type': 'backtrace', 'id': 2117907706, 'ino': 1099511627836, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs'}, {'damage_type': 'backtrace', 'id': 2128645573, 'ino': 1099511627838, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 2203029734, 'ino': 1099511629844, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/436.out'}, {'damage_type': 'backtrace', 'id': 2212412370, 'ino': 1099511629768, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/398.out'}, {'damage_type': 'backtrace', 'id': 2213934774, 'ino': 1099511629576, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/302.out'}, {'damage_type': 'backtrace', 'id': 2249879220, 'ino': 1099511629742, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/385.out'}, {'damage_type': 'backtrace', 'id': 2270120314, 'ino': 1099511629059, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/045.out'}, {'damage_type': 'backtrace', 'id': 2368131612, 'ino': 1099511629508, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/268.out'}, {'damage_type': 'backtrace', 'id': 2440449738, 'ino': 1099511629968, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/498.out'}, {'damage_type': 'backtrace', 'id': 2456128077, 'ino': 1099511629918, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/473.out'}, {'damage_type': 'backtrace', 'id': 2457543978, 'ino': 1099511629824, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/426.out'}, {'damage_type': 'backtrace', 'id': 2521450079, 'ino': 1099511628837, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/007.out'}, {'damage_type': 'backtrace', 'id': 2534297808, 'ino': 1099511628895, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/036.out'}, {'damage_type': 'backtrace', 'id': 2588571062, 'ino': 1099511628298, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/047.out'}, {'damage_type': 'backtrace', 'id': 2624291517, 'ino': 1099511629864, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/446.out'}, {'damage_type': 'backtrace', 'id': 2702022638, 'ino': 1099511629424, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/226.out'}, {'damage_type': 'backtrace', 'id': 2727615623, 'ino': 1099511627844, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs/refs/heads'}, {'damage_type': 'backtrace', 'id': 2783453885, 'ino': 1099511629138, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/083.out'}, {'damage_type': 'backtrace', 'id': 2814427279, 'ino': 1099511629238, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/133.out'}, {'damage_type': 'backtrace', 'id': 2868318498, 'ino': 1099511628945, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/ext4/301.out'}, {'damage_type': 'backtrace', 'id': 2993063012, 'ino': 1099511629750, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/389.out'}, {'damage_type': 'backtrace', 'id': 3056878919, 'ino': 1099511628248, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/022.out'}, {'damage_type': 'backtrace', 'id': 3065188648, 'ino': 1099511629666, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/347.out'}, {'damage_type': 'backtrace', 'id': 3069733774, 'ino': 1099511629276, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/152.out'}, {'damage_type': 'backtrace', 'id': 3116315931, 'ino': 1099511629708, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/368.out'}, {'damage_type': 'backtrace', 'id': 3122952478, 'ino': 1099511630092, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/560.out'}, {'damage_type': 'backtrace', 'id': 3317219061, 'ino': 1099511627793, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info/exclude'}, {'damage_type': 'backtrace', 'id': 3635173179, 'ino': 1099511630044, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/536.out'}, {'damage_type': 'backtrace', 'id': 3638865059, 'ino': 1099511629632, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/330.out'}, {'damage_type': 'backtrace', 'id': 3640877298, 'ino': 1099511629524, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/276.out'}, {'damage_type': 'backtrace', 'id': 3662223323, 'ino': 1099511629228, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/128.out'}, {'damage_type': 'backtrace', 'id': 3692822922, 'ino': 1099511629038, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/035.out.default'}, {'damage_type': 'backtrace', 'id': 3808388774, 'ino': 1099511629234, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/131.out'}, {'damage_type': 'backtrace', 'id': 3814924378, 'ino': 1099511629082, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/055.out'}, {'damage_type': 'backtrace', 'id': 3834540248, 'ino': 1099511629990, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/509.out'}, {'damage_type': 'backtrace', 'id': 3855421065, 'ino': 1099511629065, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/048.out'}, {'damage_type': 'backtrace', 'id': 3944533094, 'ino': 1099511629440, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/234.out'}, {'damage_type': 'backtrace', 'id': 4097364178, 'ino': 1099511629936, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/482.out'}, {'damage_type': 'backtrace', 'id': 4135793842, 'ino': 1099511628266, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/btrfs/031.out'}, {'damage_type': 'backtrace', 'id': 4213560154, 'ino': 1099511629142, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/085.out'}, {'damage_type': 'backtrace', 'id': 4256586274, 'ino': 1099511629882, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/455.out'}, {'damage_type': 'backtrace', 'id': 4294957871, 'ino': 1099511629256, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/142.out'}] 2023-10-08T13:34:42.626 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 19341033, 'ino': 1099511627986, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_gdbmdev.m4'}, {'damage_type': 'backtrace', 'id': 57853211, 'ino': 1099511627939, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildmacros'}, {'damage_type': 'backtrace', 'id': 68388851, 'ino': 1099511627800, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-rebase.sample'}, {'damage_type': 'backtrace', 'id': 144705888, 'ino': 1099511627998, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/visibility_hidden.m4'}, {'damage_type': 'backtrace', 'id': 172918853, 'ino': 1099511627954, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/Makefile'}, {'damage_type': 'backtrace', 'id': 185094706, 'ino': 1099511629224, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/126.out'}, {'damage_type': 'backtrace', 'id': 275925510, 'ino': 1099511627959, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/forker.c'}, {'damage_type': 'backtrace', 'id': 284863606, 'ino': 1099511627809, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads'}, {'damage_type': 'backtrace', 'id': 397029977, 'ino': 1099511627810, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/tags'}, {'damage_type': 'backtrace', 'id': 430119477, 'ino': 1099511627808, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs'}, {'damage_type': 'backtrace', 'id': 435446515, 'ino': 1099511627984, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_acldev.m4'}, {'damage_type': 'backtrace', 'id': 560113471, 'ino': 1099511627958, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/file_lock.c'}, {'damage_type': 'backtrace', 'id': 579730807, 'ino': 1099511627995, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_utilies.m4'}, {'damage_type': 'backtrace', 'id': 605872967, 'ino': 1099511627899, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/locktest'}, {'damage_type': 'backtrace', 'id': 699500601, 'ino': 1099511627806, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-receive.sample'}, {'damage_type': 'backtrace', 'id': 765998071, 'ino': 1099511627988, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_libbtrfs.m4'}, {'damage_type': 'backtrace', 'id': 784182407, 'ino': 1099511627996, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_uuiddev.m4'}, {'damage_type': 'backtrace', 'id': 797285089, 'ino': 1099511629286, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/157.out'}, {'damage_type': 'backtrace', 'id': 802629108, 'ino': 1099511627870, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar/Makefile'}, {'damage_type': 'backtrace', 'id': 806858016, 'ino': 1099511627967, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/write_log.c'}, {'damage_type': 'backtrace', 'id': 815718675, 'ino': 1099511627945, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/install-sh'}, {'damage_type': 'backtrace', 'id': 825284047, 'ino': 1099511627942, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/databin.h'}, {'damage_type': 'backtrace', 'id': 833464313, 'ino': 1099511627936, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/Makefile'}, {'damage_type': 'backtrace', 'id': 876235957, 'ino': 1099511627947, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/pattern.h'}, {'damage_type': 'backtrace', 'id': 911565272, 'ino': 1099511627974, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/doio.h'}, {'damage_type': 'backtrace', 'id': 964439098, 'ino': 1099511627982, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/manual_format.m4'}, {'damage_type': 'backtrace', 'id': 990040525, 'ino': 1099511627819, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack'}, {'damage_type': 'backtrace', 'id': 1115590269, 'ino': 1099511628991, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/012.out'}, {'damage_type': 'backtrace', 'id': 1129547958, 'ino': 1099511627956, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/databin.c'}, {'damage_type': 'backtrace', 'id': 1229704650, 'ino': 1099511627962, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random.c'}, {'damage_type': 'backtrace', 'id': 1248676156, 'ino': 1099511627951, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/tlibio.h'}, {'damage_type': 'backtrace', 'id': 1252865784, 'ino': 1099511627960, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/open_flags.c'}, {'damage_type': 'backtrace', 'id': 1266666657, 'ino': 1099511630056, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/542.out'}, {'damage_type': 'backtrace', 'id': 1352657295, 'ino': 1099511627866, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/Makefile'}, {'damage_type': 'backtrace', 'id': 1373600674, 'ino': 1099511627944, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/forker.h'}, {'damage_type': 'backtrace', 'id': 1395712689, 'ino': 1099511627798, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/update.sample'}, {'damage_type': 'backtrace', 'id': 1422801086, 'ino': 1099511630054, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/541.out'}, {'damage_type': 'backtrace', 'id': 1435489935, 'ino': 1099511629972, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/500.out'}, {'damage_type': 'backtrace', 'id': 1507644691, 'ino': 1099511627878, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/cgroup2'}, {'damage_type': 'backtrace', 'id': 1522778802, 'ino': 1099511630080, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/554.out'}, {'damage_type': 'backtrace', 'id': 1522885833, 'ino': 1099511629100, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/064.out'}, {'damage_type': 'backtrace', 'id': 1627169599, 'ino': 1099511629880, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/454.out'}, {'damage_type': 'backtrace', 'id': 1628955463, 'ino': 1099511627972, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/aio-stress.c'}, {'damage_type': 'backtrace', 'id': 1660892313, 'ino': 1099511627829, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/shallow'}, {'damage_type': 'backtrace', 'id': 1666619451, 'ino': 1099511627965, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/string_to_tokens.c'}, {'damage_type': 'backtrace', 'id': 1684918875, 'ino': 1099511630006, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/517.out'}, {'damage_type': 'backtrace', 'id': 1706679600, 'ino': 1099511628973, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/003.out'}, {'damage_type': 'backtrace', 'id': 1708615122, 'ino': 1099511627993, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_pthread.m4'}, {'damage_type': 'backtrace', 'id': 1789136527, 'ino': 1099511627827, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.idx'}, {'damage_type': 'backtrace', 'id': 1850925135, 'ino': 1099511627943, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/file_lock.h'}, {'damage_type': 'backtrace', 'id': 1888436196, 'ino': 1099511627794, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks'}, {'damage_type': 'backtrace', 'id': 1888686243, 'ino': 1099511627902, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/nfs'}, {'damage_type': 'backtrace', 'id': 1892465955, 'ino': 1099511627987, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_globals.m4'}, {'damage_type': 'backtrace', 'id': 1896371655, 'ino': 1099511627847, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/config'}, {'damage_type': 'backtrace', 'id': 1903061767, 'ino': 1099511629850, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/439.out'}, {'damage_type': 'backtrace', 'id': 1909125262, 'ino': 1099511627807, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/push-to-checkout.sample'}, {'damage_type': 'backtrace', 'id': 1958812348, 'ino': 1099511627904, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/perf'}, {'damage_type': 'backtrace', 'id': 1990165345, 'ino': 1099511627790, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/branches'}, {'damage_type': 'backtrace', 'id': 1992788737, 'ino': 1099511627869, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/tar'}, {'damage_type': 'backtrace', 'id': 2040517921, 'ino': 1099511627804, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-applypatch.sample'}, {'damage_type': 'backtrace', 'id': 2082976011, 'ino': 1099511627833, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin'}, {'damage_type': 'backtrace', 'id': 2122750148, 'ino': 1099511627791, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/description'}, {'damage_type': 'backtrace', 'id': 2192999899, 'ino': 1099511627964, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/str_to_bytes.c'}, {'damage_type': 'backtrace', 'id': 2216599084, 'ino': 1099511627915, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/test_names'}, {'damage_type': 'backtrace', 'id': 2343903497, 'ino': 1099511627873, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/Makefile'}, {'damage_type': 'backtrace', 'id': 2417956335, 'ino': 1099511627796, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-push.sample'}, {'damage_type': 'backtrace', 'id': 2575158592, 'ino': 1099511627961, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/pattern.c'}, {'damage_type': 'backtrace', 'id': 2590911299, 'ino': 1099511627792, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/info'}, {'damage_type': 'backtrace', 'id': 2609556509, 'ino': 1099511627803, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/fsmonitor-watchman.sample'}, {'damage_type': 'backtrace', 'id': 2609830672, 'ino': 1099511627880, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/defrag'}, {'damage_type': 'backtrace', 'id': 2611488884, 'ino': 1099511627963, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/random_range.c'}, {'damage_type': 'backtrace', 'id': 2745758707, 'ino': 1099511627983, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/multilib.m4'}, {'damage_type': 'backtrace', 'id': 2761983433, 'ino': 1099511627826, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/pack/pack-6711aff88cdc7b062fc99b73bbb60335d5611fa8.pack'}, {'damage_type': 'backtrace', 'id': 2812850425, 'ino': 1099511627977, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/growfiles.c'}, {'damage_type': 'backtrace', 'id': 2826609213, 'ino': 1099511629886, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/457.out'}, {'damage_type': 'backtrace', 'id': 2843282944, 'ino': 1099511627948, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/random_range.h'}, {'damage_type': 'backtrace', 'id': 2911531332, 'ino': 1099511629486, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/257.out'}, {'damage_type': 'backtrace', 'id': 2939309161, 'ino': 1099511627842, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/heads/master'}, {'damage_type': 'backtrace', 'id': 2944525566, 'ino': 1099511627797, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-commit.sample'}, {'damage_type': 'backtrace', 'id': 2963605973, 'ino': 1099511627818, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects'}, {'damage_type': 'backtrace', 'id': 2970529374, 'ino': 1099511627801, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/post-update.sample'}, {'damage_type': 'backtrace', 'id': 2990276101, 'ino': 1099511627929, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/CHANGES'}, {'damage_type': 'backtrace', 'id': 2995943157, 'ino': 1099511627940, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/buildrules'}, {'damage_type': 'backtrace', 'id': 3008076195, 'ino': 1099511627865, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm'}, {'damage_type': 'backtrace', 'id': 3012645858, 'ino': 1099511627831, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/packed-refs'}, {'damage_type': 'backtrace', 'id': 3026261627, 'ino': 1099511627955, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/dataascii.c'}, {'damage_type': 'backtrace', 'id': 3203053607, 'ino': 1099511627799, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/commit-msg.sample'}, {'damage_type': 'backtrace', 'id': 3204855407, 'ino': 1099511627927, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/xfscrash'}, {'damage_type': 'backtrace', 'id': 3238440577, 'ino': 1099511629502, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/265.out'}, {'damage_type': 'backtrace', 'id': 3266717277, 'ino': 1099511630108, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/568.out'}, {'damage_type': 'backtrace', 'id': 3268073704, 'ino': 1099511627930, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/doc/auxiliary-programs.txt'}, {'damage_type': 'backtrace', 'id': 3301778044, 'ino': 1099511627950, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/string_to_tokens.h'}, {'damage_type': 'backtrace', 'id': 3315054111, 'ino': 1099511627966, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/tlibio.c'}, {'damage_type': 'backtrace', 'id': 3318164387, 'ino': 1099511627979, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/ltp/rwtest.sh'}, {'damage_type': 'backtrace', 'id': 3370662758, 'ino': 1099511627949, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/str_to_bytes.h'}, {'damage_type': 'backtrace', 'id': 3372302082, 'ino': 1099511627994, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_types.m4'}, {'damage_type': 'backtrace', 'id': 3391443650, 'ino': 1099511627864, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/Makefile'}, {'damage_type': 'backtrace', 'id': 3508567888, 'ino': 1099511629926, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/477.out'}, {'damage_type': 'backtrace', 'id': 3551549689, 'ino': 1099511627925, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/README'}, {'damage_type': 'backtrace', 'id': 3711819305, 'ino': 1099511627867, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/build/rpm/macros.template'}, {'damage_type': 'backtrace', 'id': 3721095170, 'ino': 1099511627952, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/write_log.h'}, {'damage_type': 'backtrace', 'id': 3722318908, 'ino': 1099511627805, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/applypatch-msg.sample'}, {'damage_type': 'backtrace', 'id': 3811740125, 'ino': 1099511627885, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/common/dmhugedisk'}, {'damage_type': 'backtrace', 'id': 3826870796, 'ino': 1099511627946, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/open_flags.h'}, {'damage_type': 'backtrace', 'id': 3838120572, 'ino': 1099511627832, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes'}, {'damage_type': 'backtrace', 'id': 3863084685, 'ino': 1099511627941, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/include/dataascii.h'}, {'damage_type': 'backtrace', 'id': 3867050682, 'ino': 1099511629600, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/314.out'}, {'damage_type': 'backtrace', 'id': 3905247109, 'ino': 1099511627926, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/crash/rc.sysinit'}, {'damage_type': 'backtrace', 'id': 3918945522, 'ino': 1099511627957, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/lib/datapid.c'}, {'damage_type': 'backtrace', 'id': 3933236793, 'ino': 1099511627834, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/refs/remotes/origin/HEAD'}, {'damage_type': 'backtrace', 'id': 3935825939, 'ino': 1099511627985, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/m4/package_aiodev.m4'}, {'damage_type': 'backtrace', 'id': 3993162354, 'ino': 1099511627802, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/pre-merge-commit.sample'}, {'damage_type': 'backtrace', 'id': 3997281936, 'ino': 1099511629334, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/181.out'}, {'damage_type': 'backtrace', 'id': 4146231741, 'ino': 1099511627835, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/logs'}, {'damage_type': 'backtrace', 'id': 4191185079, 'ino': 1099511629770, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/tests/generic/399.out'}, {'damage_type': 'backtrace', 'id': 4213656839, 'ino': 1099511627820, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/objects/info'}, {'damage_type': 'backtrace', 'id': 4277558176, 'ino': 1099511627795, 'path': '/volumes/_nogroup/sv_1/fd33dcf5-3a36-4924-b584-e7cb8ee69587/client.0/tmp/xfstests-dev/.git/hooks/prepare-commit-msg.sample'}] 2023-10-08T13:34:42.626 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-10-08T13:34:42.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:42 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/166953556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:34:42.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:42 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/166953556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:34:42.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:42 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/166953556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:34:43.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:43 smithi155 ceph-mon[103467]: pgmap v520: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2023-10-08T13:34:43.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:43 smithi139 ceph-mon[99506]: pgmap v520: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2023-10-08T13:34:43.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:43 smithi187 ceph-mon[104336]: pgmap v520: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2023-10-08T13:34:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:45 smithi155 ceph-mon[103467]: pgmap v521: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:34:46.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:45 smithi139 ceph-mon[99506]: pgmap v521: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:34:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:45 smithi187 ceph-mon[104336]: pgmap v521: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T13:34:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:47 smithi155 ceph-mon[103467]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-08T13:34:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:47 smithi139 ceph-mon[99506]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-08T13:34:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:47 smithi187 ceph-mon[104336]: pgmap v522: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2023-10-08T13:34:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:49 smithi155 ceph-mon[103467]: pgmap v523: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:49 smithi139 ceph-mon[99506]: pgmap v523: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:49 smithi187 ceph-mon[104336]: pgmap v523: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:51 smithi155 ceph-mon[103467]: pgmap v524: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2023-10-08T13:34:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:51 smithi139 ceph-mon[99506]: pgmap v524: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2023-10-08T13:34:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:51 smithi187 ceph-mon[104336]: pgmap v524: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2023-10-08T13:34:52.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:34:52.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:34:52.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi155 to 196.2M 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi139 to 196.2M 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Unable to set osd_memory_target on smithi155 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Unable to set osd_memory_target on smithi139 to 205750988: error parsing value: Value '205750988' is below minimum 939524096 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.848 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Adjusting osd_memory_target on smithi187 to 196.2M 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: Unable to set osd_memory_target on smithi187 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:34:53.849 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:34:53.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:53 smithi155 ceph-mon[103467]: pgmap v525: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:53.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi155 to 196.2M 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi139 to 196.2M 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Unable to set osd_memory_target on smithi155 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-08T13:34:53.938 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Unable to set osd_memory_target on smithi139 to 205750988: error parsing value: Value '205750988' is below minimum 939524096 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Adjusting osd_memory_target on smithi187 to 196.2M 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: Unable to set osd_memory_target on smithi187 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:34:53.939 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:53 smithi139 ceph-mon[99506]: pgmap v525: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi155 to 196.2M 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi139 to 196.2M 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Unable to set osd_memory_target on smithi155 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-10-08T13:34:53.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Unable to set osd_memory_target on smithi139 to 205750988: error parsing value: Value '205750988' is below minimum 939524096 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Adjusting osd_memory_target on smithi187 to 196.2M 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: Unable to set osd_memory_target on smithi187 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:34:53.978 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:53 smithi187 ceph-mon[104336]: pgmap v525: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T13:34:56.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:55 smithi155 ceph-mon[103467]: pgmap v526: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:34:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:55 smithi139 ceph-mon[99506]: pgmap v526: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:34:56.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:55 smithi187 ceph-mon[104336]: pgmap v526: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-10-08T13:34:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:57 smithi155 ceph-mon[103467]: pgmap v527: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:34:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:57 smithi139 ceph-mon[99506]: pgmap v527: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:34:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:57 smithi187 ceph-mon[104336]: pgmap v527: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 10 op/s 2023-10-08T13:35:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:34:59 smithi155 ceph-mon[103467]: pgmap v528: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:34:59 smithi139 ceph-mon[99506]: pgmap v528: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:00.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:34:59 smithi187 ceph-mon[104336]: pgmap v528: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:01 smithi155 ceph-mon[103467]: pgmap v529: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:01 smithi139 ceph-mon[99506]: pgmap v529: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:01 smithi187 ceph-mon[104336]: pgmap v529: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:03 smithi155 ceph-mon[103467]: pgmap v530: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:04.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:03 smithi139 ceph-mon[99506]: pgmap v530: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:04.298 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:03 smithi187 ceph-mon[104336]: pgmap v530: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:05 smithi155 ceph-mon[103467]: pgmap v531: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:05 smithi139 ceph-mon[99506]: pgmap v531: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:05 smithi187 ceph-mon[104336]: pgmap v531: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:35:08.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:07 smithi155 ceph-mon[103467]: pgmap v532: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:35:08.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:07 smithi155 ceph-mon[103467]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:35:08.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:07 smithi139 ceph-mon[99506]: pgmap v532: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:35:08.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:07 smithi139 ceph-mon[99506]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:35:08.284 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:07 smithi187 ceph-mon[104336]: pgmap v532: 129 pgs: 129 active+clean; 120 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:35:08.285 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:07 smithi187 ceph-mon[104336]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T13:35:10.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:09 smithi155 ceph-mon[103467]: pgmap v534: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:09 smithi139 ceph-mon[99506]: pgmap v534: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:09 smithi187 ceph-mon[104336]: pgmap v534: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 119 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:11 smithi155 ceph-mon[103467]: pgmap v535: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 118 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:11 smithi139 ceph-mon[99506]: pgmap v535: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 118 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:11 smithi187 ceph-mon[104336]: pgmap v535: 129 pgs: 9 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 93 active+clean; 118 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:35:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:13 smithi155 ceph-mon[103467]: pgmap v536: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:35:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:13 smithi139 ceph-mon[99506]: pgmap v536: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:35:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:13 smithi187 ceph-mon[104336]: pgmap v536: 129 pgs: 5 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 109 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:35:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:15 smithi155 ceph-mon[103467]: pgmap v537: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:15 smithi155 ceph-mon[103467]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:35:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:15 smithi139 ceph-mon[99506]: pgmap v537: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:15 smithi139 ceph-mon[99506]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:35:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:15 smithi187 ceph-mon[104336]: pgmap v537: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 117 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:15 smithi187 ceph-mon[104336]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T13:35:18.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:17 smithi155 ceph-mon[103467]: pgmap v539: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:35:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:17 smithi139 ceph-mon[99506]: pgmap v539: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:35:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:17 smithi187 ceph-mon[104336]: pgmap v539: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:35:20.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:19 smithi155 ceph-mon[103467]: pgmap v540: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:19 smithi139 ceph-mon[99506]: pgmap v540: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:19 smithi187 ceph-mon[104336]: pgmap v540: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:35:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:21 smithi155 ceph-mon[103467]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:35:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:21 smithi155 ceph-mon[103467]: pgmap v542: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-10-08T13:35:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:21 smithi139 ceph-mon[99506]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:35:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:21 smithi139 ceph-mon[99506]: pgmap v542: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-10-08T13:35:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:21 smithi187 ceph-mon[104336]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T13:35:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:21 smithi187 ceph-mon[104336]: pgmap v542: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 127 B/s wr, 9 op/s 2023-10-08T13:35:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:23 smithi155 ceph-mon[103467]: pgmap v543: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 10 op/s 2023-10-08T13:35:24.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:23 smithi139 ceph-mon[99506]: pgmap v543: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 10 op/s 2023-10-08T13:35:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:23 smithi187 ceph-mon[104336]: pgmap v543: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 127 B/s wr, 10 op/s 2023-10-08T13:35:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:25 smithi155 ceph-mon[103467]: pgmap v544: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-10-08T13:35:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:25 smithi139 ceph-mon[99506]: pgmap v544: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-10-08T13:35:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:25 smithi187 ceph-mon[104336]: pgmap v544: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 110 B/s wr, 10 op/s 2023-10-08T13:35:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:27 smithi155 ceph-mon[103467]: pgmap v545: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:27 smithi139 ceph-mon[99506]: pgmap v545: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:27 smithi187 ceph-mon[104336]: pgmap v545: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:30.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:29 smithi155 ceph-mon[103467]: pgmap v546: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:29 smithi139 ceph-mon[99506]: pgmap v546: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:29 smithi187 ceph-mon[104336]: pgmap v546: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T13:35:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:31 smithi155 ceph-mon[103467]: pgmap v547: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T13:35:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:31 smithi139 ceph-mon[99506]: pgmap v547: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T13:35:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:31 smithi187 ceph-mon[104336]: pgmap v547: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T13:35:34.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:33 smithi155 ceph-mon[103467]: pgmap v548: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:34.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:33 smithi139 ceph-mon[99506]: pgmap v548: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:34.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:33 smithi187 ceph-mon[104336]: pgmap v548: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:35 smithi155 ceph-mon[103467]: pgmap v549: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:35 smithi139 ceph-mon[99506]: pgmap v549: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:35 smithi187 ceph-mon[104336]: pgmap v549: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:38.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:37 smithi155 ceph-mon[103467]: pgmap v550: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:37 smithi139 ceph-mon[99506]: pgmap v550: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:37 smithi187 ceph-mon[104336]: pgmap v550: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:40.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:39 smithi155 ceph-mon[103467]: pgmap v551: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:39 smithi139 ceph-mon[99506]: pgmap v551: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:39 smithi187 ceph-mon[104336]: pgmap v551: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:41 smithi155 ceph-mon[103467]: pgmap v552: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:41.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:41 smithi139 ceph-mon[99506]: pgmap v552: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:41 smithi187 ceph-mon[104336]: pgmap v552: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:44.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:43 smithi155 ceph-mon[103467]: pgmap v553: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:43 smithi139 ceph-mon[99506]: pgmap v553: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:43 smithi187 ceph-mon[104336]: pgmap v553: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:45 smithi155 ceph-mon[103467]: pgmap v554: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:45 smithi139 ceph-mon[99506]: pgmap v554: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:45 smithi187 ceph-mon[104336]: pgmap v554: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:48.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:47 smithi155 ceph-mon[103467]: pgmap v555: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:47 smithi139 ceph-mon[99506]: pgmap v555: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:47 smithi187 ceph-mon[104336]: pgmap v555: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:50.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:49 smithi155 ceph-mon[103467]: pgmap v556: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:49 smithi139 ceph-mon[99506]: pgmap v556: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:49 smithi187 ceph-mon[104336]: pgmap v556: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:51 smithi155 ceph-mon[103467]: pgmap v557: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:51 smithi139 ceph-mon[99506]: pgmap v557: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:51 smithi187 ceph-mon[104336]: pgmap v557: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:35:53.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:52 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:35:53.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:52 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:35:53.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:52 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:35:54.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:53 smithi155 ceph-mon[103467]: pgmap v558: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:35:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:35:54.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:35:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:53 smithi139 ceph-mon[99506]: pgmap v558: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:35:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:35:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:35:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:53 smithi187 ceph-mon[104336]: pgmap v558: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:35:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:35:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:35:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:35:56.098 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:55 smithi155 ceph-mon[103467]: pgmap v559: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:56.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:55 smithi139 ceph-mon[99506]: pgmap v559: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:56.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:55 smithi187 ceph-mon[104336]: pgmap v559: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:35:58.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:57 smithi155 ceph-mon[103467]: pgmap v560: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:58.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:57 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:35:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:57 smithi139 ceph-mon[99506]: pgmap v560: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:57 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:35:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:57 smithi187 ceph-mon[104336]: pgmap v560: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:35:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:57 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:00.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:35:59 smithi155 ceph-mon[103467]: pgmap v561: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:35:59 smithi139 ceph-mon[99506]: pgmap v561: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:00.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:35:59 smithi187 ceph-mon[104336]: pgmap v561: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:01 smithi155 ceph-mon[103467]: pgmap v562: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:01 smithi139 ceph-mon[99506]: pgmap v562: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:01.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:01 smithi187 ceph-mon[104336]: pgmap v562: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:04.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:03 smithi155 ceph-mon[103467]: pgmap v563: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:36:04.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:03 smithi139 ceph-mon[99506]: pgmap v563: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:36:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:03 smithi187 ceph-mon[104336]: pgmap v563: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:36:06.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:05 smithi155 ceph-mon[103467]: pgmap v564: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:36:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:05 smithi139 ceph-mon[99506]: pgmap v564: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:36:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:05 smithi187 ceph-mon[104336]: pgmap v564: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:36:08.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:07 smithi139 ceph-mon[99506]: pgmap v565: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:36:08.189 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:07 smithi139 ceph-mon[99506]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:36:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:07 smithi187 ceph-mon[104336]: pgmap v565: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:36:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:07 smithi187 ceph-mon[104336]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:36:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:07 smithi155 ceph-mon[103467]: pgmap v565: 129 pgs: 129 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:36:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:07 smithi155 ceph-mon[103467]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T13:36:09.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:08 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:08 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:09.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:08 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:09 smithi139 ceph-mon[99506]: pgmap v567: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:09 smithi187 ceph-mon[104336]: pgmap v567: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:10.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:09 smithi155 ceph-mon[103467]: pgmap v567: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:11 smithi155 ceph-mon[103467]: pgmap v568: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:11 smithi139 ceph-mon[99506]: pgmap v568: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:11 smithi187 ceph-mon[104336]: pgmap v568: 129 pgs: 8 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 94 active+clean; 117 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:36:14.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:13 smithi155 ceph-mon[103467]: pgmap v569: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:36:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:13 smithi139 ceph-mon[99506]: pgmap v569: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:36:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:13 smithi187 ceph-mon[104336]: pgmap v569: 129 pgs: 4 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 110 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:36:16.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:15 smithi155 ceph-mon[103467]: pgmap v570: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:16.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:15 smithi155 ceph-mon[103467]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:36:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:15 smithi139 ceph-mon[99506]: pgmap v570: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:15 smithi139 ceph-mon[99506]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:36:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:15 smithi187 ceph-mon[104336]: pgmap v570: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:15 smithi187 ceph-mon[104336]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T13:36:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:17 smithi139 ceph-mon[99506]: pgmap v572: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:36:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:17 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:17 smithi187 ceph-mon[104336]: pgmap v572: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:36:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:17 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:18.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:17 smithi155 ceph-mon[103467]: pgmap v572: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T13:36:18.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:17 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:19 smithi139 ceph-mon[99506]: pgmap v573: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:19 smithi187 ceph-mon[104336]: pgmap v573: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:20.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:19 smithi155 ceph-mon[103467]: pgmap v573: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:21 smithi155 ceph-mon[103467]: pgmap v574: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:21 smithi139 ceph-mon[99506]: pgmap v574: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:21 smithi187 ceph-mon[104336]: pgmap v574: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:36:24.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:23 smithi155 ceph-mon[103467]: pgmap v575: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:24.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:23 smithi139 ceph-mon[99506]: pgmap v575: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:23 smithi187 ceph-mon[104336]: pgmap v575: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:26.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:25 smithi155 ceph-mon[103467]: pgmap v576: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:25 smithi139 ceph-mon[99506]: pgmap v576: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:25 smithi187 ceph-mon[104336]: pgmap v576: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:36:28.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:27 smithi155 ceph-mon[103467]: pgmap v577: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:36:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:27 smithi139 ceph-mon[99506]: pgmap v577: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:36:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:27 smithi187 ceph-mon[104336]: pgmap v577: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:36:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:29 smithi139 ceph-mon[99506]: pgmap v578: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:29 smithi187 ceph-mon[104336]: pgmap v578: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:30.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:29 smithi155 ceph-mon[103467]: pgmap v578: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:31 smithi155 ceph-mon[103467]: pgmap v579: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:31 smithi139 ceph-mon[99506]: pgmap v579: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:31 smithi187 ceph-mon[104336]: pgmap v579: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:33 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:33.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:33 smithi155 ceph-mon[103467]: pgmap v580: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:33 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:33.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:33 smithi139 ceph-mon[99506]: pgmap v580: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:33 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:33 smithi187 ceph-mon[104336]: pgmap v580: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:36.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:35 smithi155 ceph-mon[103467]: pgmap v581: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:36.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:35 smithi139 ceph-mon[99506]: pgmap v581: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:36.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:35 smithi187 ceph-mon[104336]: pgmap v581: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:37 smithi139 ceph-mon[99506]: pgmap v582: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:37 smithi187 ceph-mon[104336]: pgmap v582: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:38.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:37 smithi155 ceph-mon[103467]: pgmap v582: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:40.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:39 smithi139 ceph-mon[99506]: pgmap v583: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:40.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:39 smithi187 ceph-mon[104336]: pgmap v583: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:40.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:39 smithi155 ceph-mon[103467]: pgmap v583: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:41.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:40 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:41.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:40 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:41.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:40 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:42.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:41 smithi139 ceph-mon[99506]: pgmap v584: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:42.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:41 smithi187 ceph-mon[104336]: pgmap v584: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:42.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:41 smithi155 ceph-mon[103467]: pgmap v584: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:36:44.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:43 smithi139 ceph-mon[99506]: pgmap v585: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:43 smithi187 ceph-mon[104336]: pgmap v585: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:44.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:43 smithi155 ceph-mon[103467]: pgmap v585: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:36:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:45 smithi139 ceph-mon[99506]: pgmap v586: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:46.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:45 smithi187 ceph-mon[104336]: pgmap v586: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:46.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:45 smithi155 ceph-mon[103467]: pgmap v586: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:36:47.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:46 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:47.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:46 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:47.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:46 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:47 smithi139 ceph-mon[99506]: pgmap v587: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:47 smithi187 ceph-mon[104336]: pgmap v587: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:48.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:47 smithi155 ceph-mon[103467]: pgmap v587: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:36:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:49 smithi139 ceph-mon[99506]: pgmap v588: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:50.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:49 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:49 smithi187 ceph-mon[104336]: pgmap v588: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:50.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:49 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:50.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:49 smithi155 ceph-mon[103467]: pgmap v588: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:50.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:49 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:51.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:50 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:51.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:50 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:51.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:50 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:51 smithi139 ceph-mon[99506]: pgmap v589: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T13:36:52.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:51 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:51 smithi187 ceph-mon[104336]: pgmap v589: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T13:36:52.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:51 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:52.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:51 smithi155 ceph-mon[103467]: pgmap v589: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T13:36:52.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:51 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:53 smithi139 ceph-mon[99506]: pgmap v590: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-08T13:36:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:53 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:36:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:53 smithi187 ceph-mon[104336]: pgmap v590: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-08T13:36:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:53 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:36:54.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:53 smithi155 ceph-mon[103467]: pgmap v590: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2023-10-08T13:36:54.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:53 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:36:55.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:54 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:55.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:36:55.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:36:55.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:36:55.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:54 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:55.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:36:55.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:36:55.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:36:55.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:54 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:36:55.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:36:55.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:36:55.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:36:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:55 smithi139 ceph-mon[99506]: pgmap v591: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:56.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:55 smithi187 ceph-mon[104336]: pgmap v591: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:56.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:55 smithi155 ceph-mon[103467]: pgmap v591: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:36:58.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:57 smithi139 ceph-mon[99506]: pgmap v592: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-08T13:36:58.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:57 smithi187 ceph-mon[104336]: pgmap v592: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-08T13:36:58.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:57 smithi155 ceph-mon[103467]: pgmap v592: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2023-10-08T13:37:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:36:59 smithi139 ceph-mon[99506]: pgmap v593: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:00.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:36:59 smithi187 ceph-mon[104336]: pgmap v593: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:00.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:36:59 smithi155 ceph-mon[103467]: pgmap v593: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:01.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:01 smithi155 ceph-mon[103467]: pgmap v594: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:01 smithi139 ceph-mon[99506]: pgmap v594: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:01.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:01 smithi187 ceph-mon[104336]: pgmap v594: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:03.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:03 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:03.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:03 smithi155 ceph-mon[103467]: pgmap v595: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:37:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:03 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:03.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:03 smithi139 ceph-mon[99506]: pgmap v595: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:37:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:03 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:03.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:03 smithi187 ceph-mon[104336]: pgmap v595: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:37:06.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:05 smithi139 ceph-mon[99506]: pgmap v596: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:37:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:05 smithi187 ceph-mon[104336]: pgmap v596: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:37:06.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:05 smithi155 ceph-mon[103467]: pgmap v596: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T13:37:08.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:07 smithi139 ceph-mon[99506]: pgmap v597: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:37:08.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:07 smithi139 ceph-mon[99506]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:37:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:07 smithi187 ceph-mon[104336]: pgmap v597: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:37:08.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:07 smithi187 ceph-mon[104336]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:37:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:07 smithi155 ceph-mon[103467]: pgmap v597: 129 pgs: 129 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:37:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:07 smithi155 ceph-mon[103467]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T13:37:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:09 smithi139 ceph-mon[99506]: pgmap v599: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:10.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:09 smithi187 ceph-mon[104336]: pgmap v599: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:10.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:09 smithi155 ceph-mon[103467]: pgmap v599: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 116 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:11.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:11 smithi155 ceph-mon[103467]: pgmap v600: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 112 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:11.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:11 smithi139 ceph-mon[99506]: pgmap v600: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 112 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:11.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:11 smithi187 ceph-mon[104336]: pgmap v600: 129 pgs: 7 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 102 active+clean; 112 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T13:37:14.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:13 smithi139 ceph-mon[99506]: pgmap v601: 129 pgs: 3 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 118 active+clean; 111 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:37:14.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:13 smithi187 ceph-mon[104336]: pgmap v601: 129 pgs: 3 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 118 active+clean; 111 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:37:14.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:13 smithi155 ceph-mon[103467]: pgmap v601: 129 pgs: 3 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 118 active+clean; 111 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 307 B/s wr, 10 op/s 2023-10-08T13:37:15.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:14 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:15.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:14 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:15.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:14 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:15 smithi139 ceph-mon[99506]: pgmap v602: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:16.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:15 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:16.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:15 smithi139 ceph-mon[99506]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:37:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:15 smithi187 ceph-mon[104336]: pgmap v602: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:15 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:16.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:15 smithi187 ceph-mon[104336]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:37:16.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:15 smithi155 ceph-mon[103467]: pgmap v602: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:16.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:15 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:16.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:15 smithi155 ceph-mon[103467]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T13:37:17.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:16 smithi139 ceph-mon[99506]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:17.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:16 smithi187 ceph-mon[104336]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:17.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:16 smithi155 ceph-mon[103467]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T13:37:18.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:17 smithi139 ceph-mon[99506]: pgmap v604: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-10-08T13:37:18.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:17 smithi187 ceph-mon[104336]: pgmap v604: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-10-08T13:37:18.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:17 smithi155 ceph-mon[103467]: pgmap v604: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 205 B/s wr, 10 op/s 2023-10-08T13:37:20.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:19 smithi139 ceph-mon[99506]: pgmap v605: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:20.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:19 smithi187 ceph-mon[104336]: pgmap v605: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:20.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:19 smithi155 ceph-mon[103467]: pgmap v605: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:21.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:21 smithi155 ceph-mon[103467]: pgmap v606: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:21.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:21 smithi139 ceph-mon[99506]: pgmap v606: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:21.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:21 smithi187 ceph-mon[104336]: pgmap v606: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T13:37:24.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:23 smithi139 ceph-mon[99506]: pgmap v607: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:24.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:23 smithi187 ceph-mon[104336]: pgmap v607: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:24.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:23 smithi155 ceph-mon[103467]: pgmap v607: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:26.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:25 smithi139 ceph-mon[99506]: pgmap v608: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:26.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:25 smithi187 ceph-mon[104336]: pgmap v608: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:26.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:25 smithi155 ceph-mon[103467]: pgmap v608: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T13:37:28.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:27 smithi139 ceph-mon[99506]: pgmap v609: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:37:28.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:27 smithi187 ceph-mon[104336]: pgmap v609: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:37:28.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:27 smithi155 ceph-mon[103467]: pgmap v609: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 90 B/s wr, 10 op/s 2023-10-08T13:37:30.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:29 smithi139 ceph-mon[99506]: pgmap v610: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:30.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:29 smithi187 ceph-mon[104336]: pgmap v610: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:30.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:29 smithi155 ceph-mon[103467]: pgmap v610: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2023-10-08T13:37:31.294 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T13:37:31.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- 172.21.15.139:0/3420631583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ffea0 msgr2=0x7f082c10c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 --2- 172.21.15.139:0/3420631583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ffea0 0x7f082c10c360 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f082400b0d0 tx=0x7f082400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.430 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- 172.21.15.139:0/3420631583 shutdown_connections 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 --2- 172.21.15.139:0/3420631583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ffea0 0x7f082c10c360 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 --2- 172.21.15.139:0/3420631583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 0x7f082c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 --2- 172.21.15.139:0/3420631583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ff4e0 0x7f082c0ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- 172.21.15.139:0/3420631583 >> 172.21.15.139:0/3420631583 conn(0x7f082c0fafd0 msgr2=0x7f082c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- 172.21.15.139:0/3420631583 shutdown_connections 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- 172.21.15.139:0/3420631583 wait complete. 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 Processor -- start 2023-10-08T13:37:31.431 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.430+0000 7f083247e700 1 -- start start 2023-10-08T13:37:31.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.433 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ffea0 0x7f082c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 0x7f082c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c19a940 con 0x7f082c0ff4e0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c19aab0 con 0x7f082c1055a0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c19ac70 con 0x7f082c0ffea0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43524/0 (socket says 172.21.15.139:43524) 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 -- 172.21.15.139:0/249979084 learned_addr learned my addr 172.21.15.139:0/249979084 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082b7fe700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ffea0 0x7f082c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f0830a1b700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 0x7f082c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 -- 172.21.15.139:0/249979084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ffea0 msgr2=0x7f082c195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ffea0 0x7f082c195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 -- 172.21.15.139:0/249979084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 msgr2=0x7f082c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 0x7f082c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 -- 172.21.15.139:0/249979084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0824009d00 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f082bfff700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d950 tx=0x7f081c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c009940 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c19af50 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f081c010460 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.431+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081c00f620 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.432+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c1a2800 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.433+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c1079a0 con 0x7f082c0ff4e0 2023-10-08T13:37:31.435 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.434+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f081c0108d0 con 0x7f082c0ff4e0 2023-10-08T13:37:31.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.434+0000 7f08297fa700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 0x7f08140a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.434+0000 7f082b7fe700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 0x7f08140a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.434+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f081c0cd310 con 0x7f082c0ff4e0 2023-10-08T13:37:31.436 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.435+0000 7f082b7fe700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 0x7f08140a3aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f082c196fb0 tx=0x7f0820009190 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:31.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.439+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f081c0962a0 con 0x7f082c0ff4e0 2023-10-08T13:37:31.656 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.655+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f082c10f4a0 con 0x7f08140a15e0 2023-10-08T13:37:31.665 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.664+0000 7f08297fa700 1 -- 172.21.15.139:0/249979084 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+335 (secure 0 0 0) 0x7f082c10f4a0 con 0x7f08140a15e0 2023-10-08T13:37:31.665 INFO:teuthology.orchestra.run.smithi139.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T13:27:29", "first": "2023-10-08T13:28:00", "last": "2023-10-08T13:37:00", "last_pruned": "2023-10-08T13:37:00", "created_count": 10, "pruned_count": 4, "active": true} 2023-10-08T13:37:31.667 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 msgr2=0x7f08140a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 0x7f08140a3aa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f082c196fb0 tx=0x7f0820009190 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 msgr2=0x7f082c195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f081c00d950 tx=0x7f081c00dc60 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 shutdown_connections 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f08140a15e0 0x7f08140a3aa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f082c1055a0 0x7f082c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f082c0ff4e0 0x7f082c195a60 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 --2- 172.21.15.139:0/249979084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f082c0ffea0 0x7f082c195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.668 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 >> 172.21.15.139:0/249979084 conn(0x7f082c0fafd0 msgr2=0x7f082c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:31.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 shutdown_connections 2023-10-08T13:37:31.669 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.666+0000 7f083247e700 1 -- 172.21.15.139:0/249979084 wait complete. 2023-10-08T13:37:31.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T13:37:31.803 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 -- 172.21.15.139:0/2678988952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c105670 msgr2=0x7f524c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 --2- 172.21.15.139:0/2678988952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c105670 0x7f524c105a50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f523c009990 tx=0x7f523c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 -- 172.21.15.139:0/2678988952 shutdown_connections 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 --2- 172.21.15.139:0/2678988952 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f524c100290 0x7f524c10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 --2- 172.21.15.139:0/2678988952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c105670 0x7f524c105a50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 --2- 172.21.15.139:0/2678988952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524c0ff8d0 0x7f524c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 -- 172.21.15.139:0/2678988952 >> 172.21.15.139:0/2678988952 conn(0x7f524c0764c0 msgr2=0x7f524c0768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 -- 172.21.15.139:0/2678988952 shutdown_connections 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.800+0000 7f5251d35700 1 -- 172.21.15.139:0/2678988952 wait complete. 2023-10-08T13:37:31.804 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 Processor -- start 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 -- start start 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f524c0ff8d0 0x7f524c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524c105670 0x7f524c1a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1986c0 con 0x7f524c100290 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1a2ef0 con 0x7f524c105670 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.801+0000 7f5251d35700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c1a3030 con 0x7f524c0ff8d0 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43540/0 (socket says 172.21.15.139:43540) 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 -- 172.21.15.139:0/2038451476 learned_addr learned my addr 172.21.15.139:0/2038451476 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:31.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 -- 172.21.15.139:0/2038451476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f524c0ff8d0 msgr2=0x7f524c197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f524c0ff8d0 0x7f524c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 -- 172.21.15.139:0/2038451476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524c105670 msgr2=0x7f524c1a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524c105670 0x7f524c1a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 -- 172.21.15.139:0/2038451476 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0095f0 con 0x7f524c100290 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f524affd700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f524000c950 tx=0x7f524000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240007ac0 con 0x7f524c100290 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c1a3290 con 0x7f524c100290 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5240004cf0 con 0x7f524c100290 2023-10-08T13:37:31.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240005580 con 0x7f524c100290 2023-10-08T13:37:31.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.802+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c1a37a0 con 0x7f524c100290 2023-10-08T13:37:31.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.803+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c107bd0 con 0x7f524c100290 2023-10-08T13:37:31.807 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.804+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f5240007c20 con 0x7f524c100290 2023-10-08T13:37:31.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.805+0000 7f5248ff9700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 0x7f52340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:31.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.805+0000 7f524b7fe700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 0x7f52340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:31.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.805+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f52400cd120 con 0x7f524c100290 2023-10-08T13:37:31.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.805+0000 7f524b7fe700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 0x7f52340a3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b5c0 tx=0x7f523c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:31.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:31.809+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52400960b0 con 0x7f524c100290 2023-10-08T13:37:31.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:31 smithi155 ceph-mon[103467]: pgmap v611: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:31.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:31 smithi139 ceph-mon[99506]: pgmap v611: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:31.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:31 smithi187 ceph-mon[104336]: pgmap v611: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:32.027 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.026+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 --> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f524c069480 con 0x7f52340a15f0 2023-10-08T13:37:32.035 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.034+0000 7f5248ff9700 1 -- 172.21.15.139:0/2038451476 <== mgr.14217 v2:172.21.15.139:6800/4190664653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f524c069480 con 0x7f52340a15f0 2023-10-08T13:37:32.035 INFO:teuthology.orchestra.run.smithi139.stdout:/ 1m 6m3h 2023-10-08T13:37:32.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 msgr2=0x7f52340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 0x7f52340a3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f523c00b5c0 tx=0x7f523c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.037 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 msgr2=0x7f524c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f524000c950 tx=0x7f524000cd10 comp rx=0 tx=0).stop 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 shutdown_connections 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f52340a15f0 0x7f52340a3ab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f524c105670 0x7f524c1a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f524c0ff8d0 0x7f524c197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 --2- 172.21.15.139:0/2038451476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f524c100290 0x7f524c197e70 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 >> 172.21.15.139:0/2038451476 conn(0x7f524c0764c0 msgr2=0x7f524c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 shutdown_connections 2023-10-08T13:37:32.038 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.036+0000 7f5251d35700 1 -- 172.21.15.139:0/2038451476 wait complete. 2023-10-08T13:37:32.049 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-08T13:37:32.060 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-08T13:37:32.060 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-10-08T13:37:32.061 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T13:37:32.070 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:37:32.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 -- 172.21.15.139:0/2137996664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 msgr2=0x7fc47c10c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 --2- 172.21.15.139:0/2137996664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c10c9b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc478009990 tx=0x7fc478009ca0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 -- 172.21.15.139:0/2137996664 shutdown_connections 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 --2- 172.21.15.139:0/2137996664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c10cef0 0x7fc47c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 --2- 172.21.15.139:0/2137996664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c072ba0 0x7fc47c072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 --2- 172.21.15.139:0/2137996664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c10c9b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 -- 172.21.15.139:0/2137996664 >> 172.21.15.139:0/2137996664 conn(0x7fc47c0fc1a0 msgr2=0x7fc47c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 -- 172.21.15.139:0/2137996664 shutdown_connections 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.191+0000 7fc484488700 1 -- 172.21.15.139:0/2137996664 wait complete. 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 Processor -- start 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 -- start start 2023-10-08T13:37:32.195 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c072ba0 0x7fc47c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c10cef0 0x7fc47c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c1991e0 con 0x7fc47c0734c0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c199350 con 0x7fc47c10cef0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc484488700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c199510 con 0x7fc47c072ba0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43554/0 (socket says 172.21.15.139:43554) 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 -- 172.21.15.139:0/3382612503 learned_addr learned my addr 172.21.15.139:0/3382612503 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc482224700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c072ba0 0x7fc47c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc482a25700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c10cef0 0x7fc47c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.196 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 -- 172.21.15.139:0/3382612503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c072ba0 msgr2=0x7fc47c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c072ba0 0x7fc47c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 -- 172.21.15.139:0/3382612503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c10cef0 msgr2=0x7fc47c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c10cef0 0x7fc47c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 -- 172.21.15.139:0/3382612503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780095f0 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.192+0000 7fc481a23700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc47800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.193+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47801d070 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.193+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc47800fd30 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.193+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c199790 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.193+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478017630 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.193+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c1a5a40 con 0x7fc47c0734c0 2023-10-08T13:37:32.197 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.194+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c108100 con 0x7fc47c0734c0 2023-10-08T13:37:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.195+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc478004830 con 0x7fc47c0734c0 2023-10-08T13:37:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.196+0000 7fc46f7fe700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 0x7fc4680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.198 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.196+0000 7fc482224700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 0x7fc4680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.196+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fc4780cea80 con 0x7fc47c0734c0 2023-10-08T13:37:32.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.196+0000 7fc482224700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 0x7fc4680a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc470005950 tx=0x7fc47000a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.199+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc478097aa0 con 0x7fc47c0734c0 2023-10-08T13:37:32.393 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.392+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc47c199fd0 con 0x7fc47c0734c0 2023-10-08T13:37:32.395 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.394+0000 7fc46f7fe700 1 -- 172.21.15.139:0/3382612503 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+25203 (secure 0 0 0) 0x7fc47809b0c0 con 0x7fc47c0734c0 2023-10-08T13:37:32.395 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:37:32.396 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":102,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:37:15.548720+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 msgr2=0x7fc4680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 0x7fc4680a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc470005950 tx=0x7fc47000a300 comp rx=0 tx=0).stop 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 msgr2=0x7fc47c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc47800f7d0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 shutdown_connections 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc4680a15f0 0x7fc4680a3ab0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc47c10cef0 0x7fc47c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47c072ba0 0x7fc47c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.398 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 --2- 172.21.15.139:0/3382612503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc47c0734c0 0x7fc47c19ef90 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 >> 172.21.15.139:0/3382612503 conn(0x7fc47c0fc1a0 msgr2=0x7fc47c0fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 shutdown_connections 2023-10-08T13:37:32.399 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.396+0000 7fc484488700 1 -- 172.21.15.139:0/3382612503 wait complete. 2023-10-08T13:37:32.410 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:37:32.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 -- 172.21.15.139:0/187033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c105630 msgr2=0x7ff05c105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 --2- 172.21.15.139:0/187033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c105630 0x7ff05c105a10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff0500099c0 tx=0x7ff050009cd0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 -- 172.21.15.139:0/187033400 shutdown_connections 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 --2- 172.21.15.139:0/187033400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c1007d0 0x7ff05c10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 --2- 172.21.15.139:0/187033400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c105630 0x7ff05c105a10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 --2- 172.21.15.139:0/187033400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 0x7ff05c100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 -- 172.21.15.139:0/187033400 >> 172.21.15.139:0/187033400 conn(0x7ff05c075c20 msgr2=0x7ff05c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 -- 172.21.15.139:0/187033400 shutdown_connections 2023-10-08T13:37:32.537 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.533+0000 7ff062bae700 1 -- 172.21.15.139:0/187033400 wait complete. 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 Processor -- start 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 -- start start 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 0x7ff05c195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 0x7ff05c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1a4ff0 con 0x7ff05c1007d0 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1a5160 con 0x7ff05c0ffe10 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff062bae700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1a5320 con 0x7ff05c105630 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43566/0 (socket says 172.21.15.139:43566) 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff06094a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 0x7ff05c195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.538 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 -- 172.21.15.139:0/1530355285 learned_addr learned my addr 172.21.15.139:0/1530355285 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff06114b700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 0x7ff05c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 -- 172.21.15.139:0/1530355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 msgr2=0x7ff05c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 0x7ff05c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 -- 172.21.15.139:0/1530355285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 msgr2=0x7ff05c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 0x7ff05c195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff05bfff700 1 -- 172.21.15.139:0/1530355285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500095f0 con 0x7ff05c1007d0 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.534+0000 7ff06114b700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 0x7ff05c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff05bfff700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff04800d980 tx=0x7ff04800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048004220 con 0x7ff05c1007d0 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff048007640 con 0x7ff05c1007d0 2023-10-08T13:37:32.539 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c1a5600 con 0x7ff05c1007d0 2023-10-08T13:37:32.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048005610 con 0x7ff05c1007d0 2023-10-08T13:37:32.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.535+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1a5b60 con 0x7ff05c1007d0 2023-10-08T13:37:32.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.536+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c107c20 con 0x7ff05c1007d0 2023-10-08T13:37:32.540 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.537+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7ff048004750 con 0x7ff05c1007d0 2023-10-08T13:37:32.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.537+0000 7ff059ffb700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 0x7ff04c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.537+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7ff0480cd250 con 0x7ff05c1007d0 2023-10-08T13:37:32.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.537+0000 7ff06094a700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 0x7ff04c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.541 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.538+0000 7ff06094a700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 0x7ff04c0a3b30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff050009fd0 tx=0x7ff050019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.543 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.542+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0480961e0 con 0x7ff05c1007d0 2023-10-08T13:37:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:32 smithi139 ceph-mon[99506]: from='client.17178 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:32 smithi139 ceph-mon[99506]: from='client.17184 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:32 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3382612503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:37:32.734 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.733+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff05c0ff2c0 con 0x7ff05c1007d0 2023-10-08T13:37:32.735 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.734+0000 7ff059ffb700 1 -- 172.21.15.139:0/1530355285 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0480160a0 con 0x7ff05c1007d0 2023-10-08T13:37:32.735 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 msgr2=0x7ff04c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 0x7ff04c0a3b30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff050009fd0 tx=0x7ff050019040 comp rx=0 tx=0).stop 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 msgr2=0x7ff05c195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff04800d980 tx=0x7ff04800dc90 comp rx=0 tx=0).stop 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 shutdown_connections 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff04c0a1670 0x7ff04c0a3b30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c105630 0x7ff05c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c0ffe10 0x7ff05c195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 --2- 172.21.15.139:0/1530355285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff05c1007d0 0x7ff05c195d90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 >> 172.21.15.139:0/1530355285 conn(0x7ff05c075c20 msgr2=0x7ff05c0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 shutdown_connections 2023-10-08T13:37:32.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.736+0000 7ff062bae700 1 -- 172.21.15.139:0/1530355285 wait complete. 2023-10-08T13:37:32.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:37:32.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:32 smithi155 ceph-mon[103467]: from='client.17178 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:32 smithi155 ceph-mon[103467]: from='client.17184 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:32 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3382612503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 -- 172.21.15.139:0/2849271439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944067ce0 msgr2=0x7f89440680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 --2- 172.21.15.139:0/2849271439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944067ce0 0x7f89440680c0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f89380099c0 tx=0x7f8938009cd0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 -- 172.21.15.139:0/2849271439 shutdown_connections 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 --2- 172.21.15.139:0/2849271439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944105b80 0x7f894410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 --2- 172.21.15.139:0/2849271439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944067ce0 0x7f89440680c0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 --2- 172.21.15.139:0/2849271439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 0x7f8944105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 -- 172.21.15.139:0/2849271439 >> 172.21.15.139:0/2849271439 conn(0x7f8944076780 msgr2=0x7f8944076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 -- 172.21.15.139:0/2849271439 shutdown_connections 2023-10-08T13:37:32.875 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.871+0000 7f894afb1700 1 -- 172.21.15.139:0/2849271439 wait complete. 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 Processor -- start 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 -- start start 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944067ce0 0x7f894419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 0x7f894419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944197060 con 0x7f8944105b80 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89441971d0 con 0x7f89441051c0 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894afb1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8944197390 con 0x7f8944067ce0 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894954e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894954e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43582/0 (socket says 172.21.15.139:43582) 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894954e700 1 -- 172.21.15.139:0/2379898183 learned_addr learned my addr 172.21.15.139:0/2379898183 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:32.876 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f8948d4d700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944067ce0 0x7f894419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f8943fff700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 0x7f894419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894954e700 1 -- 172.21.15.139:0/2379898183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944067ce0 msgr2=0x7f894419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.872+0000 7f894954e700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944067ce0 0x7f894419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894954e700 1 -- 172.21.15.139:0/2379898183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 msgr2=0x7f894419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894954e700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 0x7f894419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894954e700 1 -- 172.21.15.139:0/2379898183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380095f0 con 0x7f8944105b80 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894954e700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f893c007ee0 tx=0x7f893c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c017070 con 0x7f8944105b80 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f893c00f040 con 0x7f8944105b80 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8944197670 con 0x7f8944105b80 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c005740 con 0x7f8944105b80 2023-10-08T13:37:32.877 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.873+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89441a38c0 con 0x7f8944105b80 2023-10-08T13:37:32.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.874+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8944108c70 con 0x7f8944105b80 2023-10-08T13:37:32.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.875+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f893c00dc60 con 0x7f8944105b80 2023-10-08T13:37:32.878 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.876+0000 7f8941ffb700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 0x7f89340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:32.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.876+0000 7f8948d4d700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 0x7f89340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:32.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.876+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f893c0ccce0 con 0x7f8944105b80 2023-10-08T13:37:32.879 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.876+0000 7f8948d4d700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 0x7f89340a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8938009990 tx=0x7f8938003680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:32.881 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:32.880+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f893c095c10 con 0x7f8944105b80 2023-10-08T13:37:32.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:32 smithi187 ceph-mon[104336]: from='client.17178 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:32 smithi187 ceph-mon[104336]: from='client.17184 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T13:37:32.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:32 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3382612503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:37:33.072 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.071+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8944197ec0 con 0x7f8944105b80 2023-10-08T13:37:33.072 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.071+0000 7f8941ffb700 1 -- 172.21.15.139:0/2379898183 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f893c099230 con 0x7f8944105b80 2023-10-08T13:37:33.072 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:37:33.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 msgr2=0x7f89340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.074 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 0x7f89340a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8938009990 tx=0x7f8938003680 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 msgr2=0x7f8944196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f893c007ee0 tx=0x7f893c00d3b0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 shutdown_connections 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f89340a15f0 0x7f89340a3ab0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8944105b80 0x7f8944196a00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8944067ce0 0x7f894419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 --2- 172.21.15.139:0/2379898183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89441051c0 0x7f894419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 >> 172.21.15.139:0/2379898183 conn(0x7f8944076780 msgr2=0x7f89440fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 shutdown_connections 2023-10-08T13:37:33.075 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.073+0000 7f894afb1700 1 -- 172.21.15.139:0/2379898183 wait complete. 2023-10-08T13:37:33.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 -- 172.21.15.139:0/3593815592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d41056b0 msgr2=0x7f16d4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 --2- 172.21.15.139:0/3593815592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d41056b0 0x7f16d4105a90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009990 tx=0x7f16c4009ca0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 -- 172.21.15.139:0/3593815592 shutdown_connections 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 --2- 172.21.15.139:0/3593815592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d40fffe0 0x7f16d410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 --2- 172.21.15.139:0/3593815592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d41056b0 0x7f16d4105a90 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 --2- 172.21.15.139:0/3593815592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40ff620 0x7f16d40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 -- 172.21.15.139:0/3593815592 >> 172.21.15.139:0/3593815592 conn(0x7f16d4076780 msgr2=0x7f16d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.213 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 -- 172.21.15.139:0/3593815592 shutdown_connections 2023-10-08T13:37:33.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.211+0000 7f16d9cab700 1 -- 172.21.15.139:0/3593815592 wait complete. 2023-10-08T13:37:33.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 Processor -- start 2023-10-08T13:37:33.214 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 -- start start 2023-10-08T13:37:33.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.216 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40fffe0 0x7f16d4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 0x7f16d41a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4198690 con 0x7f16d40ff620 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41a2ec0 con 0x7f16d41056b0 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d9cab700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d41a3000 con 0x7f16d40fffe0 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43592/0 (socket says 172.21.15.139:43592) 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 -- 172.21.15.139:0/1651548384 learned_addr learned my addr 172.21.15.139:0/1651548384 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d2ffd700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40fffe0 0x7f16d4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d3fff700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 0x7f16d41a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 -- 172.21.15.139:0/1651548384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40fffe0 msgr2=0x7f16d4197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.217 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40fffe0 0x7f16d4197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 -- 172.21.15.139:0/1651548384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 msgr2=0x7f16d41a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 0x7f16d41a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d37fe700 1 -- 172.21.15.139:0/1651548384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c40095f0 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.212+0000 7f16d3fff700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 0x7f16d41a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d37fe700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f16c400f6f0 tx=0x7f16c400f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c401d070 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16c400fcb0 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d41a3260 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4017650 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.213+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d41a3770 con 0x7f16d40ff620 2023-10-08T13:37:33.218 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.214+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d4107c10 con 0x7f16d40ff620 2023-10-08T13:37:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.215+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f16c40050d0 con 0x7f16d40ff620 2023-10-08T13:37:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.215+0000 7f16d0ff9700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 0x7f16c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.216+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f16c40cea80 con 0x7f16d40ff620 2023-10-08T13:37:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.216+0000 7f16d2ffd700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 0x7f16c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.219 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.216+0000 7f16d2ffd700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 0x7f16c00a3ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005ea0 tx=0x7f16bc005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.220 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.219+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f16c4097a40 con 0x7f16d40ff620 2023-10-08T13:37:33.411 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.410+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16d4067dd0 con 0x7f16d40ff620 2023-10-08T13:37:33.412 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.410+0000 7f16d0ff9700 1 -- 172.21.15.139:0/1651548384 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16c409b060 con 0x7f16d40ff620 2023-10-08T13:37:33.412 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 msgr2=0x7f16c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 0x7f16c00a3ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005ea0 tx=0x7f16bc005e30 comp rx=0 tx=0).stop 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 msgr2=0x7f16d4197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f16c400f6f0 tx=0x7f16c400f7d0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 shutdown_connections 2023-10-08T13:37:33.414 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f16c00a15f0 0x7f16c00a3ab0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16d41056b0 0x7f16d41a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d40ff620 0x7f16d4197900 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 --2- 172.21.15.139:0/1651548384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16d40fffe0 0x7f16d4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 >> 172.21.15.139:0/1651548384 conn(0x7f16d4076780 msgr2=0x7f16d40fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 shutdown_connections 2023-10-08T13:37:33.415 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.413+0000 7f16d9cab700 1 -- 172.21.15.139:0/1651548384 wait complete. 2023-10-08T13:37:33.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:37:33.554 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 -- 172.21.15.139:0/412169624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 msgr2=0x7fc77010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 --2- 172.21.15.139:0/412169624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc77010c4e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc76800b0a0 tx=0x7fc76800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 -- 172.21.15.139:0/412169624 shutdown_connections 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 --2- 172.21.15.139:0/412169624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc77010c4e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 --2- 172.21.15.139:0/412169624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7701056b0 0x7fc770105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 --2- 172.21.15.139:0/412169624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7700ff620 0x7fc7700ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 -- 172.21.15.139:0/412169624 >> 172.21.15.139:0/412169624 conn(0x7fc770076780 msgr2=0x7fc770076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 -- 172.21.15.139:0/412169624 shutdown_connections 2023-10-08T13:37:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.550+0000 7fc77606f700 1 -- 172.21.15.139:0/412169624 wait complete. 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.551+0000 7fc77606f700 1 Processor -- start 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.551+0000 7fc77606f700 1 -- start start 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7700ff620 0x7fc770195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7701056b0 0x7fc77019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77019a910 con 0x7fc7700fffe0 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77019aa80 con 0x7fc7700ff620 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77019ac40 con 0x7fc7701056b0 2023-10-08T13:37:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43608/0 (socket says 172.21.15.139:43608) 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 -- 172.21.15.139:0/2068136694 learned_addr learned my addr 172.21.15.139:0/2068136694 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76ffff700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7701056b0 0x7fc77019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76f7fe700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7700ff620 0x7fc770195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 -- 172.21.15.139:0/2068136694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7701056b0 msgr2=0x7fc77019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7701056b0 0x7fc77019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 -- 172.21.15.139:0/2068136694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7700ff620 msgr2=0x7fc770195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7700ff620 0x7fc770195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 -- 172.21.15.139:0/2068136694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768009d00 con 0x7fc7700fffe0 2023-10-08T13:37:33.557 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76effd700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e9a0 tx=0x7fc76400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764009790 con 0x7fc7700fffe0 2023-10-08T13:37:33.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc764010430 con 0x7fc7700fffe0 2023-10-08T13:37:33.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77019af20 con 0x7fc7700fffe0 2023-10-08T13:37:33.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764018680 con 0x7fc7700fffe0 2023-10-08T13:37:33.558 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.552+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7701a27d0 con 0x7fc7700fffe0 2023-10-08T13:37:33.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.554+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc770107c30 con 0x7fc7700fffe0 2023-10-08T13:37:33.559 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.554+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fc7640105a0 con 0x7fc7700fffe0 2023-10-08T13:37:33.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.555+0000 7fc76cff9700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 0x7fc7580a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.555+0000 7fc76f7fe700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 0x7fc7580a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.555+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fc764014070 con 0x7fc7700fffe0 2023-10-08T13:37:33.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.555+0000 7fc76f7fe700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 0x7fc7580a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc770077ab0 tx=0x7fc76000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.560 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.559+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc764052100 con 0x7fc7700fffe0 2023-10-08T13:37:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1530355285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.687 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:33 smithi139 ceph-mon[99506]: pgmap v612: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:33.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2379898183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.688 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:33 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1651548384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.754 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.753+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc770196d30 con 0x7fc7700fffe0 2023-10-08T13:37:33.755 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.754+0000 7fc76cff9700 1 -- 172.21.15.139:0/2068136694 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v102) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7640965e0 con 0x7fc7700fffe0 2023-10-08T13:37:33.755 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 msgr2=0x7fc7580a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 0x7fc7580a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc770077ab0 tx=0x7fc76000b410 comp rx=0 tx=0).stop 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 msgr2=0x7fc770195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc76400e9a0 tx=0x7fc76400ecb0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 shutdown_connections 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fc7580a15f0 0x7fc7580a3ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.758 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7701056b0 0x7fc77019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7700ff620 0x7fc770195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 --2- 172.21.15.139:0/2068136694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7700fffe0 0x7fc770195f70 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 >> 172.21.15.139:0/2068136694 conn(0x7fc770076780 msgr2=0x7fc7700fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 shutdown_connections 2023-10-08T13:37:33.759 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.756+0000 7fc77606f700 1 -- 172.21.15.139:0/2068136694 wait complete. 2023-10-08T13:37:33.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T13:37:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1530355285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:33 smithi155 ceph-mon[103467]: pgmap v612: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:33.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2379898183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:33 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1651548384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 -- 172.21.15.139:0/2080171027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100fff00 msgr2=0x7f001010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 --2- 172.21.15.139:0/2080171027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100fff00 0x7f001010c3c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f000800b0d0 tx=0x7f000800b3e0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 -- 172.21.15.139:0/2080171027 shutdown_connections 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 --2- 172.21.15.139:0/2080171027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100fff00 0x7f001010c3c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 --2- 172.21.15.139:0/2080171027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 --2- 172.21.15.139:0/2080171027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100ff540 0x7f00100ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.890 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 -- 172.21.15.139:0/2080171027 >> 172.21.15.139:0/2080171027 conn(0x7f00100fb030 msgr2=0x7f00100fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:33.891 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 -- 172.21.15.139:0/2080171027 shutdown_connections 2023-10-08T13:37:33.891 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.888+0000 7f0014e1a700 1 -- 172.21.15.139:0/2080171027 wait complete. 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 Processor -- start 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 -- start start 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100fff00 0x7f0010197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.893 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010198760 con 0x7f00100ff540 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00101a2f70 con 0x7f0010105600 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f0014e1a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00101a30b0 con 0x7f00100fff00 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f000e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f000e59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43620/0 (socket says 172.21.15.139:43620) 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.889+0000 7f000e59c700 1 -- 172.21.15.139:0/1215255681 learned_addr learned my addr 172.21.15.139:0/1215255681 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000ed9d700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000dd9b700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100fff00 0x7f0010197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 -- 172.21.15.139:0/1215255681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100fff00 msgr2=0x7f0010197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100fff00 0x7f0010197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 -- 172.21.15.139:0/1215255681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 msgr2=0x7f00101a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:33.894 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 -- 172.21.15.139:0/1215255681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009d00 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000ed9d700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f000e59c700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f000000c920 tx=0x7f000000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000007b00 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00101a3340 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0000004cf0 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000005520 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.890+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00101a3850 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.891+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0010107aa0 con 0x7f00100ff540 2023-10-08T13:37:33.895 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.892+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f0000004750 con 0x7f00100ff540 2023-10-08T13:37:33.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.892+0000 7f00077fe700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 0x7efffc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:37:33.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.893+0000 7f000dd9b700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 0x7efffc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:37:33.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.893+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f00000cd1b0 con 0x7f00100ff540 2023-10-08T13:37:33.896 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.893+0000 7f000dd9b700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 0x7efffc0a3ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efff8005950 tx=0x7efff80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:37:33.898 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:33.897+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f00000960e0 con 0x7f00100ff540 2023-10-08T13:37:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1530355285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:33 smithi187 ceph-mon[104336]: pgmap v612: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:33.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2379898183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:37:33.977 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:33 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1651548384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:37:34.145 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.144+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f0010067df0 con 0x7f00100ff540 2023-10-08T13:37:34.152 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.151+0000 7f00077fe700 1 -- 172.21.15.139:0/1215255681 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+734418 (secure 0 0 0) 0x7f0000099700 con 0x7f00100ff540 2023-10-08T13:37:34.165 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:37:34.165 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:37:34.165 INFO:teuthology.orchestra.run.smithi139.stdout: "epoch": 24, 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "active_gid": 14217, 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "active_name": "x", 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "active_addrs": { 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:6800", 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 4190664653 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:6801", 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 4190664653 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "active_addr": "172.21.15.139:6801/4190664653", 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "active_change": "2023-10-08T13:20:08.526118+0000", 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "active_mgr_features": 4540138322906710015, 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "available": true, 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "standbys": [ 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.167 INFO:teuthology.orchestra.run.smithi139.stdout: "gid": 24139, 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "z", 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "available_modules": [ 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "alerts", 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.170 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.171 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.172 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.173 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.174 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.175 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_destination": { 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_destination", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:37:34.176 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_from_name": { 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_from_name", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "Ceph", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.177 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email From: name", 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_host": { 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_host", 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.178 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP server", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_password": { 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_password", 2023-10-08T13:37:34.179 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Password to authenticate with", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.180 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_port": { 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_port", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "465", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP port", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.181 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_sender": { 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_sender", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.182 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_ssl": { 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_ssl", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.183 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_user": { 2023-10-08T13:37:34.184 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_user", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "User to authenticate as", 2023-10-08T13:37:34.185 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "balancer", 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.186 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "active": { 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "active", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.187 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_time": { 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_time", 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.188 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0000", 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_weekday": { 2023-10-08T13:37:34.189 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_weekday", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.190 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_max_iterations": { 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.191 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "25", 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "250", 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_metrics": { 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_metrics", 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.193 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_step": { 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_step", 2023-10-08T13:37:34.194 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.5", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0.001", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "0.999", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:37:34.195 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "end_time": { 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_time", 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2359", 2023-10-08T13:37:34.196 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "end_weekday": { 2023-10-08T13:37:34.197 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_weekday", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.198 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.199 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.200 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.201 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.202 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.203 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.204 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "min_score": { 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_score", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.205 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:34.206 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "upmap", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "crush-compat", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "none", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap" 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Balancer mode", 2023-10-08T13:37:34.207 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_ids": { 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_ids", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.208 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.209 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_deviation": { 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_deviation", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.210 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_optimizations": { 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.211 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm", 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_down_multiplier": { 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_down_multiplier", 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.213 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_refresh_rate": { 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_refresh_rate", 2023-10-08T13:37:34.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "20", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_starting_port": { 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_starting_port", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4721", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.216 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_ptrace": { 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_ptrace", 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:37:34.218 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_interval": { 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_interval", 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.220 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:37:34.221 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:37:34.221 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.221 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.7", 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.222 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm_log_destination": { 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm_log_destination", 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.223 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "file", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "file,syslog", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "syslog" 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.224 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "cgroups_split": { 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cgroups_split", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:37:34.225 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "config_checks_enabled": { 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_checks_enabled", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.226 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "config_dashboard": { 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_dashboard", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.227 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.228 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_alertmanager": { 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_alertmanager", 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:37:34.229 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_base": { 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_base", 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:37:34.231 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.232 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_elasticsearch": { 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "elasticsearch container image", 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_grafana": { 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_grafana", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.235 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_haproxy": { 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_haproxy", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.236 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "HAproxy container image", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_agent": { 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:37:34.237 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_collector": { 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.238 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_query": { 2023-10-08T13:37:34.239 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger query container image", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_keepalived": { 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_keepalived", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Keepalived container image", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_loki": { 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_loki", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Loki container image", 2023-10-08T13:37:34.242 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_node_exporter": { 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_node_exporter", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.243 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_nvmeof": { 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_nvmeof", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:37:34.244 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Nvme-of container image", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_prometheus": { 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_prometheus", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_promtail": { 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_promtail", 2023-10-08T13:37:34.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Promtail container image", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.247 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_snmp_gateway": { 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.248 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "container_init": { 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_init", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.249 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "daemon_cache_timeout": { 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.250 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "900", 2023-10-08T13:37:34.251 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "default_registry": { 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_registry", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io", 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "device_cache_timeout": { 2023-10-08T13:37:34.253 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_cache_timeout", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1800", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.254 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "device_enhanced_scan": { 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_enhanced_scan", 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.255 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "facts_cache_timeout": { 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "facts_cache_timeout", 2023-10-08T13:37:34.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.257 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.257 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.257 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "host_check_interval": { 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "host_check_interval", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.258 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "inventory_list_all": { 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "inventory_list_all", 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.260 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.261 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.262 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.263 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: "log_refresh_metadata": { 2023-10-08T13:37:34.264 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_refresh_metadata", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.265 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.266 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.267 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.268 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.270 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.271 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "*", 2023-10-08T13:37:34.272 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "max_count_per_host": { 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_count_per_host", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "max_osd_draining_count": { 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_osd_draining_count", 2023-10-08T13:37:34.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.275 INFO:teuthology.orchestra.run.smithi139.stdout: "migration_current": { 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "migration_current", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "internal - do not modify", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.276 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "root", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm-package", 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: "root" 2023-10-08T13:37:34.277 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "prometheus_alerts_path": { 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:37:34.278 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_insecure": { 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_insecure", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.279 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_password": { 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_password", 2023-10-08T13:37:34.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.281 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_url": { 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_url", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.282 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_username": { 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_username", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:37:34.283 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "secure_monitoring_stack": { 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.284 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "service_discovery_port": { 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "service_discovery_port", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8765", 2023-10-08T13:37:34.285 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ssh_config_file": { 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssh_config_file", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.287 INFO:teuthology.orchestra.run.smithi139.stdout: "use_agent": { 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_agent", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:37:34.288 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "use_repo_digest": { 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_repo_digest", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.289 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_failed_host_check": { 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.290 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_daemons": { 2023-10-08T13:37:34.291 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:37:34.292 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_hosts": { 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.293 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crash", 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.295 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.296 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.297 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.298 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.299 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.300 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.301 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.302 INFO:teuthology.orchestra.run.smithi139.stdout: "retain_interval": { 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retain_interval", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "31536000", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.303 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_recent_interval": { 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_recent_interval", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1209600", 2023-10-08T13:37:34.304 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dashboard", 2023-10-08T13:37:34.305 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.306 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.307 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.308 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:37:34.309 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.310 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.312 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.313 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.314 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:37:34.316 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:37:34.317 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.318 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.319 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.320 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.321 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.323 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.324 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.325 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_URL": { 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.326 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.327 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.328 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.328 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.328 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:37:34.328 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.329 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:37:34.330 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.331 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.333 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:37:34.334 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.335 INFO:teuthology.orchestra.run.smithi139.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.336 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.338 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.339 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:37:34.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.341 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.342 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.343 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.344 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.345 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.346 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:37:34.347 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.349 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.350 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.351 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8", 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.352 INFO:teuthology.orchestra.run.smithi139.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "45", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.353 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.355 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.356 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.357 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:37:34.358 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.359 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.360 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.361 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:37:34.362 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.363 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.365 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.366 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.369 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:37:34.369 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:37:34.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.369 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "cross_origin_url": { 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cross_origin_url", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "crt_file": { 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crt_file", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "debug": { 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "debug", 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: "jwt_token_ttl": { 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "jwt_token_ttl", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "28800", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.380 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "motd": { 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "motd", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "The message of the day", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.384 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:34.386 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8080", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.387 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl_server_port": { 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl_server_port", 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8443", 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.389 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.390 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "redirect", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.391 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect" 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:34.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "url_prefix": { 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url_prefix", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.394 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "devicehealth", 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.395 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_monitoring": { 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_monitoring", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "monitor device health metrics", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.396 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.397 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.398 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.400 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.401 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.402 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.403 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.404 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "mark_out_threshold": { 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mark_out_threshold", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.405 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2419200", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_name": { 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_name", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.406 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "device_health_metrics", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "retention_period": { 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retention_period", 2023-10-08T13:37:34.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15552000", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.408 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_frequency": { 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_frequency", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "self_heal": { 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "self_heal", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:37:34.410 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.411 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_threshold": { 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_threshold", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7257600", 2023-10-08T13:37:34.412 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.413 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "diskprediction_local", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.414 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.416 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.417 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.418 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.419 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.420 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.420 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.420 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.420 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.420 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.421 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.422 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.422 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.422 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.422 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.423 INFO:teuthology.orchestra.run.smithi139.stdout: "predict_interval": { 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predict_interval", 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:34.424 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.425 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: "predictor_model": { 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predictor_model", 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.426 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.427 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "prophetstor", 2023-10-08T13:37:34.427 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.427 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.427 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.427 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.428 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.429 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.430 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.430 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.430 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.430 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.430 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "influx", 2023-10-08T13:37:34.431 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": false, 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "batch_size": { 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "batch_size", 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.432 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.433 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.433 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5000", 2023-10-08T13:37:34.433 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.433 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.433 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.434 INFO:teuthology.orchestra.run.smithi139.stdout: "database": { 2023-10-08T13:37:34.435 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "database", 2023-10-08T13:37:34.435 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.435 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.435 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.435 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "ceph", 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.436 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": { 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "hostname", 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.437 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.438 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.438 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.438 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.438 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.438 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.439 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "30", 2023-10-08T13:37:34.440 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "5", 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.442 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.443 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.444 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.445 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.446 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.448 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.449 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.450 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.451 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.452 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.454 INFO:teuthology.orchestra.run.smithi139.stdout: "password": { 2023-10-08T13:37:34.454 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "password", 2023-10-08T13:37:34.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.454 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.454 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:37:34.455 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.456 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.456 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.456 INFO:teuthology.orchestra.run.smithi139.stdout: "port": { 2023-10-08T13:37:34.456 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "port", 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8086", 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.457 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server port", 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.459 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:34.459 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:34.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.459 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "false", 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:34.460 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.461 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.461 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.461 INFO:teuthology.orchestra.run.smithi139.stdout: "threads": { 2023-10-08T13:37:34.461 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threads", 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.462 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "32", 2023-10-08T13:37:34.463 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.463 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:37:34.463 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.463 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.463 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: "username": { 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "username", 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.465 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.465 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.465 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.465 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.465 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: "verify_ssl": { 2023-10-08T13:37:34.466 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "verify_ssl", 2023-10-08T13:37:34.467 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.467 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.467 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.467 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "true", 2023-10-08T13:37:34.467 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.468 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "insights", 2023-10-08T13:37:34.469 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.470 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.473 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "iostat", 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.480 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.481 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.482 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.483 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.484 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.485 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.486 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.487 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "k8sevents", 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.489 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_event_retention_days": { 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.490 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "config_check_secs": { 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_check_secs", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "10", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.491 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.492 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.493 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.494 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.495 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "localpool", 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "failure_domain": { 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "failure_domain", 2023-10-08T13:37:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "host", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.499 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.500 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.501 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.502 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.503 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.504 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "min_size": { 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_size", 2023-10-08T13:37:34.505 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.506 INFO:teuthology.orchestra.run.smithi139.stdout: "num_rep": { 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "num_rep", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.507 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_num": { 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_num", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "128", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.508 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "prefix": { 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prefix", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.509 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "subtree": { 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "subtree", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "rack", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.510 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mds_autoscaler", 2023-10-08T13:37:34.511 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.512 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.513 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.515 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.516 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirroring", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.518 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.519 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.521 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.522 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.523 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "nfs", 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.524 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.525 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.526 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.527 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.529 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "fail_fs": { 2023-10-08T13:37:34.530 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "fail_fs", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.532 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.533 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.534 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.535 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.536 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator": { 2023-10-08T13:37:34.537 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "rook", 2023-10-08T13:37:34.538 INFO:teuthology.orchestra.run.smithi139.stdout: "test_orchestrator" 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Orchestrator backend", 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_perf_query", 2023-10-08T13:37:34.539 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.540 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.541 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.542 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.543 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.544 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.545 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_support", 2023-10-08T13:37:34.546 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.547 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.549 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.550 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.551 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_autoscaler", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.553 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.556 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.558 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.559 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "threshold": { 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threshold", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1.0", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.560 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "scaling threshold", 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "progress", 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_pg_recovery_event": { 2023-10-08T13:37:34.561 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.563 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.564 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.566 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.567 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.568 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "max_completed_events": { 2023-10-08T13:37:34.569 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_completed_events", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "50", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.570 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:37:34.571 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus", 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.572 INFO:teuthology.orchestra.run.smithi139.stdout: "cache": { 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cache", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "exclude_perf_counters": { 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "exclude_perf_counters", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.574 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.575 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.576 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.577 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.579 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools": { 2023-10-08T13:37:34.581 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.582 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.583 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_interval": { 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_interval", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15.0", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.584 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.585 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.586 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "9283", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "stale_cache_strategy": { 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stale_cache_strategy", 2023-10-08T13:37:34.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "log", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.588 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "default", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "default", 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "error" 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.589 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:34.590 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_support", 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.591 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.592 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.593 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.595 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_snap_create": { 2023-10-08T13:37:34.597 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "trash_purge_schedule": { 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "trash_purge_schedule", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.600 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "restful", 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_auth": { 2023-10-08T13:37:34.601 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_auth", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.603 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.604 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.605 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.607 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.608 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.609 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.610 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.611 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rgw", 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.612 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.613 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.614 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.615 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.616 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.617 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rook", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "drive_group_interval": { 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "drive_group_interval", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300.0", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.619 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.620 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.621 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.622 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.623 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.625 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "storage_class": { 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "storage_class", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "local", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.626 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "selftest", 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.627 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.628 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.629 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.630 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.631 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.632 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "roption1": { 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption1", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.634 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "roption2": { 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption2", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "xyz", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.635 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption1": { 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption1", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.636 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption2": { 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption2", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.637 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption3": { 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption3", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption4": { 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption4", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.639 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption5": { 2023-10-08T13:37:34.640 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption5", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption6": { 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption6", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.642 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption7": { 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption7", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "42", 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.643 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "testkey": { 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testkey", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.644 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "testlkey": { 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testlkey", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.645 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "testnewline": { 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testnewline", 2023-10-08T13:37:34.646 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snap_schedule", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_m_granularity": { 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_m_granularity", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.648 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "dump_on_update": { 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dump_on_update", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.649 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.650 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.651 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.652 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.653 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.654 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.655 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stats", 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.656 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.657 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.659 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.660 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.661 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "status", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.663 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.664 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.665 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.666 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.668 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telegraf", 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "address": { 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "address", 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.669 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.670 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.671 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.672 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.673 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.674 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.675 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.676 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.677 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telemetry", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_basic": { 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_basic", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.678 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_crash": { 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_crash", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.679 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_device": { 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_device", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.680 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_ident": { 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_ident", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.681 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_perf": { 2023-10-08T13:37:34.682 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_perf", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.683 INFO:teuthology.orchestra.run.smithi139.stdout: "contact": { 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "contact", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.684 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": { 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "description", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.685 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "device_url": { 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_url", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.687 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.688 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "24", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "8", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "last_opt_revision": { 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "last_opt_revision", 2023-10-08T13:37:34.689 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.690 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard": { 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard_description": { 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard_description", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.692 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.693 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.694 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.696 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.697 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "organization": { 2023-10-08T13:37:34.698 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "organization", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.699 INFO:teuthology.orchestra.run.smithi139.stdout: "proxy": { 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "proxy", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.700 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "url": { 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.701 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "test_orchestrator", 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.703 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.705 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.706 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.707 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "volumes", 2023-10-08T13:37:34.708 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.709 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.710 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.712 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.713 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_clones": { 2023-10-08T13:37:34.714 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_clones", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "periodic_async_work": { 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "periodic_async_work", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Periodically check for async work", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.716 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "snapshot_clone_delay": { 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:37:34.717 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix", 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "discovery_interval": { 2023-10-08T13:37:34.718 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "discovery_interval", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "100", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.719 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "identifier": { 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "identifier", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.720 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.721 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.722 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.723 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.724 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.725 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.726 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.727 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_host": { 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_host", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.728 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_port": { 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_port", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10051", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.729 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_sender": { 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_sender", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.730 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "gid": 24146, 2023-10-08T13:37:34.731 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "y", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "mgr_features": 4540138322906710015, 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "available_modules": [ 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "alerts", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.732 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.733 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.734 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.735 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.736 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.737 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.738 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_destination": { 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_destination", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.739 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_from_name": { 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_from_name", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "Ceph", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email From: name", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_host": { 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_host", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.741 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP server", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_password": { 2023-10-08T13:37:34.742 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_password", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Password to authenticate with", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_port": { 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_port", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "465", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP port", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.744 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_sender": { 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_sender", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:37:34.745 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_ssl": { 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_ssl", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.746 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_user": { 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_user", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.747 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "User to authenticate as", 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "balancer", 2023-10-08T13:37:34.748 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "active": { 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "active", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:37:34.749 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_time": { 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_time", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0000", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.750 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_weekday": { 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_weekday", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.751 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_max_iterations": { 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:37:34.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "25", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "250", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.753 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_metrics": { 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_metrics", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.754 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_step": { 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_step", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.5", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0.001", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "0.999", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:37:34.755 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "end_time": { 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_time", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2359", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.756 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "end_weekday": { 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_weekday", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:34.757 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.758 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.759 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.760 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.761 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.762 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.763 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "min_score": { 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_score", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.764 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "upmap", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.765 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "crush-compat", 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "none", 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap" 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Balancer mode", 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_ids": { 2023-10-08T13:37:34.766 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_ids", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.768 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_deviation": { 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_deviation", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:37:34.769 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_optimizations": { 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.770 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm", 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.771 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_down_multiplier": { 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_down_multiplier", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.772 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_refresh_rate": { 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_refresh_rate", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "20", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.773 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_starting_port": { 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_starting_port", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4721", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.774 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_ptrace": { 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_ptrace", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.775 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_interval": { 2023-10-08T13:37:34.776 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_interval", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.7", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.778 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm_log_destination": { 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm_log_destination", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.779 INFO:teuthology.orchestra.run.smithi139.stdout: "file", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "file,syslog", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "syslog" 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "cgroups_split": { 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cgroups_split", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.780 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.781 INFO:teuthology.orchestra.run.smithi139.stdout: "config_checks_enabled": { 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_checks_enabled", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.782 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "config_dashboard": { 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_dashboard", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.783 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:37:34.785 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.785 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.785 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_alertmanager": { 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_alertmanager", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.786 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_base": { 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_base", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.787 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_elasticsearch": { 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.788 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "elasticsearch container image", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_grafana": { 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_grafana", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.789 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_haproxy": { 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_haproxy", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.790 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "HAproxy container image", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_agent": { 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.791 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_collector": { 2023-10-08T13:37:34.792 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_query": { 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger query container image", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.794 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_keepalived": { 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_keepalived", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.795 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Keepalived container image", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_loki": { 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_loki", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:37:34.796 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Loki container image", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_node_exporter": { 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_node_exporter", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.797 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_nvmeof": { 2023-10-08T13:37:34.798 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_nvmeof", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Nvme-of container image", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.799 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_prometheus": { 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_prometheus", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.800 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_promtail": { 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_promtail", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Promtail container image", 2023-10-08T13:37:34.801 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_snmp_gateway": { 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.802 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "container_init": { 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_init", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.803 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "daemon_cache_timeout": { 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.804 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.805 INFO:teuthology.orchestra.run.smithi139.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "900", 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.806 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "default_registry": { 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_registry", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:37:34.808 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "device_cache_timeout": { 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_cache_timeout", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1800", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.809 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "device_enhanced_scan": { 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_enhanced_scan", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.810 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "facts_cache_timeout": { 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "facts_cache_timeout", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.811 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "host_check_interval": { 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "host_check_interval", 2023-10-08T13:37:34.812 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.813 INFO:teuthology.orchestra.run.smithi139.stdout: "inventory_list_all": { 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "inventory_list_all", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.814 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.815 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "log_refresh_metadata": { 2023-10-08T13:37:34.816 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_refresh_metadata", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.817 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.818 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.819 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.820 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.822 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "*", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.823 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "max_count_per_host": { 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_count_per_host", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.824 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "max_osd_draining_count": { 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_osd_draining_count", 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.825 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "migration_current": { 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "migration_current", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.826 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "internal - do not modify", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:34.827 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "root", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm-package", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "root" 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:37:34.828 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "prometheus_alerts_path": { 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.829 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_insecure": { 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_insecure", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.830 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_password": { 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_password", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.831 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_url": { 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_url", 2023-10-08T13:37:34.832 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.833 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_username": { 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_username", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.834 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "secure_monitoring_stack": { 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:37:34.835 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "service_discovery_port": { 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "service_discovery_port", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8765", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.836 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "ssh_config_file": { 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssh_config_file", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.837 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "use_agent": { 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_agent", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.838 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "use_repo_digest": { 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_repo_digest", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.839 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.840 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_failed_host_check": { 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_daemons": { 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:37:34.842 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_hosts": { 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.843 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crash", 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.844 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.845 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.846 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.847 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.848 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.849 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "retain_interval": { 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retain_interval", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.850 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "31536000", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_recent_interval": { 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_recent_interval", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.851 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1209600", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dashboard", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.853 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.854 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:37:34.855 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:37:34.856 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.858 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.859 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.860 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.861 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.862 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:37:34.863 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.864 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.865 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.866 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.867 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.868 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.869 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.870 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_URL": { 2023-10-08T13:37:34.871 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.873 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.874 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.875 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.876 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.877 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:37:34.878 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:37:34.879 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.881 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.882 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.883 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.884 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.885 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:37:34.886 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.887 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.888 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.889 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.890 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.891 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "45", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:37:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:37:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "cross_origin_url": { 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cross_origin_url", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "crt_file": { 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crt_file", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "debug": { 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "debug", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "jwt_token_ttl": { 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "jwt_token_ttl", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "28800", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "motd": { 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "motd", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "The message of the day", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:37:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8080", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl_server_port": { 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl_server_port", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8443", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "redirect", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect" 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "url_prefix": { 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url_prefix", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "devicehealth", 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_monitoring": { 2023-10-08T13:37:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_monitoring", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "monitor device health metrics", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "mark_out_threshold": { 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mark_out_threshold", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2419200", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_name": { 2023-10-08T13:37:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_name", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "device_health_metrics", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "retention_period": { 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retention_period", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15552000", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_frequency": { 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_frequency", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:37:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "self_heal": { 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "self_heal", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_threshold": { 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_threshold", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7257600", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "diskprediction_local", 2023-10-08T13:37:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "predict_interval": { 2023-10-08T13:37:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predict_interval", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "predictor_model": { 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predictor_model", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "prophetstor", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "influx", 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": false, 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "batch_size": { 2023-10-08T13:37:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "batch_size", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5000", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "database": { 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "database", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "ceph", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": { 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "hostname", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:37:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "30", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "5", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "password": { 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "password", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:37:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "port": { 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "port", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8086", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server port", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "false", 2023-10-08T13:37:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "threads": { 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threads", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "32", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "username": { 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "username", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "verify_ssl": { 2023-10-08T13:37:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "verify_ssl", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "true", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "insights", 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "iostat", 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.980 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.981 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "k8sevents", 2023-10-08T13:37:34.982 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_event_retention_days": { 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:37:34.983 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "config_check_secs": { 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_check_secs", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "10", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.984 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.985 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.986 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.987 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.988 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.989 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.990 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "localpool", 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "failure_domain": { 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "failure_domain", 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.991 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "host", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:34.992 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.993 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.994 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:34.995 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:34.996 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.997 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "min_size": { 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_size", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:34.998 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "num_rep": { 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "num_rep", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:34.999 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_num": { 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_num", 2023-10-08T13:37:35.000 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "128", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "prefix": { 2023-10-08T13:37:35.001 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prefix", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "subtree": { 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "subtree", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "rack", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:37:35.003 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mds_autoscaler", 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.004 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.005 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.006 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.007 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.008 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.009 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.010 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirroring", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.011 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.012 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.013 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.014 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.015 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "nfs", 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.017 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.018 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.019 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.020 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.021 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.022 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.023 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.025 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:35.027 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "fail_fs": { 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "fail_fs", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.028 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.029 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.030 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.031 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.032 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.033 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.034 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator": { 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.035 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm", 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "rook", 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "test_orchestrator" 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Orchestrator backend", 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_perf_query", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.037 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.039 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.040 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.041 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_support", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.043 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.044 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.045 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.046 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.047 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.048 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_autoscaler", 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.050 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.051 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.052 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.054 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.055 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "threshold": { 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threshold", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.056 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1.0", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "scaling threshold", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "progress", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_pg_recovery_event": { 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.058 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.059 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.060 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.061 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.062 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.064 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.065 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "max_completed_events": { 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_completed_events", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.066 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "50", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.067 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "cache": { 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cache", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.069 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "exclude_perf_counters": { 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "exclude_perf_counters", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.070 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.071 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.072 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.073 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.074 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.075 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.076 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools": { 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:37:35.078 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.079 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_interval": { 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_interval", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15.0", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.080 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:37:35.081 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "9283", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.082 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "stale_cache_strategy": { 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stale_cache_strategy", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "log", 2023-10-08T13:37:35.083 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.084 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "default", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "default", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "error" 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.085 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.086 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_support", 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.087 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.089 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.090 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.091 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.092 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_snap_create": { 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.093 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.094 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "trash_purge_schedule": { 2023-10-08T13:37:35.095 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "trash_purge_schedule", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.096 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "restful", 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_auth": { 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_auth", 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.097 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.098 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.099 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.100 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.101 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.102 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.103 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.104 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.105 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.106 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rgw", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.108 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.109 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.110 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.111 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.113 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rook", 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.114 INFO:teuthology.orchestra.run.smithi139.stdout: "drive_group_interval": { 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "drive_group_interval", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300.0", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.116 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.117 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.119 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.120 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.121 INFO:teuthology.orchestra.run.smithi139.stdout: "storage_class": { 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "storage_class", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "local", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.122 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "selftest", 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.123 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.124 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.125 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.127 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.128 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "roption1": { 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption1", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.129 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "roption2": { 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption2", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "xyz", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.130 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption1": { 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption1", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.131 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption2": { 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption2", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.132 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption3": { 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption3", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.133 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption4": { 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption4", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.134 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption5": { 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption5", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.135 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption6": { 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption6", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption7": { 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption7", 2023-10-08T13:37:35.137 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "42", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.138 INFO:teuthology.orchestra.run.smithi139.stdout: "testkey": { 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testkey", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "testlkey": { 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testlkey", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.140 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "testnewline": { 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testnewline", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.141 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snap_schedule", 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.142 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_m_granularity": { 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_m_granularity", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.143 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "dump_on_update": { 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dump_on_update", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.144 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.145 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.146 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.147 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.148 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.149 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stats", 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.152 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.153 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.154 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.155 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.156 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "status", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.158 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.160 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.162 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telegraf", 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "address": { 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "address", 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.164 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.165 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.166 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.167 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.168 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.169 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.170 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.171 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telemetry", 2023-10-08T13:37:35.172 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_basic": { 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_basic", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.173 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_crash": { 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_crash", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.174 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_device": { 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_device", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.175 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_ident": { 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_ident", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_perf": { 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_perf", 2023-10-08T13:37:35.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "contact": { 2023-10-08T13:37:35.178 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "contact", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "description": { 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "description", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.180 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "device_url": { 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_url", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.181 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.182 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.183 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "24", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "8", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "last_opt_revision": { 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "last_opt_revision", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.184 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard": { 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard", 2023-10-08T13:37:35.185 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.186 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard_description": { 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard_description", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.187 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.188 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.189 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.191 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.193 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.194 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "organization": { 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "organization", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.195 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "proxy": { 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "proxy", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.196 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "url": { 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "test_orchestrator", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.199 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.201 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.202 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.203 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.204 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "volumes", 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.205 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.207 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.209 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.210 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_clones": { 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_clones", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.211 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "periodic_async_work": { 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "periodic_async_work", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.212 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Periodically check for async work", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "snapshot_clone_delay": { 2023-10-08T13:37:35.213 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix", 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "discovery_interval": { 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "discovery_interval", 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.215 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "100", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "identifier": { 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "identifier", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.216 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.217 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.219 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.220 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.221 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.222 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.223 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_host": { 2023-10-08T13:37:35.224 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_host", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.225 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_port": { 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_port", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10051", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.226 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_sender": { 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_sender", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.227 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: "modules": [ 2023-10-08T13:37:35.228 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "dashboard", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "iostat", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "nfs", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "restful", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "snap_schedule" 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "available_modules": [ 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "alerts", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.229 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.230 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.231 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.232 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.233 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.234 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.235 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_destination": { 2023-10-08T13:37:35.236 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_destination", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email address to send alerts to", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_from_name": { 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_from_name", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "Ceph", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Email From: name", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_host": { 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_host", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP server", 2023-10-08T13:37:35.239 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_password": { 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_password", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.240 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Password to authenticate with", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_port": { 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_port", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.241 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "465", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP port", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_sender": { 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_sender", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.242 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SMTP envelope sender", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_ssl": { 2023-10-08T13:37:35.243 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_ssl", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "smtp_user": { 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "smtp_user", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "User to authenticate as", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.245 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "balancer", 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "active": { 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "active", 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_time": { 2023-10-08T13:37:35.247 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_time", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0000", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.248 INFO:teuthology.orchestra.run.smithi139.stdout: "begin_weekday": { 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "begin_weekday", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.249 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_max_iterations": { 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_max_iterations", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "25", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "250", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T13:37:35.250 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_metrics": { 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_metrics", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.251 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "crush_compat_step": { 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crush_compat_step", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.5", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0.001", 2023-10-08T13:37:35.252 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "0.999", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "aggressiveness of optimization", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "end_time": { 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_time", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.253 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2359", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "end_weekday": { 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "end_weekday", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.254 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "0", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "6", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.255 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.256 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.257 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.258 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.259 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.260 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "min_score": { 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_score", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.261 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:35.262 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "upmap", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "crush-compat", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "none", 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap" 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.263 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Balancer mode", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_ids": { 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_ids", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.264 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.265 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_deviation": { 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_deviation", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.266 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "upmap_max_optimizations": { 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "upmap_max_optimizations", 2023-10-08T13:37:35.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm", 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_down_multiplier": { 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_down_multiplier", 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.269 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_refresh_rate": { 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_refresh_rate", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.270 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "20", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "agent_starting_port": { 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "agent_starting_port", 2023-10-08T13:37:35.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4721", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.272 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_ptrace": { 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_ptrace", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.273 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_interval": { 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_interval", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T13:37:35.274 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "autotune_memory_target_ratio": { 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0.7", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.275 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm_log_destination": { 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cephadm_log_destination", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.276 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "file", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "file,syslog", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "syslog" 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "cgroups_split": { 2023-10-08T13:37:35.277 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cgroups_split", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "config_checks_enabled": { 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_checks_enabled", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "config_dashboard": { 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_dashboard", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.280 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_alertmanager": { 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_alertmanager", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.281 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_base": { 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_base", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T13:37:35.282 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Container image name, without the tag", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_elasticsearch": { 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_elasticsearch", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "elasticsearch container image", 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_grafana": { 2023-10-08T13:37:35.284 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_grafana", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_haproxy": { 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_haproxy", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "HAproxy container image", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.286 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_agent": { 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_agent", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger agent container image", 2023-10-08T13:37:35.287 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_collector": { 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_collector", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.288 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger collector container image", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_jaeger_query": { 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_jaeger_query", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T13:37:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Jaeger query container image", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_keepalived": { 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_keepalived", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.290 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Keepalived container image", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_loki": { 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_loki", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.291 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Loki container image", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.292 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_node_exporter": { 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_node_exporter", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_nvmeof": { 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_nvmeof", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Nvme-of container image", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.294 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_prometheus": { 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_prometheus", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.295 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Prometheus container image", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_promtail": { 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_promtail", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.296 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Promtail container image", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "container_image_snmp_gateway": { 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_image_snmp_gateway", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T13:37:35.297 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "SNMP Gateway container image", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "container_init": { 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "container_init", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.298 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "daemon_cache_timeout": { 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "daemon_cache_timeout", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.299 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "default_cephadm_command_timeout": { 2023-10-08T13:37:35.300 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "900", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "default_registry": { 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "default_registry", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "docker.io", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.302 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "device_cache_timeout": { 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_cache_timeout", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1800", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache device inventory", 2023-10-08T13:37:35.303 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "device_enhanced_scan": { 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_enhanced_scan", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.304 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "facts_cache_timeout": { 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "facts_cache_timeout", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.305 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "seconds to cache host facts data", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "host_check_interval": { 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "host_check_interval", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.306 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to perform a host check", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "inventory_list_all": { 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "inventory_list_all", 2023-10-08T13:37:35.307 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.308 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.309 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "log_refresh_metadata": { 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_refresh_metadata", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.310 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.312 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.313 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.314 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.315 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T13:37:35.316 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "*", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "max_count_per_host": { 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_count_per_host", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of daemons per service per host", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.318 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "max_osd_draining_count": { 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_osd_draining_count", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.319 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "migration_current": { 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "migration_current", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.320 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "internal - do not modify", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "mode": { 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mode", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "root", 2023-10-08T13:37:35.321 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm-package", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "root" 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "prometheus_alerts_path": { 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus_alerts_path", 2023-10-08T13:37:35.322 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.323 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_insecure": { 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_insecure", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_password": { 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_password", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_url": { 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_url", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.326 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "registry_username": { 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "registry_username", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "secure_monitoring_stack": { 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "secure_monitoring_stack", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.328 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "service_discovery_port": { 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "service_discovery_port", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.329 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8765", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "cephadm service discovery port", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "ssh_config_file": { 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssh_config_file", 2023-10-08T13:37:35.330 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.331 INFO:teuthology.orchestra.run.smithi139.stdout: "use_agent": { 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_agent", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.332 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "use_repo_digest": { 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "use_repo_digest", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T13:37:35.333 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_failed_host_check": { 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_failed_host_check", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.334 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_daemons": { 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_daemons", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.335 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_on_stray_hosts": { 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_on_stray_hosts", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.336 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.337 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crash", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.338 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.339 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.340 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.341 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.342 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.343 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "retain_interval": { 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retain_interval", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "31536000", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T13:37:35.344 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_recent_interval": { 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_recent_interval", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1209600", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.345 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dashboard", 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.346 INFO:teuthology.orchestra.run.smithi139.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.347 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.348 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_ENABLED": { 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.350 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.351 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.352 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T13:37:35.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.354 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.356 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.357 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.358 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.359 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.361 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.363 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.364 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_URL": { 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_URL", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.365 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:35.366 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.367 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.368 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T13:37:35.369 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.371 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.372 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.373 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.374 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T13:37:35.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.377 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.378 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.379 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.380 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.381 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.382 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T13:37:35.383 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.384 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.385 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.386 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "45", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.387 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.388 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.389 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "admin", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T13:37:35.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.391 INFO:teuthology.orchestra.run.smithi139.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.393 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.394 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.395 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.396 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "cross_origin_url": { 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cross_origin_url", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.397 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "crt_file": { 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "crt_file", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.399 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.401 INFO:teuthology.orchestra.run.smithi139.stdout: "debug": { 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "debug", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Enable/disable debug options", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.402 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "jwt_token_ttl": { 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "jwt_token_ttl", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "28800", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.403 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.404 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.405 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.407 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.408 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.409 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "motd": { 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "motd", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "The message of the day", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect_resolve_ip_addr": { 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.412 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.413 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8080", 2023-10-08T13:37:35.414 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.415 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl_server_port": { 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl_server_port", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.416 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8443", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:35.417 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "redirect", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "redirect" 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.419 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "url_prefix": { 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url_prefix", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.420 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "devicehealth", 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.421 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_monitoring": { 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_monitoring", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "monitor device health metrics", 2023-10-08T13:37:35.422 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "mark_out_threshold": { 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mark_out_threshold", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "2419200", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T13:37:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "pool_name": { 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pool_name", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "device_health_metrics", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "retention_period": { 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "retention_period", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15552000", 2023-10-08T13:37:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long to retain device health metrics", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_frequency": { 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_frequency", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "self_heal": { 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "self_heal", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "warn_threshold": { 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "warn_threshold", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7257600", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "diskprediction_local", 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "predict_interval": { 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predict_interval", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "86400", 2023-10-08T13:37:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "predictor_model": { 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "predictor_model", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "prophetstor", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "600", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "influx", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": false, 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "influxdb python module not found", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "batch_size": { 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "batch_size", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5000", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "database": { 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "database", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "ceph", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": { 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "hostname", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server hostname", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "30", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "5", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "password": { 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "password", 2023-10-08T13:37:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "password of InfluxDB server user", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "port": { 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "port", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "8086", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "InfluxDB server port", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "ssl": { 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ssl", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "false", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "threads": { 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threads", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "32", 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "username": { 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "username", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "username of InfluxDB server user", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "verify_ssl": { 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "verify_ssl", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "true", 2023-10-08T13:37:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "insights", 2023-10-08T13:37:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "iostat", 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "k8sevents", 2023-10-08T13:37:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_event_retention_days": { 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "ceph_event_retention_days", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "7", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "config_check_secs": { 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "config_check_secs", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "10", 2023-10-08T13:37:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "localpool", 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "failure_domain": { 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "failure_domain", 2023-10-08T13:37:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "host", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "failure domain for any created local pool", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "min_size": { 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "min_size", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default min_size for any created local pool", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "num_rep": { 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "num_rep", 2023-10-08T13:37:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default replica count for any created local pool", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_num": { 2023-10-08T13:37:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_num", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "128", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "prefix": { 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prefix", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "name prefix for any created local pool", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "subtree": { 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "subtree", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "rack", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mds_autoscaler", 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirroring", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "nfs", 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "fail_fs": { 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "fail_fs", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T13:37:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.523 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.525 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator": { 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "orchestrator", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.526 INFO:teuthology.orchestra.run.smithi139.stdout: "cephadm", 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "rook", 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "test_orchestrator" 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Orchestrator backend", 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.527 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_perf_query", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.528 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.529 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.530 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.531 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.532 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "osd_support", 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.535 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.536 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.537 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.538 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.539 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "pg_autoscaler", 2023-10-08T13:37:35.540 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.541 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.543 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.544 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.546 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.547 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "threshold": { 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "threshold", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "3.0", 2023-10-08T13:37:35.548 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1.0", 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "scaling threshold", 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "progress", 2023-10-08T13:37:35.549 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_pg_recovery_event": { 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_pg_recovery_event", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.550 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.551 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.552 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.553 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.554 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.555 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.557 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "max_completed_events": { 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_completed_events", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "50", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.558 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "number of past completed events to remember", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sleep_interval": { 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "sleep_interval", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "5", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.559 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "how long the module is going to sleep", 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "prometheus", 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.560 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "cache": { 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "cache", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.561 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "exclude_perf_counters": { 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "exclude_perf_counters", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.562 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.563 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.564 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.565 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.566 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.567 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.568 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools": { 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.569 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.570 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "scrape_interval": { 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "scrape_interval", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15.0", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.571 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "::", 2023-10-08T13:37:35.572 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.573 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "9283", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "stale_cache_strategy": { 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stale_cache_strategy", 2023-10-08T13:37:35.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "log", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.575 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_behaviour": { 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_behaviour", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "default", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "default", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "error" 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.576 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "standby_error_status_code": { 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "standby_error_status_code", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "500", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "400", 2023-10-08T13:37:35.577 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "599", 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_support", 2023-10-08T13:37:35.578 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.579 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.580 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.582 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.583 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.584 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_snap_create": { 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_snap_create", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.585 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "mirror_snapshot_schedule": { 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.586 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "trash_purge_schedule": { 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "trash_purge_schedule", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.587 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "restful", 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.588 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "enable_auth": { 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enable_auth", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.589 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "key_file": { 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "key_file", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.590 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.591 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.592 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.593 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.594 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.595 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.596 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "server_addr": { 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_addr", 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.597 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "server_port": { 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "server_port", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.598 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rgw", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.600 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.603 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.604 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rook", 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "drive_group_interval": { 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "drive_group_interval", 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "300.0", 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.609 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.609 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.609 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.610 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.611 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.612 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.613 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "storage_class": { 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "storage_class", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "local", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.616 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "selftest", 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.617 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.618 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.619 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.621 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.622 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "roption1": { 2023-10-08T13:37:35.623 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption1", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "roption2": { 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "roption2", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "xyz", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.625 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption1": { 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption1", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.626 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption2": { 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption2", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.627 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption3": { 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption3", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "float", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.628 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption4": { 2023-10-08T13:37:35.629 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption4", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption5": { 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption5", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.631 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption6": { 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption6", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.632 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "rwoption7": { 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rwoption7", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.633 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "1", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "42", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "testkey": { 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testkey", 2023-10-08T13:37:35.634 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: "testlkey": { 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testlkey", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.636 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "testnewline": { 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "testnewline", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.637 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snap_schedule", 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.638 INFO:teuthology.orchestra.run.smithi139.stdout: "allow_m_granularity": { 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "allow_m_granularity", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.639 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "dump_on_update": { 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "dump_on_update", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "dump database to debug log on update", 2023-10-08T13:37:35.640 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.641 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.642 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.643 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.644 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.645 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "stats", 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.647 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.648 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.649 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.650 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.651 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.652 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "status", 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.653 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.654 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.655 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.656 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.657 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.658 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.659 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telegraf", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "address": { 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "address", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.660 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "15", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.661 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.662 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.663 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.664 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.666 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.667 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "telemetry", 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_basic": { 2023-10-08T13:37:35.668 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_basic", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_crash": { 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_crash", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.670 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_device": { 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_device", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "True", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.671 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_ident": { 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_ident", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.672 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "channel_perf": { 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "channel_perf", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.673 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "contact": { 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "contact", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.674 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "description": { 2023-10-08T13:37:35.675 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "description", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.676 INFO:teuthology.orchestra.run.smithi139.stdout: "device_url": { 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "device_url", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.677 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "enabled": { 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "enabled", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.678 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "24", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "8", 2023-10-08T13:37:35.679 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "last_opt_revision": { 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "last_opt_revision", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.680 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "1", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard": { 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard", 2023-10-08T13:37:35.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.682 INFO:teuthology.orchestra.run.smithi139.stdout: "leaderboard_description": { 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "leaderboard_description", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.683 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.684 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.685 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.686 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.687 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "organization": { 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "organization", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.690 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "proxy": { 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "proxy", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "url": { 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "url", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.692 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.693 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "test_orchestrator", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.694 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.695 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.696 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.697 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.698 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.699 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "volumes", 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.700 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.701 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.702 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.703 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.704 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.705 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "max_concurrent_clones": { 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "max_concurrent_clones", 2023-10-08T13:37:35.706 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "4", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.707 INFO:teuthology.orchestra.run.smithi139.stdout: "periodic_async_work": { 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "periodic_async_work", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Periodically check for async work", 2023-10-08T13:37:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "snapshot_clone_delay": { 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snapshot_clone_delay", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "0", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.709 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix", 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "can_run": true, 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "error_string": "", 2023-10-08T13:37:35.710 INFO:teuthology.orchestra.run.smithi139.stdout: "module_options": { 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "discovery_interval": { 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "discovery_interval", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "uint", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "100", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.711 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "identifier": { 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "identifier", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.712 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "interval": { 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "interval", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "secs", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.713 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "60", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "log_level": { 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_level", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.714 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.715 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster": { 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.716 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_cluster_level": { 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_cluster_level", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "info", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [ 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "critical", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "debug", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "error", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "info", 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: "warning" 2023-10-08T13:37:35.718 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "log_to_file": { 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "log_to_file", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "bool", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 1, 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "False", 2023-10-08T13:37:35.719 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_host": { 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_host", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.720 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "", 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_port": { 2023-10-08T13:37:35.721 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_port", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "int", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "10051", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "zabbix_sender": { 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "zabbix_sender", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "str", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "level": "advanced", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "flags": 0, 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "min": "", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "max": "", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "enum_allowed": [], 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "desc": "", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "long_desc": "", 2023-10-08T13:37:35.723 INFO:teuthology.orchestra.run.smithi139.stdout: "tags": [], 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "see_also": [] 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "services": { 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "dashboard": "https://172.21.15.139:8443/" 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "always_on_modules": { 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "octopus": [ 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "balancer", 2023-10-08T13:37:35.724 INFO:teuthology.orchestra.run.smithi139.stdout: "crash", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "devicehealth", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_autoscaler", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "progress", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_support", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "status", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "telemetry", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "volumes" 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "pacific": [ 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "balancer", 2023-10-08T13:37:35.725 INFO:teuthology.orchestra.run.smithi139.stdout: "crash", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "devicehealth", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_autoscaler", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "progress", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_support", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "status", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "telemetry", 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "volumes" 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "quincy": [ 2023-10-08T13:37:35.726 INFO:teuthology.orchestra.run.smithi139.stdout: "balancer", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "crash", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "devicehealth", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_autoscaler", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "progress", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_support", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "status", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "telemetry", 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "volumes" 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "reef": [ 2023-10-08T13:37:35.727 INFO:teuthology.orchestra.run.smithi139.stdout: "balancer", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "crash", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "devicehealth", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "orchestrator", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "pg_autoscaler", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "progress", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "rbd_support", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "status", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "telemetry", 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: "volumes" 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "last_failure_osd_epoch": 5, 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "active_clients": [ 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "devicehealth", 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 496172019 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "libcephsqlite", 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 4224656222 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.730 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "rbd_support", 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2967129286 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snap_schedule", 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2804374375 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "snap_schedule", 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1895072450 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "name": "volumes", 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "addrvec": [ 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v2", 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2023-10-08T13:37:35.733 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3768596099 2023-10-08T13:37:35.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:35.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2023-10-08T13:37:35.734 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:37:35.735 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2068136694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:37:35.735 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:34 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1215255681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:37:35.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2068136694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:37:35.736 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:34 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1215255681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:37:35.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 msgr2=0x7efffc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:35.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 0x7efffc0a3ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efff8005950 tx=0x7efff80058e0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 msgr2=0x7f00101979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:37:35.736 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f000000c920 tx=0x7f000000cce0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 shutdown_connections 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7efffc0a15f0 0x7efffc0a3ab0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0010105600 0x7f00101a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00100ff540 0x7f00101979b0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 --2- 172.21.15.139:0/1215255681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00100fff00 0x7f0010197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 >> 172.21.15.139:0/1215255681 conn(0x7f00100fb030 msgr2=0x7f00100fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 shutdown_connections 2023-10-08T13:37:35.737 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:37:34.157+0000 7f0014e1a700 1 -- 172.21.15.139:0/1215255681 wait complete. 2023-10-08T13:37:35.779 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T13:37:35.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-08T13:37:35.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2068136694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:37:35.780 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:34 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1215255681' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T13:37:35.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:35 smithi155 ceph-mon[103467]: pgmap v613: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:35.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:35 smithi139 ceph-mon[99506]: pgmap v613: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:35.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:35 smithi187 ceph-mon[104336]: pgmap v613: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:36.346 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 267, 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 220, 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1030818, 2023-10-08T13:37:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 122141, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 1, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.035488687, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.012884096, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.020220551, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.004382947, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 220, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.011528752, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000052403 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1029984, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 121824 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 574, 2023-10-08T13:37:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 723, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4343763, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 510304, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.057995948, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.022054325, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.013879916, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.016894793, 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 721, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.027140130, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000037642 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 332096 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1408, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1410, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 8196061, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 437946, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.128295738, 2023-10-08T13:37:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.042741756, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.032759906, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.042739022, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1408, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.054931367, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000039013 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3362, 2023-10-08T13:37:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.086820872, 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000025824 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2023-10-08T13:37:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 3251, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 3251, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 3251, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 80, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2023-10-08T13:37:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2023-10-08T13:37:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2023-10-08T13:37:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 5562, 2023-10-08T13:37:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 8, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 16169362, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 16166801, 2023-10-08T13:37:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 5562 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 958, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 3962, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 3004, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 63, 2023-10-08T13:37:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 126, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 63, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 3251, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 5929, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 2678, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 59236, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 207152 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2023-10-08T13:37:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2023-10-08T13:37:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2023-10-08T13:37:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 1, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2023-10-08T13:37:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2020, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 233556, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 1095, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 185, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 4634746, 2023-10-08T13:37:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 49217, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 1982, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2023-10-08T13:37:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 1982, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1982, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.114971475, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000562548 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1982, 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1983 2023-10-08T13:37:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 1982, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 1982, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1236, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 744, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2023-10-08T13:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2023-10-08T13:37:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2023-10-08T13:37:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 102, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 15, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 6, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 6, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2023-10-08T13:37:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2245, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 13352490, 2023-10-08T13:37:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2245, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2245, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 13352490, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 1982, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 11978694, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1982, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 11978694, 2023-10-08T13:37:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 1982, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 1982, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1982, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1982, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x555f9e004960": { 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:37.612 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:37:37.905 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-10-08T13:37:37.905 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-10-08T13:37:37.905 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2023-10-08T13:37:37.906 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2023-10-08T13:37:37.906 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2023-10-08T13:37:37.906 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:37.906 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:37.906 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2023-10-08T13:37:37.906 DEBUG:tasks.check_counter:Getting stats from d 2023-10-08T13:37:37.906 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-08T13:37:38.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:37 smithi139 ceph-mon[99506]: pgmap v614: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:38.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:37 smithi187 ceph-mon[104336]: pgmap v614: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:38.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:37 smithi155 ceph-mon[103467]: pgmap v614: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:38.463 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:37:39.837 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:37:39.837 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:39.837 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 903, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 903, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 286551, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 280038, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.090671885, 2023-10-08T13:37:39.838 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.034500441, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.019297931, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.028319593, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 902, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.043993199, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000048772 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:39.839 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:39.840 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1127, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1279, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 8838344, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 682867, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:39.841 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.084993300, 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.026882114, 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.024324558, 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.027355888, 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1277, 2023-10-08T13:37:39.842 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.040201299, 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000031481 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.843 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 332624 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 270, 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 225, 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1029700, 2023-10-08T13:37:39.844 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 125440, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.036273086, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.012623875, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.023591995, 2023-10-08T13:37:39.845 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.004495765, 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 224, 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.011599652, 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000051784 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.846 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1028352, 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 124496 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2023-10-08T13:37:39.847 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3422, 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.085853461, 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000025088 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.849 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2023-10-08T13:37:39.851 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 1223, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 0, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 1223, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 1223, 2023-10-08T13:37:39.852 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 3, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:39.853 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2023-10-08T13:37:39.854 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2023-10-08T13:37:39.855 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:39.855 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:37:39.855 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:39.855 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2023-10-08T13:37:39.855 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2023-10-08T13:37:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2023-10-08T13:37:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:37:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:39.856 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:39.857 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:37:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:37:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:39.858 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2023-10-08T13:37:39.859 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:39.860 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:39.861 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2023-10-08T13:37:39.861 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2023-10-08T13:37:39.861 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:39.861 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2023-10-08T13:37:39.861 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2023-10-08T13:37:39.862 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2023-10-08T13:37:39.863 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 4344, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2023-10-08T13:37:39.864 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 7, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2023-10-08T13:37:39.865 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 12744212, 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 12741651, 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.866 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 4344 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 8, 2023-10-08T13:37:39.867 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 2633, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 2625, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 6, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 70, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 64, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 1223, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 3720, 2023-10-08T13:37:39.868 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 2497, 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 55808, 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 207152 2023-10-08T13:37:39.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2023-10-08T13:37:39.870 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2023-10-08T13:37:39.871 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.871 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.871 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.871 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.872 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.873 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.873 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2023-10-08T13:37:39.873 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.873 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.874 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2023-10-08T13:37:39.876 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.877 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2023-10-08T13:37:39.879 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2023-10-08T13:37:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.881 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2023-10-08T13:37:39.883 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.884 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.885 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.886 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:39.887 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.887 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.887 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.887 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.888 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2023-10-08T13:37:39.890 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.891 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:39.893 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.894 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2023-10-08T13:37:39.895 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2023-10-08T13:37:39.897 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2023-10-08T13:37:39.897 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2023-10-08T13:37:39.897 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2023-10-08T13:37:39.897 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2023-10-08T13:37:39.898 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2023-10-08T13:37:39.898 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2023-10-08T13:37:39.898 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2019, 2023-10-08T13:37:39.898 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:39.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:39.899 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:39.900 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:39.900 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:39.900 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:39.900 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:39.901 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:39.902 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:39.903 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:39.904 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 197463, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 54, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:39.905 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 185, 2023-10-08T13:37:39.906 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:39.907 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:39.907 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:39.907 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2023-10-08T13:37:39.907 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 893824, 2023-10-08T13:37:39.907 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 4980, 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.908 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2028, 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2023-10-08T13:37:39.909 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2028, 2023-10-08T13:37:39.910 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2023-10-08T13:37:39.910 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2028, 2023-10-08T13:37:39.910 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.287941385, 2023-10-08T13:37:39.910 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001128176 2023-10-08T13:37:39.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.911 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2023-10-08T13:37:39.911 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2028, 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2029 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2028, 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2028, 2023-10-08T13:37:39.912 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2023-10-08T13:37:39.913 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2023-10-08T13:37:39.913 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2023-10-08T13:37:39.913 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1299, 2023-10-08T13:37:39.913 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2023-10-08T13:37:39.913 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 727, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2023-10-08T13:37:39.914 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:39.915 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:39.916 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2023-10-08T13:37:39.917 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2023-10-08T13:37:39.918 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 102, 2023-10-08T13:37:39.919 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 15, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 6, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 6, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2023-10-08T13:37:39.920 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:39.921 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:39.922 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2296, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 9931593, 2023-10-08T13:37:39.923 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2296, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2296, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 9931593, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:39.924 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2028, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 8549913, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2028, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 8549913, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.925 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:39.926 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2028, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2028, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2028, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2028, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:39.927 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.928 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55f13a5fe960": { 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:39.929 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:39.930 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:37:40.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:39 smithi139 ceph-mon[99506]: pgmap v615: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:40.213 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2023-10-08T13:37:40.213 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds_cache.dir_update_receipt=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:40.214 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2023-10-08T13:37:40.215 DEBUG:tasks.check_counter:Getting stats from g 2023-10-08T13:37:40.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-08T13:37:40.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:39 smithi187 ceph-mon[104336]: pgmap v615: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:40.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:39 smithi155 ceph-mon[103467]: pgmap v615: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:40.779 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:37:41.822 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:41 smithi139 ceph-mon[99506]: pgmap v616: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-08T13:37:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:41 smithi155 ceph-mon[103467]: pgmap v616: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-08T13:37:41.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:41 smithi187 ceph-mon[104336]: pgmap v616: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1191, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1193, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4559064, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 370402, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2023-10-08T13:37:42.007 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.098758603, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.028875727, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.026172340, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.034071553, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1191, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.044527899, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000037386 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.008 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 887, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 842, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4765825, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 316445, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.083771823, 2023-10-08T13:37:42.009 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.026403254, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.036108713, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.021052054, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 841, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.034054922, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000040493 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.010 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1027536, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 122624 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 228, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 376, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 58032, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 403657, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:42.011 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.033456291, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.016238618, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.006146928, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.007885110, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 375, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.020728507, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000055276 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.012 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 334304 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3400, 2023-10-08T13:37:42.013 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.090037419, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000026481 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.014 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2023-10-08T13:37:42.015 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 1104, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 1104, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 1104, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2023-10-08T13:37:42.016 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:42.017 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:42.018 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2023-10-08T13:37:42.019 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2023-10-08T13:37:42.020 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2023-10-08T13:37:42.021 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 3946, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 6, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2023-10-08T13:37:42.022 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 11965691, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 11963130, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 3946 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.023 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 7, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 2389, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 2382, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 5, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 55, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 50, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 1104, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 3345, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 2241, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2023-10-08T13:37:42.024 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 52952, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 207152 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.025 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.026 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.027 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.028 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.030 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2023-10-08T13:37:42.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.033 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.035 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.036 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.037 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 1, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 0, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2023-10-08T13:37:42.038 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 2023, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:42.039 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:42.040 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:42.041 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 198247, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 56, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:42.042 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 185, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 806512, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 4492, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.043 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2037, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2037, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2037, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.336965757, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000656340 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.044 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2037, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2038 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2037, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2037, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1305, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2023-10-08T13:37:42.045 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 730, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2023-10-08T13:37:42.046 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2023-10-08T13:37:42.047 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2023-10-08T13:37:42.048 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 102, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 15, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 6, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 6, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2023-10-08T13:37:42.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2023-10-08T13:37:42.050 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:42.051 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2302, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 9159535, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2302, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2302, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 9159535, 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:42.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:42.053 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2037, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 7772907, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2037, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 7772907, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2037, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2037, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2037, 2023-10-08T13:37:42.055 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2037, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:42.056 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x563b6981c960": { 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:42.058 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:42.059 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:37:42.337 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-08T13:37:42.337 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-08T13:37:42.337 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-08T13:37:42.338 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-08T13:37:42.338 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-08T13:37:42.338 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:42.338 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:42.338 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2023-10-08T13:37:42.338 DEBUG:tasks.check_counter:Getting stats from j 2023-10-08T13:37:42.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-08T13:37:42.900 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T13:37:43.871 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:43 smithi139 ceph-mon[99506]: pgmap v617: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:44.110 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2023-10-08T13:37:44.110 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:44.110 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 0, 2023-10-08T13:37:44.110 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 2, 2023-10-08T13:37:44.110 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 0, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 0, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.001260176, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.000340051, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:44.111 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 212, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 205, 2023-10-08T13:37:44.112 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 744640, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 122096, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 2, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 1, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.031610779, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.011940687, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.017328705, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.004441690, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 205, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.009116202, 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000044469 2023-10-08T13:37:44.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 744640, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 122096 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 155, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 160, 2023-10-08T13:37:44.114 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 103808, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 3, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.011553388, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.008768051, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.001226180, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 153, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.008069809, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000052743 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:44.115 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 103808 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 0, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2023-10-08T13:37:44.116 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:44.117 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:44.118 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:44.119 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 148984, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 30, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:44.120 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:44.121 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 928, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 2, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:44.122 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 209, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 712265, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 209, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 209, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 712265, 2023-10-08T13:37:44.123 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2023-10-08T13:37:44.124 INFO:teuthology.orchestra.run.smithi139.stdout:} 2023-10-08T13:37:44.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:43 smithi187 ceph-mon[104336]: pgmap v617: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:44.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:43 smithi155 ceph-mon[103467]: pgmap v617: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 12 op/s 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:37:44.553 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-08T13:37:44.554 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2023-10-08T13:37:44.554 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T13:37:44.554 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-08T13:37:45.135 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:37:46.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:45 smithi155 ceph-mon[103467]: pgmap v618: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-10-08T13:37:46.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:45 smithi139 ceph-mon[99506]: pgmap v618: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-10-08T13:37:46.250 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:45 smithi187 ceph-mon[104336]: pgmap v618: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s 2023-10-08T13:37:46.613 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-10-08T13:37:46.613 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:46.613 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2669, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 3181, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 850008, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 5851119, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 14, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.168040773, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.054823638, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.059449052, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.047327596, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3177, 2023-10-08T13:37:46.614 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.344083174, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000108304 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1782, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000315207, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000176 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1901318, 2023-10-08T13:37:46.615 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1902321, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 310883475, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 309287171, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 8, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 6, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 59.028053267, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 23.863849780, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 41.722179375, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.037736333, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1902322, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 29.275352897, 2023-10-08T13:37:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000015389 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3327872, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.572066462, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000171 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1050752, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 164272 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 42476, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 48836, 2023-10-08T13:37:46.617 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 9950090, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 18225701, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 19, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 8, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 1.703054389, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.668737434, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 1.182267241, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.029838096, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 48835, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.257468468, 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000025749 2023-10-08T13:37:46.618 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 87210, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.010221929, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000117 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 337872 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.619 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 897, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.288785271, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002551600 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2849, 2023-10-08T13:37:46.620 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.353357516, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000124028 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 4005, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 3842, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3842, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 6.441327491, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001676555 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2023-10-08T13:37:46.621 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 162, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 2, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 27, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 2, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 1699, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 2, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 1, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 1696, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 1696, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 2634, 2023-10-08T13:37:46.622 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 3, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 6291, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 5680, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 162, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 44, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 1, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 44, 2023-10-08T13:37:46.623 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 2489, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 55, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 2640, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 491, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 246, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 6, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 491, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:46.624 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 5, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 5, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 486, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 24, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 253, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 2200, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 1084, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 824, 2023-10-08T13:37:46.625 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 42, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 3169 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 289, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 367, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 198, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 315, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 457, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 50, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:46.626 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1609, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1559, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 44, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2023-10-08T13:37:46.627 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 2, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 5562, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 5562, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2023-10-08T13:37:46.628 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 8, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 8, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 16169362, 2023-10-08T13:37:46.629 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 0, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 274, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.659171637, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.013354641 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 0 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 967, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 3982, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 3015, 2023-10-08T13:37:46.630 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 72, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 282, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 210, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 1699, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 5964, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 4265, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 0, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 2438, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 2438, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 75972, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 198960 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.631 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 4956, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 28, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 4005, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 9, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 79, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 362, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.250801323, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000692821 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.632 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.633 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1786, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.591473289, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001450992 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2023-10-08T13:37:46.634 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.635 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.636 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2023-10-08T13:37:46.637 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 85, 2023-10-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.100890034, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001186941 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.639 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 50, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.918376530, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.018367530 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.640 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.641 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.642 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.643 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1559, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.579786315, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001654769 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.644 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 2192, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 2192, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 550, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2023-10-08T13:37:46.645 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:46.646 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:46.647 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 713667, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 1183, 2023-10-08T13:37:46.648 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 185, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:46.649 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 3627522, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 48564, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2023-10-08T13:37:46.650 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 4082, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 12481636, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 27, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 4082, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4082, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 25.806463011, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.006322014 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4082, 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 4146 2023-10-08T13:37:46.651 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 4082, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 538, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 3544, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 0, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 10, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 45, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 319, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 35, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2023-10-08T13:37:46.652 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 3134, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 492, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 20, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2023-10-08T13:37:46.653 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2023-10-08T13:37:46.654 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 102, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 15, 2023-10-08T13:37:46.655 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 12, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 12, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 73, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 4, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 14 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 1, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2023-10-08T13:37:46.656 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 12, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 5, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1559, 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:46.657 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1946459, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 146484403, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:46.658 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1946459, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1946459, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 146484403, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:46.659 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:46.660 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:46.660 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:46.660 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:46.660 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:46.660 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4082, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 12701847, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 4082, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 12701847, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.661 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 4082, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 4082, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 4082, 2023-10-08T13:37:46.662 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 4082, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1559, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 220243, 2023-10-08T13:37:46.663 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1559, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 45, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 220243, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:46.664 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x557d14d626e0": { 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 5562, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 11975058, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 5562, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 274, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 11975058, 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:46.665 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.666 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:46.666 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds.exported=44 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds.imported=55 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=289 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=367 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:46.990 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=2 2023-10-08T13:37:46.991 DEBUG:tasks.check_counter:Getting stats from e 2023-10-08T13:37:46.991 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-08T13:37:47.545 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:37:48.031 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:47 smithi155 ceph-mon[103467]: pgmap v619: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2023-10-08T13:37:48.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:47 smithi139 ceph-mon[99506]: pgmap v619: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2023-10-08T13:37:48.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:47 smithi187 ceph-mon[104336]: pgmap v619: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 974, 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 974, 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 38719922, 2023-10-08T13:37:48.758 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 302128, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.102755162, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.025470293, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.040062846, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.028916432, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 973, 2023-10-08T13:37:48.759 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.046647361, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000047941 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:48.760 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 330, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 300, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 21405488, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 122498, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.043604081, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.009448354, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.026189161, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.007741252, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 299, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.027227766, 2023-10-08T13:37:48.761 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000091062 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 388784, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 68016 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:48.762 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 284, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 367, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 8345411, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 316631, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.034982518, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.008764156, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.012332368, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.011015417, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 365, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.020309202, 2023-10-08T13:37:48.763 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000055641 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 228608 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2023-10-08T13:37:48.764 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2392, 2023-10-08T13:37:48.765 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.063239059, 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000026437 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:48.766 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 0, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 0, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.767 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 143, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 9, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 134, 2023-10-08T13:37:48.768 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 130, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 4, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2023-10-08T13:37:48.769 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:48.770 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 246, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 6, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:48.771 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 0, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 0 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.772 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:48.773 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:48.774 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2023-10-08T13:37:48.775 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 15588, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 0, 2023-10-08T13:37:48.776 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 2, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 15, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 142950038, 2023-10-08T13:37:48.777 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 143290607, 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 143290471, 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 15588 2023-10-08T13:37:48.778 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 65, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 97, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 32, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 13, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 17, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 4, 2023-10-08T13:37:48.779 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 143, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 178, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 35, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 0, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 0, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 47844, 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 207128 2023-10-08T13:37:48.780 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 0, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 0, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 0, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 0, 2023-10-08T13:37:48.781 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2023-10-08T13:37:48.783 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.784 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2023-10-08T13:37:48.785 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.786 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.787 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.788 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.789 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2023-10-08T13:37:48.790 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.791 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:48.792 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.793 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.794 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.794 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2023-10-08T13:37:48.794 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.794 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.794 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.795 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2023-10-08T13:37:48.796 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.797 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.798 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.799 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2023-10-08T13:37:48.800 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.801 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2023-10-08T13:37:48.802 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 2, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 2, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 2010, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:48.803 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:48.804 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:48.805 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 223957, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 135, 2023-10-08T13:37:48.806 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 185, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:48.807 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 301070, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 2656, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 1428, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 26, 2023-10-08T13:37:48.808 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 4, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 1428, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1428, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.236974539, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000866228 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1428, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1429 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.809 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 1428, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 1428, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 806, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 619, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2023-10-08T13:37:48.810 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 2, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2023-10-08T13:37:48.812 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2023-10-08T13:37:48.813 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 102, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 9, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 9, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 9, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 0, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 2, 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 0 2023-10-08T13:37:48.814 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:48.815 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1584, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 68317549, 2023-10-08T13:37:48.816 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1584, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1584, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 68317549, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.817 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1428, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 67678749, 2023-10-08T13:37:48.818 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1428, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 67678749, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:48.819 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 1428, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 1428, 2023-10-08T13:37:48.820 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 1428, 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1428, 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:48.821 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:48.822 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:48.823 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x564b68c4c8c0": { 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2023-10-08T13:37:48.824 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:48.825 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-10-08T13:37:49.100 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:49.101 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:49.102 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2023-10-08T13:37:49.102 DEBUG:tasks.check_counter:Getting stats from h 2023-10-08T13:37:49.102 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-08T13:37:49.656 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:37:50.149 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:49 smithi155 ceph-mon[103467]: pgmap v620: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:50.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:49 smithi139 ceph-mon[99506]: pgmap v620: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:50.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:49 smithi187 ceph-mon[104336]: pgmap v620: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1928709, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1928727, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 326668982, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 311187501, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 19, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 8, 2023-10-08T13:37:50.874 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 61.592362142, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 25.103588035, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 43.522144184, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.023050627, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1928725, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 27.763642249, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000014394 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3392609, 2023-10-08T13:37:50.875 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.536992774, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000158 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1043296, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 156048 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 106119, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 110786, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 20470809, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 23107493, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 14, 2023-10-08T13:37:50.876 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 3.156247707, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 1.295959451, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 2.108992664, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.032751152, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 110786, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.867479270, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000016856 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 199921, 2023-10-08T13:37:50.877 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.021724398, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000108 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 339568 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 2648, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 2184, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1209487, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 3068436, 2023-10-08T13:37:50.878 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 10, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 6, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.154581480, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.055029315, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.069845520, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.038043385, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2182, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.214278016, 2023-10-08T13:37:50.879 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000098202 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1899, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000250148, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000131 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 3472, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 11040 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2023-10-08T13:37:50.880 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 580, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1.727254950, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002978025 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:50.881 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2278, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.333352278, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000146335 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 3111, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 3108, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3108, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.939934230, 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000945924 2023-10-08T13:37:50.882 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 3, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 10, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 11, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 19, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 4, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 5, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 10, 2023-10-08T13:37:50.883 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 13, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 2664, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 2, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 5, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 5321, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 4844, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 125, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 2, 2023-10-08T13:37:50.884 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 49, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 2461, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 49, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 1176, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 437, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2023-10-08T13:37:50.885 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 246, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 6, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 437, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 437, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 17, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 1580, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 833, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 815, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 45, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 2527 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2023-10-08T13:37:50.887 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 105, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 643, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 407, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 490, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 128, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 1218, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 1218, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:50.888 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 49, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2023-10-08T13:37:50.889 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 4344, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 4344, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 7, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 7, 2023-10-08T13:37:50.890 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 12744212, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 0, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 143, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.214925372, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.022481995 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 0 2023-10-08T13:37:50.891 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 25, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 2775, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 2750, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 24, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 291, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 267, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 19, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 3924, 2023-10-08T13:37:50.892 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 3905, 2023-10-08T13:37:50.893 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 2, 2023-10-08T13:37:50.893 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 2079, 2023-10-08T13:37:50.893 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 2077, 2023-10-08T13:37:50.893 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 73496, 2023-10-08T13:37:50.894 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 198960 2023-10-08T13:37:50.894 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.894 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2023-10-08T13:37:50.894 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 3858, 2023-10-08T13:37:50.894 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 9, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 3111, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 17, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 45, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 329, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.217801618, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000662010 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000779545, 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000259848 2023-10-08T13:37:50.895 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2023-10-08T13:37:50.896 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1508, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.623731906, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000413615 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000182298, 2023-10-08T13:37:50.897 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000182298 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.898 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.899 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.900 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 49, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.077735840, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001586445 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.901 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.902 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.903 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.904 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.905 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1218, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2.019703023, 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001658212 2023-10-08T13:37:50.906 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 2, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 2, 2023-10-08T13:37:50.907 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 2, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 1611, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 805, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 603, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:50.908 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:50.909 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:50.910 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 300777, 2023-10-08T13:37:50.911 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 140, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 880, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 10, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 185, 2023-10-08T13:37:50.912 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 136437, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 500, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.913 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 3162, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 8809343, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 28, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 3162, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3162, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 24.898480858, 2023-10-08T13:37:50.914 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.007874282 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3162, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3213 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 3162, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 475, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 2687, 2023-10-08T13:37:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 10, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 28, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 171, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 26, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2023-10-08T13:37:50.916 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 2450, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 437, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 20, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2023-10-08T13:37:50.917 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2023-10-08T13:37:50.918 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2023-10-08T13:37:50.919 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 102, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 15, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 12, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 12, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 41, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 20, 2023-10-08T13:37:50.920 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 10 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 1, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2023-10-08T13:37:50.921 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 10, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 5, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 1218, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 2037472, 2023-10-08T13:37:50.922 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 164958407, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 2037472, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2037472, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 164958407, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.923 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 3162, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 8977721, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 3162, 2023-10-08T13:37:50.924 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 8977721, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:50.925 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 3162, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 3162, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 3162, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 3162, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.926 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 1218, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 168538, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 1218, 2023-10-08T13:37:50.927 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 28, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 168538, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x55ceb38c26e0": { 2023-10-08T13:37:50.928 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 4344, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 8549908, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 4344, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 143, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 8549908, 2023-10-08T13:37:50.929 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:50.930 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-10-08T13:37:51.299 INFO:tasks.check_counter:Daemon mds.h mds.exported=49 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds.imported=49 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=105 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=643 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:51.300 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2023-10-08T13:37:51.300 DEBUG:tasks.check_counter:Getting stats from k 2023-10-08T13:37:51.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-08T13:37:51.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:51 smithi155 ceph-mon[103467]: pgmap v621: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:51.857 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T13:37:51.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:51 smithi139 ceph-mon[99506]: pgmap v621: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:51.976 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:51 smithi187 ceph-mon[104336]: pgmap v621: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:37:53.073 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 977, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 932, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1266656, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 346558, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.108223309, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.038249472, 2023-10-08T13:37:53.074 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.038350736, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.028762631, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 931, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.054187594, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000058203 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1029440, 2023-10-08T13:37:53.075 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 126992 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 226, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 382, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 55574, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 408117, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 4, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.029796605, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.010661705, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.007067097, 2023-10-08T13:37:53.076 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.008999153, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 380, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.022259685, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000058578 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 338080 2023-10-08T13:37:53.077 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1200, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1200, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 12502994, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 372411, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.083043587, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.018197261, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.028020117, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.031422459, 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:53.078 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1199, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.031278890, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000026087 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.079 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3561, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.093823321, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000026347 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:53.080 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 0, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 0, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 9305, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 186, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 8984, 2023-10-08T13:37:53.082 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 135, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 9039, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 4, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 1, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2023-10-08T13:37:53.083 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T13:37:53.084 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:53.085 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 0 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2023-10-08T13:37:53.086 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2023-10-08T13:37:53.087 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 4195, 2023-10-08T13:37:53.088 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 7, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 16387813, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 16384779, 2023-10-08T13:37:53.089 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 4195 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 4876, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 6716, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 1840, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 171, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 241, 2023-10-08T13:37:53.090 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 70, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 9305, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 10927, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 1622, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 0, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 0, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 70880, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 207152 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 0, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2023-10-08T13:37:53.091 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 0, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 0, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 0, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.092 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.094 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.096 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.097 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.098 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.099 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.100 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.101 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.102 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:53.103 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 2, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 1, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2023-10-08T13:37:53.104 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 2016, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:53.105 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:53.106 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:53.107 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 356988, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 4959, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:53.108 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 185, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 17816435, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 152175, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2023-10-08T13:37:53.109 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 2127, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 21, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 3, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 2127, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2127, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.713922568, 2023-10-08T13:37:53.110 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001746084 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2127, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2128 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 2127, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 2127, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 0, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2023-10-08T13:37:53.111 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 1353, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 772, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:53.112 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 1, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2023-10-08T13:37:53.113 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2023-10-08T13:37:53.114 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 102, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 15, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 5, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 5, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 0, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 2, 2023-10-08T13:37:53.115 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 0 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:53.116 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 2399, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 13592744, 2023-10-08T13:37:53.117 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 2399, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2399, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 13592744, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:53.118 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2127, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 12193514, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2127, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 12193514, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.119 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:53.120 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2127, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 2127, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2127, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2127, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:53.121 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.122 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x557963ed8960": { 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2023-10-08T13:37:53.123 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout: } 2023-10-08T13:37:53.124 INFO:teuthology.orchestra.run.smithi155.stdout:} 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:53.502 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2023-10-08T13:37:53.502 DEBUG:tasks.check_counter:Getting stats from c 2023-10-08T13:37:53.503 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-08T13:37:54.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:53 smithi139 ceph-mon[99506]: pgmap v622: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:37:54.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:53 smithi187 ceph-mon[104336]: pgmap v622: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:37:54.272 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:37:54.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:53 smithi155 ceph-mon[103467]: pgmap v622: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2023-10-08T13:37:55.158 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:54 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:37:55.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:54 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:37:55.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:54 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 4796476, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 4795932, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 765551913, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 803979890, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 11, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 5, 2023-10-08T13:37:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 136.889113592, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 58.286811942, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 99.004814515, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.030091543, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 4795930, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 129.523536393, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000027006 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 9196446, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.419899564, 2023-10-08T13:37:55.739 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000154 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 100615, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 102943, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 19673846, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 19896458, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 15, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 7, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 4.632227317, 2023-10-08T13:37:55.740 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 1.994159257, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 3.248035510, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.093440270, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 102943, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.903128268, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000018487 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 200318, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.025544268, 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000127 2023-10-08T13:37:55.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1059216, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 175920 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 5111, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 8799, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 1861196, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 5410394, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 16, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 8, 2023-10-08T13:37:55.742 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.300202187, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.123318636, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.182194136, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.027346799, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8797, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.580873194, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000066030 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 9949, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.001669732, 2023-10-08T13:37:55.743 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000167 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1728, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 342720 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:37:55.744 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1513, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.060104748, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001361602 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1478, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.204368503, 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000138273 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 2984, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 2860, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2860, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 13.369648464, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004674702 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 124, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 33, 2023-10-08T13:37:55.746 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 11, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 8456, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 158, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 7670, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 628, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 8229, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 1930, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 0, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 0, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 4, 2023-10-08T13:37:55.747 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 5916, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 3531, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 109, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 99, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 7, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 27, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 1432, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 167, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 8604, 2023-10-08T13:37:55.748 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 821, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 4, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 246, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 6, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 821, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 35, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:55.749 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 35, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 786, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 27, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 120, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 1233, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 2, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 853, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 695, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 32, 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 1880 2023-10-08T13:37:55.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 132, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 508, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 293, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 512, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 238, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 18, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 836, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 818, 2023-10-08T13:37:55.751 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 27, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-10-08T13:37:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 4195, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 4195, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 7, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2023-10-08T13:37:55.753 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 7, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 2, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 16387813, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 459, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 7.409820425, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.016143399 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.754 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 4898, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 6915, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 2017, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 187, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 381, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 194, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 8456, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 11434, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 2978, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 0, 2023-10-08T13:37:55.755 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 1926, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 1926, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 86000, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 198960 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 4999, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 61, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 2984, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 21, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 336, 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-10-08T13:37:55.756 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 198, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.564760437, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002852325 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.016069832, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.003213966 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1612, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.393680234, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000864565 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:55.758 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.759 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.760 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5, 2023-10-08T13:37:55.761 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.010075598, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002015119 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.762 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 106, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.045845032, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000432500 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 79, 2023-10-08T13:37:55.763 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.151112210, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001912812 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 17, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 6.677176528, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.392775089 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.764 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 18, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.158924815, 2023-10-08T13:37:55.765 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.119940267 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.766 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.008500773, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004250386 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.767 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.768 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.001356712, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000678356 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 816, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.342146293, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002870277 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:55.769 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 1, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 2, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 1, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 1, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 1489, 2023-10-08T13:37:55.770 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 1489, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 630, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:55.771 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:55.772 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:55.773 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 615788, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 4982, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 968, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 11, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-10-08T13:37:55.774 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 185, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 17432999, 2023-10-08T13:37:55.775 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 166404, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 3100, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 12384913, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 33, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 3100, 2023-10-08T13:37:55.776 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3100, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 20.476656717, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.006605373 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3100, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3196 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 3100, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 883, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 2217, 2023-10-08T13:37:55.777 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 10, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 29, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 488, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 33, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 1650, 2023-10-08T13:37:55.778 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 828, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 20, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-10-08T13:37:55.779 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 2, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-10-08T13:37:55.780 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 102, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 15, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 12, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2023-10-08T13:37:55.781 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 54, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 66, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 16 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2023-10-08T13:37:55.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 10, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 5, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 818, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:37:55.783 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 4902198, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 345870543, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 4902198, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 4902198, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 345870543, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 3100, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 12505259, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 3100, 2023-10-08T13:37:55.785 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 12505259, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:37:55.786 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 3100, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 3100, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 3100, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 3100, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 818, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 120874, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 818, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 29, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 120874, 2023-10-08T13:37:55.788 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x55ec40ada6e0": { 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 4195, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 12193509, 2023-10-08T13:37:55.789 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 4195, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 459, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 12193509, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:55.790 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-10-08T13:37:56.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:55 smithi139 ceph-mon[99506]: pgmap v623: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:56.205 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:55 smithi187 ceph-mon[104336]: pgmap v623: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds.exported=27 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds.imported=167 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=132 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=508 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:56.221 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2023-10-08T13:37:56.221 DEBUG:tasks.check_counter:Getting stats from f 2023-10-08T13:37:56.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-08T13:37:56.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:55 smithi155 ceph-mon[103467]: pgmap v623: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:37:56.786 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:37:58.161 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 60421, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 61332, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 12081333, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 16449143, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 10, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 3, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 2.613188170, 2023-10-08T13:37:58.162 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 1.104827414, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 1.891861376, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.027261293, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 61334, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.022698005, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000032978 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 118749, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.014641704, 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000123 2023-10-08T13:37:58.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 970027, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 969942, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 158809193, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 158661715, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 13, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 7, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 45.646895947, 2023-10-08T13:37:58.164 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 18.646318236, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 34.216458967, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.039851168, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 969942, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 15.550395125, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000016032 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1935579, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.254105616, 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000131 2023-10-08T13:37:58.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1049888, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 166128 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 5609, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 8783, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 2110012, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 4983171, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 19, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 11, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.342185553, 2023-10-08T13:37:58.166 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.139548392, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.228115826, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.022670789, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8777, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.464558677, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000166863 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10841, 2023-10-08T13:37:58.167 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.001959790, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000180 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 160, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 341504 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-10-08T13:37:58.168 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 628, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.743833731, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002776805 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2022, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.271193279, 2023-10-08T13:37:58.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000134121 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 2742, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 2584, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2584, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3.486432380, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001349238 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-10-08T13:37:58.170 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 158, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 1, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 11, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 19, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 4, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 5, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 10, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 13, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 2357, 2023-10-08T13:37:58.171 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 1, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 1, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 5, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 4694, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 4100, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 158, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 102, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 3, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-10-08T13:37:58.172 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 33, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 2170, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 33, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 1171, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 537, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 4, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 246, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 6, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 537, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-10-08T13:37:58.173 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 537, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 14, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 1316, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:37:58.174 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 845, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 831, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 20, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 2232 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 35, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 623, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 359, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 474, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 62, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2023-10-08T13:37:58.175 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 1100, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 1100, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T13:37:58.176 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 33, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 3946, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 3946, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-10-08T13:37:58.177 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 6, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 6, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 2, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 11965691, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2023-10-08T13:37:58.178 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 114, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.159021060, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.010166851 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 25, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 2476, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 2451, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 24, 2023-10-08T13:37:58.179 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 326, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 302, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 19, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 3494, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 3475, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 1, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 1854, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 1853, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 69340, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 198960 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 3699, 2023-10-08T13:37:58.180 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 9, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 2742, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 9, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 49, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 205, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.140409521, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000684924 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.182 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1245, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.732409176, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000588280 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1, 2023-10-08T13:37:58.183 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000314090, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000314090 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-10-08T13:37:58.185 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.186 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 33, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.039157459, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001186589 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.187 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.188 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-10-08T13:37:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-10-08T13:37:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1100, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.574142134, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002340129 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-10-08T13:37:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 1, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 1, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 0, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 1, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 1466, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 1466, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 623, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:37:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:37:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:37:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 292410, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 126, 2023-10-08T13:37:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 440, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 5, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 9640, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 185, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:37:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 121933, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 455, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-10-08T13:37:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 2981, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 8004297, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 27, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 2981, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2981, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 18.245694792, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.006120662 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2981, 2023-10-08T13:37:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3021 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 2981, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 564, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 2417, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 0, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 10, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 26, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 140, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 25, 2023-10-08T13:37:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 2213, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 537, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 20, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:37:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-10-08T13:37:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-10-08T13:37:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 102, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 15, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 12, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 39, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 2, 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 9 2023-10-08T13:37:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-10-08T13:37:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 10, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 5, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 1100, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 1036053, 2023-10-08T13:37:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 79737812, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 1036053, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 1036053, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 79737812, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 2981, 2023-10-08T13:37:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 8157653, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 2981, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 8157653, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-10-08T13:37:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 2981, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 2981, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 2981, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 2981, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 1100, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 153372, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 1100, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 26, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 153372, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x561589ec06e0": { 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:37:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 3946, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 7771387, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 3946, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 114, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 7771387, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:37:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:37:58.215 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-10-08T13:37:58.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: pgmap v624: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:37:58.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.215 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:57 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: pgmap v624: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.216 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:57 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: pgmap v624: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:57 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:58.552 INFO:tasks.check_counter:Daemon mds.f mds.exported=33 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds.imported=33 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=35 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=623 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T13:37:58.553 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2023-10-08T13:37:58.553 DEBUG:tasks.check_counter:Getting stats from i 2023-10-08T13:37:58.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-08T13:37:59.111 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:37:59.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:37:59.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:37:59.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:58 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:37:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:37:59.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:58 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:37:59.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T13:37:59.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T13:37:59.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:58 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' 2023-10-08T13:38:00.174 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:37:59 smithi187 ceph-mon[104336]: pgmap v625: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:38:00.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:37:59 smithi139 ceph-mon[99506]: pgmap v625: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:38:00.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:37:59 smithi155 ceph-mon[103467]: pgmap v625: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 166731, 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 164754, 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 32712098, 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 96973286, 2023-10-08T13:38:00.347 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 105, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 6.149959756, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 2.315120595, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 3.300985566, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.893502472, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 164752, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 11.530955641, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000069989 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:00.348 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 274040, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.035248769, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000128 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 313264, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 85584 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 60545, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 113704, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 17913111, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 104493334, 2023-10-08T13:38:00.349 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 33, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 5, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 4.553298998, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 1.766615395, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 2.373890555, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.833595638, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 113703, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 19.604369089, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000172417 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:00.350 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 103445, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.021684929, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000209 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 49632, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 384288 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 188273, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 184903, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 38728424, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 60679421, 2023-10-08T13:38:00.351 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 13, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 7, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 8.308316860, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 3.420463027, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 4.960924890, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.859867630, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 184902, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 18.101085591, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000097895 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:00.352 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 319685, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.036938177, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000115 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1067520, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 139536 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.353 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 88763, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 32.511721778, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000366275 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3613, 2023-10-08T13:38:00.354 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.659680765, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000182585 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 20569, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 20071, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 20071, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 85.124359315, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004241161 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.355 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 498, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 5, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 1, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 616, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 21, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 1, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 159, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 18, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 130, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 11, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 132, 2023-10-08T13:38:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 6922, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 2, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 2, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 6, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 24147, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 22551, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 360, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 60, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 39, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-10-08T13:38:00.357 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 155, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 5160, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 4, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 121, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 137, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 4, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 246, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 6, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 137, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-10-08T13:38:00.358 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 71, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 4, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 67, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 66, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 15, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 9440, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 17446, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 8292, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T13:38:00.359 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 14474, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 12060, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 211, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 13318 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 379, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 167, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 114, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 105, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 1017, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 3, 2023-10-08T13:38:00.360 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 2019, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 2014, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 2, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 4, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 155, 2023-10-08T13:38:00.361 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 22, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evlrg": 0, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 41947, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 41872, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 41872, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 75, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-10-08T13:38:00.362 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 33, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 77, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 76, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 76, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 1, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segmjr": 1, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 1, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 142950038, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 143290607, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-10-08T13:38:00.363 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 26845, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 68.235490454, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002541832 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 91, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 6712, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 6621, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 36, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 353, 2023-10-08T13:38:00.364 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 317, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 159, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 9202, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 9043, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 2, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 5699, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 5697, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 88560, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 207152 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 40699, 2023-10-08T13:38:00.365 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 175, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 20569, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 182, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 342, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5604, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 24.671962368, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004402562 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 482, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.446642741, 2023-10-08T13:38:00.366 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.005076022 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.002660815, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001330407 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.367 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1748, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.700745133, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000972966 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.368 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.369 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.003723725, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000372372 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 82, 2023-10-08T13:38:00.370 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.069552984, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000848207 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.573033742, 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.157303374 2023-10-08T13:38:00.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 320, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.074411838, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000232536 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 75, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.749520547, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.009993607 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-10-08T13:38:00.372 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 64, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.145908302, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002279817 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 25, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.557177426, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.022287097 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 4, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.505762589, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.126440647 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-10-08T13:38:00.374 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 9666, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 48.020367260, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004967966 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.375 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.003522746, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000440343 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.376 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 7, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.020255697, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002893671 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 5, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.005168998, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001033799 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1959, 2023-10-08T13:38:00.377 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.573942404, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002334835 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-10-08T13:38:00.378 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 2, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 4, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 2, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 2, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 367, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 183, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 615, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "mdthresh_evicted": 0 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 240, 2023-10-08T13:38:00.379 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 240, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:38:00.380 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-10-08T13:38:00.381 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 357218, 2023-10-08T13:38:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 201, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 1408, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 16, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 9640, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 185, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:38:00.383 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 424735, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 3479, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-10-08T13:38:00.384 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 77503, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 146767467, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 31, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 77503, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 77503, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1738.727724014, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.022434328 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 77503, 2023-10-08T13:38:00.385 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 88776 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 77503, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 197, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 77306, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 378, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 6718, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 50, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 26891, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 155, 2023-10-08T13:38:00.386 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 7, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 4140, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 147, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 10144, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-10-08T13:38:00.387 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 38663, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-10-08T13:38:00.388 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-10-08T13:38:00.389 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 102, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 20, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 12, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 1323, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 12, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 148 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-10-08T13:38:00.390 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 30, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-10-08T13:38:00.391 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 6, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 2014, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 415545, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 51897593, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 415545, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:38:00.392 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 415545, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 51897593, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:38:00.393 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 77503, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 146992741, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 77503, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 146992741, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.394 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 77503, 2023-10-08T13:38:00.395 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 77503, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 77503, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 77503, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:38:00.396 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 2014, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 225358, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 2014, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 46, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 225358, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.397 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x56069525e6e0": { 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 41947, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 139096303, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 41947, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:38:00.398 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 26845, 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 139096303, 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:00.399 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds.exported=155 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=379 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=167 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2023-10-08T13:38:00.768 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=21 2023-10-08T13:38:00.768 DEBUG:tasks.check_counter:Getting stats from l 2023-10-08T13:38:00.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-08T13:38:01.325 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T13:38:01.847 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:01 smithi155 ceph-mon[103467]: pgmap v626: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:38:01.869 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:01 smithi187 ceph-mon[104336]: pgmap v626: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:38:01.937 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:01 smithi139 ceph-mon[99506]: pgmap v626: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T13:38:02.522 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-10-08T13:38:02.522 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T13:38:02.522 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 0, 2023-10-08T13:38:02.522 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 2, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 0, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 0, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 4, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 0, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.001139413, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.000288342, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:02.523 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 5, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 161, 2023-10-08T13:38:02.524 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 3152, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 104960, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 3, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 2, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.008605745, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.005551979, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.001516790, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 160, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.016988840, 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000106180 2023-10-08T13:38:02.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 104960 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 214, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 209, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 743280, 2023-10-08T13:38:02.526 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 125392, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 2, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 1, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.031964389, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.008748529, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.017123654, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.006682984, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 208, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.016136080, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000077577 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-10-08T13:38:02.527 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 743280, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 125392 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 0, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-10-08T13:38:02.528 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-10-08T13:38:02.529 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T13:38:02.530 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T13:38:02.531 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 150015, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 31, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 0, 2023-10-08T13:38:02.532 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 928, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 2, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T13:38:02.533 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 215, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 713045, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 215, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 215, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 713045, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-10-08T13:38:02.534 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-10-08T13:38:02.535 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-10-08T13:38:02.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:02.535 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-10-08T13:38:02.535 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-10-08T13:38:02.982 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2023-10-08T13:38:02.983 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T13:38:02.994 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T13:38:02.994 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:38:02.994 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:38:03.017 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:38:03.018 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:38:03.079 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:38:03.252 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 -- 172.21.15.139:0/2839332508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc0ff540 msgr2=0x7fd3fc0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2839332508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc0ff9c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00099c0 tx=0x7fd3f0009cd0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 -- 172.21.15.139:0/2839332508 shutdown_connections 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2839332508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 0x7fd3fc10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2839332508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc105600 0x7fd3fc1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2839332508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc0ff9c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 -- 172.21.15.139:0/2839332508 >> 172.21.15.139:0/2839332508 conn(0x7fd3fc0fb030 msgr2=0x7fd3fc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 -- 172.21.15.139:0/2839332508 shutdown_connections 2023-10-08T13:38:03.253 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.251+0000 7fd4011a1700 1 -- 172.21.15.139:0/2839332508 wait complete. 2023-10-08T13:38:03.255 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.252+0000 7fd4011a1700 1 Processor -- start 2023-10-08T13:38:03.255 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.252+0000 7fd4011a1700 1 -- start start 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc1956d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 0x7fd3fc195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1a4e70 con 0x7fd3fc105600 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1a4fe0 con 0x7fd3fc0fff00 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc1a51a0 con 0x7fd3fc0ff540 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc1956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43636/0 (socket says 172.21.15.139:43636) 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 -- 172.21.15.139:0/2656296619 learned_addr learned my addr 172.21.15.139:0/2656296619 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:03.256 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fa59c700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 0x7fd3fc195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 -- 172.21.15.139:0/2656296619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 msgr2=0x7fd3fc1956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc1956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 -- 172.21.15.139:0/2656296619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 msgr2=0x7fd3fc195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 0x7fd3fc195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 -- 172.21.15.139:0/2656296619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00095f0 con 0x7fd3fc105600 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fad9d700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc1956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3fb59e700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400ada0 tx=0x7fd3f400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400f070 con 0x7fd3fc105600 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc1a5480 con 0x7fd3fc105600 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3f4007b30 con 0x7fd3fc105600 2023-10-08T13:38:03.257 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.253+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4005280 con 0x7fd3fc105600 2023-10-08T13:38:03.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.254+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc1a5910 con 0x7fd3fc105600 2023-10-08T13:38:03.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.255+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc107aa0 con 0x7fd3fc105600 2023-10-08T13:38:03.258 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.256+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd3f400a090 con 0x7fd3fc105600 2023-10-08T13:38:03.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.256+0000 7fd3e3fff700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 0x7fd3e40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.256+0000 7fd3fad9d700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 0x7fd3e40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.256+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd3f40ccfc0 con 0x7fd3fc105600 2023-10-08T13:38:03.259 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.257+0000 7fd3fad9d700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 0x7fd3e40a3ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec005950 tx=0x7fd3ec00a300 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.260 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.260+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd3f4099a70 con 0x7fd3fc105600 2023-10-08T13:38:03.454 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.453+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3fc100c60 con 0x7fd3fc105600 2023-10-08T13:38:03.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.455+0000 7fd3e3fff700 1 -- 172.21.15.139:0/2656296619 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+25203 (secure 0 0 0) 0x7fd3f4099600 con 0x7fd3fc105600 2023-10-08T13:38:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:38:03.456 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":102,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:37:15.548720+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 msgr2=0x7fd3e40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 0x7fd3e40a3ab0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec005950 tx=0x7fd3ec00a300 comp rx=0 tx=0).stop 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 msgr2=0x7fd3fc196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400ada0 tx=0x7fd3f400c330 comp rx=0 tx=0).stop 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 shutdown_connections 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd3e40a15f0 0x7fd3e40a3ab0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3fc105600 0x7fd3fc196150 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3fc0ff540 0x7fd3fc1956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 --2- 172.21.15.139:0/2656296619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3fc0fff00 0x7fd3fc195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 >> 172.21.15.139:0/2656296619 conn(0x7fd3fc0fb030 msgr2=0x7fd3fc0fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:03.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 shutdown_connections 2023-10-08T13:38:03.459 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.457+0000 7fd4011a1700 1 -- 172.21.15.139:0/2656296619 wait complete. 2023-10-08T13:38:03.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T13:21:44.849275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T13:25:31.668638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T13:25:33.033915+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-08T13:25:36.695771+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T13:38:03.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:38:03.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 -- 172.21.15.139:0/2818389570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 msgr2=0x7f04ac0ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 --2- 172.21.15.139:0/2818389570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac0ffac0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f049c009990 tx=0x7f049c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 -- 172.21.15.139:0/2818389570 shutdown_connections 2023-10-08T13:38:03.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 --2- 172.21.15.139:0/2818389570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.598 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 --2- 172.21.15.139:0/2818389570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 0x7f04ac105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 --2- 172.21.15.139:0/2818389570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac0ffac0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 -- 172.21.15.139:0/2818389570 >> 172.21.15.139:0/2818389570 conn(0x7f04ac076790 msgr2=0x7f04ac076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 -- 172.21.15.139:0/2818389570 shutdown_connections 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.595+0000 7f04b0f16700 1 -- 172.21.15.139:0/2818389570 wait complete. 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 Processor -- start 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 -- start start 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 0x7f04ac1a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.599 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac198810 con 0x7f04ac0ff640 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac1a2fd0 con 0x7f04ac105630 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04b0f16700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac1a3110 con 0x7f04ac100000 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43646/0 (socket says 172.21.15.139:43646) 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 -- 172.21.15.139:0/3960293113 learned_addr learned my addr 172.21.15.139:0/3960293113 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04a9d9b700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aad9d700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 0x7f04ac1a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 -- 172.21.15.139:0/3960293113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 msgr2=0x7f04ac197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 -- 172.21.15.139:0/3960293113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 msgr2=0x7f04ac1a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.600 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 0x7f04ac1a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 -- 172.21.15.139:0/3960293113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0095f0 con 0x7f04ac0ff640 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04a9d9b700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f04aa59c700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c920 tx=0x7f04a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.596+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0007b00 con 0x7f04ac0ff640 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.597+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a0004cf0 con 0x7f04ac0ff640 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.597+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac1a33f0 con 0x7f04ac0ff640 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.597+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005520 con 0x7f04ac0ff640 2023-10-08T13:38:03.601 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.597+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac1a3900 con 0x7f04ac0ff640 2023-10-08T13:38:03.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.598+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac107c40 con 0x7f04ac0ff640 2023-10-08T13:38:03.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.599+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f04a0004750 con 0x7f04ac0ff640 2023-10-08T13:38:03.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.599+0000 7f049b7fe700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 0x7f04940a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.599+0000 7f04a9d9b700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 0x7f04940a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.602 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.599+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f04a00cd0e0 con 0x7f04ac0ff640 2023-10-08T13:38:03.603 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.600+0000 7f04a9d9b700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 0x7f04940a3ab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f049c00b5c0 tx=0x7f049c005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.604 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.604+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04a0096070 con 0x7f04ac0ff640 2023-10-08T13:38:03.796 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.795+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04ac067980 con 0x7f04ac0ff640 2023-10-08T13:38:03.797 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.796+0000 7f049b7fe700 1 -- 172.21.15.139:0/3960293113 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04a0099690 con 0x7f04ac0ff640 2023-10-08T13:38:03.797 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 1 2023-10-08T13:38:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 msgr2=0x7f04940a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 0x7f04940a3ab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f049c00b5c0 tx=0x7f049c005fb0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 msgr2=0x7f04ac197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c920 tx=0x7f04a000cce0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.799 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 shutdown_connections 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f04940a15f0 0x7f04940a3ab0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04ac105630 0x7f04ac1a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f04ac0ff640 0x7f04ac197a10 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 --2- 172.21.15.139:0/3960293113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ac100000 0x7f04ac197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 >> 172.21.15.139:0/3960293113 conn(0x7f04ac076790 msgr2=0x7f04ac0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 shutdown_connections 2023-10-08T13:38:03.800 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.798+0000 7f04b0f16700 1 -- 172.21.15.139:0/3960293113 wait complete. 2023-10-08T13:38:03.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 -- 172.21.15.139:0/2741170743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79040696d0 msgr2=0x7f790410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 --2- 172.21.15.139:0/2741170743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79040696d0 0x7f790410d5c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00b0a0 tx=0x7f78fc00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 -- 172.21.15.139:0/2741170743 shutdown_connections 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 --2- 172.21.15.139:0/2741170743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79040696d0 0x7f790410d5c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 --2- 172.21.15.139:0/2741170743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7904106770 0x7f7904106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 --2- 172.21.15.139:0/2741170743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f7904069190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 -- 172.21.15.139:0/2741170743 >> 172.21.15.139:0/2741170743 conn(0x7f7904076790 msgr2=0x7f7904076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:03.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 -- 172.21.15.139:0/2741170743 shutdown_connections 2023-10-08T13:38:03.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.935+0000 7f790919c700 1 -- 172.21.15.139:0/2741170743 wait complete. 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.936+0000 7f790919c700 1 Processor -- start 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.936+0000 7f790919c700 1 -- start start 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.936+0000 7f790919c700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f790419c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.936+0000 7f790919c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 0x7f790419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7904197170 con 0x7f7904106770 2023-10-08T13:38:03.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041972e0 con 0x7f7904068d10 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041974a0 con 0x7f79040696d0 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43662/0 (socket says 172.21.15.139:43662) 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 -- 172.21.15.139:0/544388115 learned_addr learned my addr 172.21.15.139:0/544388115 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790259c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 0x7f790419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f7902d9d700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f790419c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 -- 172.21.15.139:0/544388115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 msgr2=0x7f790419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 0x7f790419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 -- 172.21.15.139:0/544388115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 msgr2=0x7f790419c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f790419c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:03.941 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 -- 172.21.15.139:0/544388115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc009d00 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790259c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 0x7f790419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f7902d9d700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f790419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790359e700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00b070 tx=0x7f78fc0079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00e040 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7904197720 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78fc004c50 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0052a0 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.937+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79041a39d0 con 0x7f7904106770 2023-10-08T13:38:03.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.938+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7904108ca0 con 0x7f7904106770 2023-10-08T13:38:03.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.939+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f78fc01d470 con 0x7f7904106770 2023-10-08T13:38:03.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.940+0000 7f78ebfff700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 0x7f78ec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:03.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.940+0000 7f7902d9d700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 0x7f78ec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:03.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.940+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f78fc0cf1b0 con 0x7f7904106770 2023-10-08T13:38:03.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.940+0000 7f7902d9d700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 0x7f78ec0a3ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005e10 tx=0x7f78f4005d60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:03.944 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:03.943+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78fc0981d0 con 0x7f7904106770 2023-10-08T13:38:04.135 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.134+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7904197fd0 con 0x7f7904106770 2023-10-08T13:38:04.136 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.135+0000 7f78ebfff700 1 -- 172.21.15.139:0/544388115 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78fc09b7f0 con 0x7f7904106770 2023-10-08T13:38:04.136 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:38:04.138 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 msgr2=0x7f78ec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 0x7f78ec0a3ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78f4005e10 tx=0x7f78f4005d60 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 msgr2=0x7f7904196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00b070 tx=0x7f78fc0079e0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 shutdown_connections 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f78ec0a15f0 0x7f78ec0a3ab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7904106770 0x7f7904196b10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7904068d10 0x7f790419c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 --2- 172.21.15.139:0/544388115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79040696d0 0x7f790419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 >> 172.21.15.139:0/544388115 conn(0x7f7904076790 msgr2=0x7f79040fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 shutdown_connections 2023-10-08T13:38:04.140 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.137+0000 7f790919c700 1 -- 172.21.15.139:0/544388115 wait complete. 2023-10-08T13:38:04.150 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:03 smithi139 ceph-mon[99506]: pgmap v627: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:04.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:03 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2656296619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:04.151 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:03 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3960293113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:38:04.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:38:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:03 smithi187 ceph-mon[104336]: pgmap v627: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:03 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2656296619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:04.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:03 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3960293113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:38:04.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- 172.21.15.139:0/830371890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0fffe0 msgr2=0x7f40cc10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 --2- 172.21.15.139:0/830371890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0fffe0 0x7f40cc10c4e0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f40c400b0a0 tx=0x7f40c400b3b0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- 172.21.15.139:0/830371890 shutdown_connections 2023-10-08T13:38:04.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 --2- 172.21.15.139:0/830371890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0fffe0 0x7f40cc10c4e0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.279 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 --2- 172.21.15.139:0/830371890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc1056b0 0x7f40cc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 --2- 172.21.15.139:0/830371890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc0ff620 0x7f40cc0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- 172.21.15.139:0/830371890 >> 172.21.15.139:0/830371890 conn(0x7f40cc076780 msgr2=0x7f40cc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- 172.21.15.139:0/830371890 shutdown_connections 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- 172.21.15.139:0/830371890 wait complete. 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 Processor -- start 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.276+0000 7f40d219e700 1 -- start start 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc0fffe0 0x7f40cc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc1056b0 0x7f40cc1a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc198690 con 0x7f40cc0ff620 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1a2e90 con 0x7f40cc1056b0 2023-10-08T13:38:04.280 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40d219e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc1a2fd0 con 0x7f40cc0fffe0 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43672/0 (socket says 172.21.15.139:43672) 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 -- 172.21.15.139:0/4238999688 learned_addr learned my addr 172.21.15.139:0/4238999688 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cbfff700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc1056b0 0x7f40cc1a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40caffd700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc0fffe0 0x7f40cc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 -- 172.21.15.139:0/4238999688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc0fffe0 msgr2=0x7f40cc197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc0fffe0 0x7f40cc197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 -- 172.21.15.139:0/4238999688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc1056b0 msgr2=0x7f40cc1a2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc1056b0 0x7f40cc1a2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 -- 172.21.15.139:0/4238999688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4009d00 con 0x7f40cc0ff620 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40cb7fe700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c970 tx=0x7f40b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.281 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.277+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004220 con 0x7f40cc0ff620 2023-10-08T13:38:04.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.278+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40b400ce60 con 0x7f40cc0ff620 2023-10-08T13:38:04.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.278+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40cc1a3260 con 0x7f40cc0ff620 2023-10-08T13:38:04.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.278+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4003c00 con 0x7f40cc0ff620 2023-10-08T13:38:04.282 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.278+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40cc1a3770 con 0x7f40cc0ff620 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.278+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40cc107c30 con 0x7f40cc0ff620 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.279+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f40b4003d60 con 0x7f40cc0ff620 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.280+0000 7f40c8ff9700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 0x7f40b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.280+0000 7f40caffd700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 0x7f40b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.280+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f40b40cd490 con 0x7f40cc0ff620 2023-10-08T13:38:04.283 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.281+0000 7f40caffd700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 0x7f40b80a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f40bc005950 tx=0x7f40bc0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.284 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.284+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f40b40963c0 con 0x7f40cc0ff620 2023-10-08T13:38:04.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:03 smithi155 ceph-mon[103467]: pgmap v627: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:04.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:03 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2656296619' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:04.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:03 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3960293113' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T13:38:04.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.477+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40cc067df0 con 0x7f40cc0ff620 2023-10-08T13:38:04.478 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.477+0000 7f40c8ff9700 1 -- 172.21.15.139:0/4238999688 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40b401d0a0 con 0x7f40cc0ff620 2023-10-08T13:38:04.478 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 64 2023-10-08T13:38:04.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 msgr2=0x7f40b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.480 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 0x7f40b80a3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f40bc005950 tx=0x7f40bc0058e0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 msgr2=0x7f40cc1978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c970 tx=0x7f40b400cc80 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 shutdown_connections 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f40b80a15f0 0x7f40b80a3ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40cc1056b0 0x7f40cc1a2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40cc0ff620 0x7f40cc1978d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 --2- 172.21.15.139:0/4238999688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40cc0fffe0 0x7f40cc197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 >> 172.21.15.139:0/4238999688 conn(0x7f40cc076780 msgr2=0x7f40cc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 shutdown_connections 2023-10-08T13:38:04.481 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.479+0000 7f40d219e700 1 -- 172.21.15.139:0/4238999688 wait complete. 2023-10-08T13:38:04.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-08T13:38:04.617 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 -- 172.21.15.139:0/1021673752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 msgr2=0x7fd65c100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 --2- 172.21.15.139:0/1021673752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c100bd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd644009990 tx=0x7fd644009ca0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 -- 172.21.15.139:0/1021673752 shutdown_connections 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 --2- 172.21.15.139:0/1021673752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 0x7fd65c10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 --2- 172.21.15.139:0/1021673752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c106b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 --2- 172.21.15.139:0/1021673752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c100bd0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 -- 172.21.15.139:0/1021673752 >> 172.21.15.139:0/1021673752 conn(0x7fd65c0fc220 msgr2=0x7fd65c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 -- 172.21.15.139:0/1021673752 shutdown_connections 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.616+0000 7fd661381700 1 -- 172.21.15.139:0/1021673752 wait complete. 2023-10-08T13:38:04.618 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 Processor -- start 2023-10-08T13:38:04.619 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 -- start start 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 0x7fd65c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c197080 con 0x7fd65c100750 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1971f0 con 0x7fd65c101110 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd661381700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1973b0 con 0x7fd65c106760 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43686/0 (socket says 172.21.15.139:43686) 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 -- 172.21.15.139:0/100841170 learned_addr learned my addr 172.21.15.139:0/100841170 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:04.621 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65a7fc700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 0x7fd65c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65b7fe700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 -- 172.21.15.139:0/100841170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 msgr2=0x7fd65c196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 -- 172.21.15.139:0/100841170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 msgr2=0x7fd65c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 0x7fd65c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 -- 172.21.15.139:0/100841170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440095f0 con 0x7fd65c100750 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65b7fe700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.617+0000 7fd65affd700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e9a0 tx=0x7fd64c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.618+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c009790 con 0x7fd65c100750 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.618+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c197690 con 0x7fd65c100750 2023-10-08T13:38:04.622 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.618+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd64c00cbd0 con 0x7fd65c100750 2023-10-08T13:38:04.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.618+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c018680 con 0x7fd65c100750 2023-10-08T13:38:04.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.618+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c1a38e0 con 0x7fd65c100750 2023-10-08T13:38:04.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.619+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c108ce0 con 0x7fd65c100750 2023-10-08T13:38:04.623 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.620+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fd64c00cd40 con 0x7fd65c100750 2023-10-08T13:38:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.620+0000 7fd653fff700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 0x7fd6480a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.621+0000 7fd65a7fc700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 0x7fd6480a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.621+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fd64c014070 con 0x7fd65c100750 2023-10-08T13:38:04.624 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.621+0000 7fd65a7fc700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 0x7fd6480a3ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd65c197be0 tx=0x7fd644005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.626 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.625+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd64c052100 con 0x7fd65c100750 2023-10-08T13:38:04.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.817+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd65c0679b0 con 0x7fd65c100750 2023-10-08T13:38:04.819 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.818+0000 7fd653fff700 1 -- 172.21.15.139:0/100841170 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v102) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd64c096640 con 0x7fd65c100750 2023-10-08T13:38:04.819 INFO:teuthology.orchestra.run.smithi139.stdout:pg_num: 32 2023-10-08T13:38:04.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 msgr2=0x7fd6480a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 0x7fd6480a3ab0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd65c197be0 tx=0x7fd644005fd0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 msgr2=0x7fd65c19c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e9a0 tx=0x7fd64c00ecb0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.821 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 shutdown_connections 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fd6480a15f0 0x7fd6480a3ab0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd65c106760 0x7fd65c196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd65c100750 0x7fd65c19c8f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 --2- 172.21.15.139:0/100841170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd65c101110 0x7fd65c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 >> 172.21.15.139:0/100841170 conn(0x7fd65c0fc220 msgr2=0x7fd65c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 shutdown_connections 2023-10-08T13:38:04.822 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.820+0000 7fd661381700 1 -- 172.21.15.139:0/100841170 wait complete. 2023-10-08T13:38:04.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T13:38:04.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- 172.21.15.139:0/2833224148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 msgr2=0x7f811c10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 --2- 172.21.15.139:0/2833224148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c10d590 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f811400b0d0 tx=0x7f811400b3e0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- 172.21.15.139:0/2833224148 shutdown_connections 2023-10-08T13:38:04.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 --2- 172.21.15.139:0/2833224148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c10d590 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 --2- 172.21.15.139:0/2833224148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 0x7f811c0680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 --2- 172.21.15.139:0/2833224148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- 172.21.15.139:0/2833224148 >> 172.21.15.139:0/2833224148 conn(0x7f811c076780 msgr2=0x7f811c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- 172.21.15.139:0/2833224148 shutdown_connections 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- 172.21.15.139:0/2833224148 wait complete. 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 Processor -- start 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.955+0000 7f8122eac700 1 -- start start 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 0x7f811c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c197100 con 0x7f811c105b80 2023-10-08T13:38:04.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c197270 con 0x7f811c067ce0 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c197430 con 0x7f811c1051c0 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43702/0 (socket says 172.21.15.139:43702) 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 -- 172.21.15.139:0/4093533364 learned_addr learned my addr 172.21.15.139:0/4093533364 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f811bfff700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8120c48700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 0x7f811c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 -- 172.21.15.139:0/4093533364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 msgr2=0x7f811c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 -- 172.21.15.139:0/4093533364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 msgr2=0x7f811c19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 0x7f811c19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:04.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 -- 172.21.15.139:0/4093533364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009d00 con 0x7f811c105b80 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f811bfff700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8121449700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8114007fd0 tx=0x7f8114009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400e040 con 0x7f811c105b80 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c1976b0 con 0x7f811c105b80 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8114004c50 con 0x7f811c105b80 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.956+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811401b7c0 con 0x7f811c105b80 2023-10-08T13:38:04.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.957+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c1a3910 con 0x7f811c105b80 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.957+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c108c70 con 0x7f811c105b80 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.959+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8114005050 con 0x7f811c105b80 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.959+0000 7f8119ffb700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 0x7f810c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.959+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f81140cee10 con 0x7f811c105b80 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.959+0000 7f8120c48700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 0x7f810c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:04.962 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.960+0000 7f8120c48700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 0x7f810c0a3ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f811000a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:04.963 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:04.963+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8114097f50 con 0x7f811c105b80 2023-10-08T13:38:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.169+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f811c197f10 con 0x7f811c105b80 2023-10-08T13:38:05.170 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.169+0000 7f8119ffb700 1 -- 172.21.15.139:0/4093533364 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v102) v1 ==== 81+0+900 (secure 0 0 0) 0x7f8114020020 con 0x7f811c105b80 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/542053995 2023-10-09T13:20:08.525995+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4107466857 2023-10-09T13:20:08.525995+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/2305265719 2023-10-09T13:20:08.525995+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1347436644 2023-10-09T13:19:05.548203+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/368295246 2023-10-09T13:18:43.030956+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1490471359 2023-10-09T13:20:08.525995+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3474112198 2023-10-09T13:19:05.548203+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6800/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:38:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/1278886955 2023-10-09T13:19:05.548203+0000 2023-10-08T13:38:05.172 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3196233301 2023-10-09T13:18:43.030956+0000 2023-10-08T13:38:05.172 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:6801/1721493169 2023-10-09T13:19:05.548203+0000 2023-10-08T13:38:05.172 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/4197784005 2023-10-09T13:18:43.030956+0000 2023-10-08T13:38:05.172 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139:0/3589198312 2023-10-09T13:18:43.030956+0000 2023-10-08T13:38:05.172 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 msgr2=0x7f810c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 0x7f810c0a3ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f811000a560 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 msgr2=0x7f811c196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8114007fd0 tx=0x7f8114009570 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 shutdown_connections 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f810c0a15f0 0x7f810c0a3ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f811c105b80 0x7f811c196aa0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f811c067ce0 0x7f811c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 --2- 172.21.15.139:0/4093533364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c1051c0 0x7f811c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 >> 172.21.15.139:0/4093533364 conn(0x7f811c076780 msgr2=0x7f811c0fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 shutdown_connections 2023-10-08T13:38:05.173 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.171+0000 7f8122eac700 1 -- 172.21.15.139:0/4093533364 wait complete. 2023-10-08T13:38:05.174 INFO:teuthology.orchestra.run.smithi139.stderr:listed 15 entries 2023-10-08T13:38:05.183 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:04 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/544388115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.183 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:04 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4238999688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.184 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:04 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/100841170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.184 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T13:38:05.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T13:38:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:04 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/544388115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:04 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4238999688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:04 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/100841170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.249 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:38:05.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.249 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T13:38:05.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.266 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-10-08T13:38:05.323 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T13:38:05.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T13:38:05.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:04 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/544388115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:04 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4238999688' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:04 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/100841170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2023-10-08T13:38:05.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2023-10-08T13:38:05.494 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T13:38:05.494 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2023-10-08T13:38:05.495 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:38:05.513 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284220k,nr_inodes=4071055,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3295 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/diff,workdir=/var/lib/containers/storage/overlay/9cefc0d707cf12c0cf639f524d70f2eb58cebe1bcf1a59f502d85af6688d8a96/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/diff,workdir=/var/lib/containers/storage/overlay/e618f4c29222730f11bf9ee37e12db93d52ff64906ec75d2f8cc2a9c2cc9aa21/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/diff,workdir=/var/lib/containers/storage/overlay/5ec2c475447b5a0b49d27c672aa75f084154fe5100f7012451d5547d855b8f9f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/diff,workdir=/var/lib/containers/storage/overlay/f71d0494deb5109c9a2ba6f15e121c38f48ff2d4da76694831ba82f56cfb91db/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/diff,workdir=/var/lib/containers/storage/overlay/2f0d3c61d4db18144b0c8df25ca17c9a318e58148655025e3a955433426d32b7/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/diff,workdir=/var/lib/containers/storage/overlay/531aa67e38625c4a9b858b13813587e372813d025ca6771c7624c1ca3e6520b7/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/diff,workdir=/var/lib/containers/storage/overlay/6411c7f455940e7e55d173407bb37a486984f82e447eaa462c5718960cb3b242/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/diff,workdir=/var/lib/containers/storage/overlay/377d565e0e785ead5261bbb62a3a5dd014890653cb766a8527acb2ce5e1468e7/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/diff,workdir=/var/lib/containers/storage/overlay/9a9f7aa21a2818ed98324db0b6a316f4c198d5ea3b8521eccf7a37b4317dac37/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/L5KYIOLDIBODFZHGT55SMG5LM7:/var/lib/containers/storage/overlay/l/E6B2FYWAWG4UCHBCKMZ6JIWHJU,upperdir=/var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/diff,workdir=/var/lib/containers/storage/overlay/1157b5a2b6996a6c9b811e5191e52d990dafa3ff2d1f048e7e151e84a0ef21e1/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-10-08T13:38:05.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.513 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2023-10-08T13:38:05.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:38:05.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2023-10-08T13:38:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2023-10-08T13:38:05.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:38:05.641 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-08T13:38:05.653 INFO:tasks.cephadm:Teardown begin 2023-10-08T13:38:05.653 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T13:38:05.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 -- 172.21.15.139:0/53027731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 msgr2=0x7fa24c10a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 --2- 172.21.15.139:0/53027731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c10a600 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009990 tx=0x7fa23c009ca0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 -- 172.21.15.139:0/53027731 shutdown_connections 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 --2- 172.21.15.139:0/53027731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c10ac20 0x7fa24c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 --2- 172.21.15.139:0/53027731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c101800 0x7fa24c101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.805 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 --2- 172.21.15.139:0/53027731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c10a600 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 -- 172.21.15.139:0/53027731 >> 172.21.15.139:0/53027731 conn(0x7fa24c0fb060 msgr2=0x7fa24c0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:05.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 -- 172.21.15.139:0/53027731 shutdown_connections 2023-10-08T13:38:05.806 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.803+0000 7fa250bc8700 1 -- 172.21.15.139:0/53027731 wait complete. 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 Processor -- start 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 -- start start 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c101800 0x7fa24c0ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 0x7fa24c0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:05.808 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1a4e90 con 0x7fa24c102120 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1a5000 con 0x7fa24c10ac20 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.804+0000 7fa250bc8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c1a51c0 con 0x7fa24c101800 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43712/0 (socket says 172.21.15.139:43712) 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 -- 172.21.15.139:0/550434233 learned_addr learned my addr 172.21.15.139:0/550434233 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa24ad9d700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 0x7fa24c0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa24a59c700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c101800 0x7fa24c0ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 -- 172.21.15.139:0/550434233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c101800 msgr2=0x7fa24c0ff450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c101800 0x7fa24c0ff450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 -- 172.21.15.139:0/550434233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 msgr2=0x7fa24c0ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:05.809 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 0x7fa24c0ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 -- 172.21.15.139:0/550434233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0095f0 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa24ad9d700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 0x7fa24c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa249d9b700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c00f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c01d070 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c1a5440 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa23c00fce0 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c017760 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.805+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c1a5940 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.806+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c105cf0 con 0x7fa24c102120 2023-10-08T13:38:05.810 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.807+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fa23c0178c0 con 0x7fa24c102120 2023-10-08T13:38:05.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.808+0000 7fa23b7fe700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 0x7fa2340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:05.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.808+0000 7fa24a59c700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 0x7fa2340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:05.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.808+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fa23c0cee00 con 0x7fa24c102120 2023-10-08T13:38:05.811 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.808+0000 7fa24a59c700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 0x7fa2340a3ab0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa240005ea0 tx=0x7fa240005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:05.812 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:05.813+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa23c097e20 con 0x7fa24c102120 2023-10-08T13:38:06.048 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.047+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa24c100930 con 0x7fa24c102120 2023-10-08T13:38:06.049 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.048+0000 7fa23b7fe700 1 -- 172.21.15.139:0/550434233 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+11393 (secure 0 0 0) 0x7fa23c09b440 con 0x7fa24c102120 2023-10-08T13:38:06.049 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:38:06.049 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":66,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:37:14.942322+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_26153":{"gid":26153,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3686588084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3686588084},{"type":"v1","addr":"172.21.15.155:6835","nonce":3686588084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:38:06.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 msgr2=0x7fa2340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.051 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 0x7fa2340a3ab0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa240005ea0 tx=0x7fa240005e30 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 msgr2=0x7fa24c0ff990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c00f7b0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 shutdown_connections 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fa2340a15f0 0x7fa2340a3ab0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa24c10ac20 0x7fa24c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa24c101800 0x7fa24c0ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 --2- 172.21.15.139:0/550434233 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa24c102120 0x7fa24c0ff990 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 >> 172.21.15.139:0/550434233 conn(0x7fa24c0fb060 msgr2=0x7fa24c0fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.052 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 shutdown_connections 2023-10-08T13:38:06.053 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.050+0000 7fa250bc8700 1 -- 172.21.15.139:0/550434233 wait complete. 2023-10-08T13:38:06.053 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 66 2023-10-08T13:38:06.063 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:05 smithi139 ceph-mon[99506]: pgmap v628: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:06.063 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:05 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/4093533364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:38:06.064 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- 172.21.15.139:0/2543240615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 msgr2=0x7f251c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 --2- 172.21.15.139:0/2543240615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c1059e0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f25100099c0 tx=0x7f2510009cd0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- 172.21.15.139:0/2543240615 shutdown_connections 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 --2- 172.21.15.139:0/2543240615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0fff00 0x7f251c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 --2- 172.21.15.139:0/2543240615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c1059e0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 --2- 172.21.15.139:0/2543240615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0ff540 0x7f251c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- 172.21.15.139:0/2543240615 >> 172.21.15.139:0/2543240615 conn(0x7f251c0fb030 msgr2=0x7f251c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.188 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- 172.21.15.139:0/2543240615 shutdown_connections 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- 172.21.15.139:0/2543240615 wait complete. 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 Processor -- start 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.185+0000 7f2521dbb700 1 -- start start 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0ff540 0x7f251c1011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0fff00 0x7f251c1016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1a4d70 con 0x7f251c105600 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1a4ee0 con 0x7f251c0fff00 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2521dbb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c1a50a0 con 0x7f251c0ff540 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.189 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43728/0 (socket says 172.21.15.139:43728) 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 -- 172.21.15.139:0/1729494884 learned_addr learned my addr 172.21.15.139:0/1729494884 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251b7fe700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0ff540 0x7f251c1011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251affd700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0fff00 0x7f251c1016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 -- 172.21.15.139:0/1729494884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0ff540 msgr2=0x7f251c1011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0ff540 0x7f251c1011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 -- 172.21.15.139:0/1729494884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0fff00 msgr2=0x7f251c1016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0fff00 0x7f251c1016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 -- 172.21.15.139:0/1729494884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100095f0 con 0x7f251c105600 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f251bfff700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f251400ada0 tx=0x7f251400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251400f070 con 0x7f251c105600 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2514007b30 con 0x7f251c105600 2023-10-08T13:38:06.190 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.186+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140053e0 con 0x7f251c105600 2023-10-08T13:38:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.187+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c1a5380 con 0x7f251c105600 2023-10-08T13:38:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.187+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c1a5840 con 0x7f251c105600 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.188+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c100c60 con 0x7f251c105600 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.189+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f251400c980 con 0x7f251c105600 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.189+0000 7f2518ff9700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 0x7f25040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.189+0000 7f251b7fe700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 0x7f25040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.189+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7f25140ccdb0 con 0x7f251c105600 2023-10-08T13:38:06.192 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.190+0000 7f251b7fe700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 0x7f25040a3ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.194 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.193+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2514095dd0 con 0x7f251c105600 2023-10-08T13:38:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:05 smithi187 ceph-mon[104336]: pgmap v628: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:06.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:05 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/4093533364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:38:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:05 smithi155 ceph-mon[103467]: pgmap v628: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T13:38:06.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:05 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/4093533364' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T13:38:06.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.433+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f251c067450 con 0x7f251c105600 2023-10-08T13:38:06.434 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.434+0000 7f2518ff9700 1 -- 172.21.15.139:0/1729494884 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+11393 (secure 0 0 0) 0x7f251401a310 con 0x7f251c105600 2023-10-08T13:38:06.434 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:38:06.435 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14736,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2027109215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2027109215},{"type":"v1","addr":"172.21.15.187:6833","nonce":2027109215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/516841200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":516841200},{"type":"v1","addr":"172.21.15.139:6835","nonce":516841200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":66,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T13:25:33.853946+0000","modified":"2023-10-08T13:37:14.942322+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24628,"mds_1":24607,"mds_2":24599,"mds_3":24595,"mds_4":24566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14772":{"gid":14772,"name":"d","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2085954073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2085954073},{"type":"v1","addr":"172.21.15.139:6837","nonce":2085954073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14826":{"gid":14826,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6839/4169446012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":4169446012},{"type":"v1","addr":"172.21.15.139:6839","nonce":4169446012}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14838":{"gid":14838,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6841/3823660758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6840","nonce":3823660758},{"type":"v1","addr":"172.21.15.139:6841","nonce":3823660758}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24518":{"gid":24518,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3719268095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3719268095},{"type":"v1","addr":"172.21.15.155:6833","nonce":3719268095}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24566":{"gid":24566,"name":"h","rank":4,"incarnation":24,"state":"up:active","state_seq":61,"addr":"172.21.15.155:6837/4218841185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":4218841185},{"type":"v1","addr":"172.21.15.155:6837","nonce":4218841185}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24595":{"gid":24595,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6835/3167078820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3167078820},{"type":"v1","addr":"172.21.15.187:6835","nonce":3167078820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24599":{"gid":24599,"name":"b","rank":2,"incarnation":20,"state":"up:active","state_seq":58,"addr":"172.21.15.155:6839/4212065890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":4212065890},{"type":"v1","addr":"172.21.15.155:6839","nonce":4212065890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"c","rank":1,"incarnation":18,"state":"up:active","state_seq":60,"addr":"172.21.15.187:6837/3566030950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":3566030950},{"type":"v1","addr":"172.21.15.187:6837","nonce":3566030950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24628":{"gid":24628,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.187:6839/3909111900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":3909111900},{"type":"v1","addr":"172.21.15.187:6839","nonce":3909111900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_26153":{"gid":26153,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3686588084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3686588084},{"type":"v1","addr":"172.21.15.155:6835","nonce":3686588084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 msgr2=0x7f25040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 0x7f25040a3ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510005c60 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 msgr2=0x7f251c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f251400ada0 tx=0x7f251400c330 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 shutdown_connections 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f25040a15f0 0x7f25040a3ab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f251c105600 0x7f251c101c30 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f251c0ff540 0x7f251c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 --2- 172.21.15.139:0/1729494884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0fff00 0x7f251c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.436+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 >> 172.21.15.139:0/1729494884 conn(0x7f251c0fb030 msgr2=0x7f251c0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.437 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.437+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 shutdown_connections 2023-10-08T13:38:06.438 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.437+0000 7f2521dbb700 1 -- 172.21.15.139:0/1729494884 wait complete. 2023-10-08T13:38:06.438 INFO:teuthology.orchestra.run.smithi139.stderr:dumped fsmap epoch 66 2023-10-08T13:38:06.449 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:38:06.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 -- 172.21.15.139:0/3357610819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 msgr2=0x7fb71410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 --2- 172.21.15.139:0/3357610819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb71410d0d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b0a0 tx=0x7fb70c00b3b0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 -- 172.21.15.139:0/3357610819 shutdown_connections 2023-10-08T13:38:06.577 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 --2- 172.21.15.139:0/3357610819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb71410d0d0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 --2- 172.21.15.139:0/3357610819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141018b0 0x7fb714101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 --2- 172.21.15.139:0/3357610819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141021d0 0x7fb71410a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 -- 172.21.15.139:0/3357610819 >> 172.21.15.139:0/3357610819 conn(0x7fb7140fb030 msgr2=0x7fb7140fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 -- 172.21.15.139:0/3357610819 shutdown_connections 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 -- 172.21.15.139:0/3357610819 wait complete. 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.575+0000 7fb71988a700 1 Processor -- start 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 -- start start 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 0x7fb71419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141021d0 0x7fb71419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141970b0 con 0x7fb71410ac80 2023-10-08T13:38:06.578 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714197220 con 0x7fb7141021d0 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb71988a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141973e0 con 0x7fb7141018b0 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43742/0 (socket says 172.21.15.139:43742) 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 -- 172.21.15.139:0/2496218807 learned_addr learned my addr 172.21.15.139:0/2496218807 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7127fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141021d0 0x7fb71419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb712ffd700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 0x7fb71419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 -- 172.21.15.139:0/2496218807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 msgr2=0x7fb71419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 0x7fb71419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 -- 172.21.15.139:0/2496218807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141021d0 msgr2=0x7fb71419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.579 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141021d0 0x7fb71419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 -- 172.21.15.139:0/2496218807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c009d00 con 0x7fb71410ac80 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb712ffd700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 0x7fb71419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb7137fe700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b070 tx=0x7fb70c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.576+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00e040 con 0x7fb71410ac80 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.577+0000 7fb71988a700 1 -- 172.21.15.139:0/2496218807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb714197660 con 0x7fb71410ac80 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.577+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb70c009440 con 0x7fb71410ac80 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.577+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c01b450 con 0x7fb71410ac80 2023-10-08T13:38:06.580 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.577+0000 7fb71988a700 1 -- 172.21.15.139:0/2496218807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7141a38c0 con 0x7fb71410ac80 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.578+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f40052f0 con 0x7fb71410ac80 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.578+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb70c01d480 con 0x7fb71410ac80 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.579+0000 7fb718888700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 0x7fb6fc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.579+0000 7fb712ffd700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 0x7fb6fc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.579+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 9439+0+0 (secure 0 0 0) 0x7fb70c0cea50 con 0x7fb71410ac80 2023-10-08T13:38:06.581 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.579+0000 7fb712ffd700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 0x7fb6fc0a3ab0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb708005950 tx=0x7fb7080058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.583 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.583+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb70c097a70 con 0x7fb71410ac80 2023-10-08T13:38:06.778 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.778+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6f4005870 con 0x7fb71410ac80 2023-10-08T13:38:06.779 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.779+0000 7fb718888700 1 -- 172.21.15.139:0/2496218807 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+25203 (secure 0 0 0) 0x7fb70c09b090 con 0x7fb71410ac80 2023-10-08T13:38:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-08T13:38:06.780 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":102,"fsid":"0585722a-65dd-11ee-8db5-212e2dc638e7","created":"2023-10-08T13:18:09.442366+0000","modified":"2023-10-08T13:37:15.548720+0000","last_up_change":"2023-10-08T13:24:52.494545+0000","last_in_change":"2023-10-08T13:24:35.080585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T13:21:44.849275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T13:25:31.668638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T13:25:33.033915+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-08T13:25:36.695771+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7d1e38b5-74c5-449b-96f0-3619599c9602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6803","nonce":927870802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6805","nonce":927870802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6809","nonce":927870802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":927870802},{"type":"v1","addr":"172.21.15.139:6807","nonce":927870802}]},"public_addr":"172.21.15.139:6803/927870802","cluster_addr":"172.21.15.139:6805/927870802","heartbeat_back_addr":"172.21.15.139:6809/927870802","heartbeat_front_addr":"172.21.15.139:6807/927870802","state":["exists","up"]},{"osd":1,"uuid":"a8d6fd01-729c-4b3b-9073-1df5819593c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6801","nonce":765538581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6803","nonce":765538581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6807","nonce":765538581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":765538581},{"type":"v1","addr":"172.21.15.155:6805","nonce":765538581}]},"public_addr":"172.21.15.155:6801/765538581","cluster_addr":"172.21.15.155:6803/765538581","heartbeat_back_addr":"172.21.15.155:6807/765538581","heartbeat_front_addr":"172.21.15.155:6805/765538581","state":["exists","up"]},{"osd":2,"uuid":"59c35f9f-67d3-45b6-9bf0-c13e6c593ddd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6801","nonce":3332520457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6803","nonce":3332520457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6807","nonce":3332520457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":3332520457},{"type":"v1","addr":"172.21.15.187:6805","nonce":3332520457}]},"public_addr":"172.21.15.187:6801/3332520457","cluster_addr":"172.21.15.187:6803/3332520457","heartbeat_back_addr":"172.21.15.187:6807/3332520457","heartbeat_front_addr":"172.21.15.187:6805/3332520457","state":["exists","up"]},{"osd":3,"uuid":"6c4fd3e0-7072-4fc5-8b9d-48030d0a877a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6811","nonce":254276736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6813","nonce":254276736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6817","nonce":254276736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":254276736},{"type":"v1","addr":"172.21.15.139:6815","nonce":254276736}]},"public_addr":"172.21.15.139:6811/254276736","cluster_addr":"172.21.15.139:6813/254276736","heartbeat_back_addr":"172.21.15.139:6817/254276736","heartbeat_front_addr":"172.21.15.139:6815/254276736","state":["exists","up"]},{"osd":4,"uuid":"b56dde7b-4858-481a-bbcb-1d3d243a368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6809","nonce":3389759441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6811","nonce":3389759441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6815","nonce":3389759441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3389759441},{"type":"v1","addr":"172.21.15.155:6813","nonce":3389759441}]},"public_addr":"172.21.15.155:6809/3389759441","cluster_addr":"172.21.15.155:6811/3389759441","heartbeat_back_addr":"172.21.15.155:6815/3389759441","heartbeat_front_addr":"172.21.15.155:6813/3389759441","state":["exists","up"]},{"osd":5,"uuid":"a99b3b48-6c21-402e-9030-59a51a671f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6809","nonce":247670329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6811","nonce":247670329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6815","nonce":247670329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":247670329},{"type":"v1","addr":"172.21.15.187:6813","nonce":247670329}]},"public_addr":"172.21.15.187:6809/247670329","cluster_addr":"172.21.15.187:6811/247670329","heartbeat_back_addr":"172.21.15.187:6815/247670329","heartbeat_front_addr":"172.21.15.187:6813/247670329","state":["exists","up"]},{"osd":6,"uuid":"4b0ca25a-6499-4462-9664-e1c0cb8a12b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6819","nonce":3559626556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6821","nonce":3559626556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6825","nonce":3559626556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3559626556},{"type":"v1","addr":"172.21.15.139:6823","nonce":3559626556}]},"public_addr":"172.21.15.139:6819/3559626556","cluster_addr":"172.21.15.139:6821/3559626556","heartbeat_back_addr":"172.21.15.139:6825/3559626556","heartbeat_front_addr":"172.21.15.139:6823/3559626556","state":["exists","up"]},{"osd":7,"uuid":"a94a0e56-610f-4aae-a73e-80a5f7b7dbe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6817","nonce":1735491118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6819","nonce":1735491118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6823","nonce":1735491118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1735491118},{"type":"v1","addr":"172.21.15.155:6821","nonce":1735491118}]},"public_addr":"172.21.15.155:6817/1735491118","cluster_addr":"172.21.15.155:6819/1735491118","heartbeat_back_addr":"172.21.15.155:6823/1735491118","heartbeat_front_addr":"172.21.15.155:6821/1735491118","state":["exists","up"]},{"osd":8,"uuid":"a53a4eb0-33db-4e79-9640-45d1717efe54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6817","nonce":3076471964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6819","nonce":3076471964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6823","nonce":3076471964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":3076471964},{"type":"v1","addr":"172.21.15.187:6821","nonce":3076471964}]},"public_addr":"172.21.15.187:6817/3076471964","cluster_addr":"172.21.15.187:6819/3076471964","heartbeat_back_addr":"172.21.15.187:6823/3076471964","heartbeat_front_addr":"172.21.15.187:6821/3076471964","state":["exists","up"]},{"osd":9,"uuid":"a9b3fbe3-9a87-4a39-b045-3d243900ce93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6827","nonce":317853684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6829","nonce":317853684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6833","nonce":317853684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":317853684},{"type":"v1","addr":"172.21.15.139:6831","nonce":317853684}]},"public_addr":"172.21.15.139:6827/317853684","cluster_addr":"172.21.15.139:6829/317853684","heartbeat_back_addr":"172.21.15.139:6833/317853684","heartbeat_front_addr":"172.21.15.139:6831/317853684","state":["exists","up"]},{"osd":10,"uuid":"6c2c1528-8a2f-4b3a-a1ae-2eb754fe64d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6825","nonce":1252167532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6827","nonce":1252167532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6831","nonce":1252167532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":1252167532},{"type":"v1","addr":"172.21.15.155:6829","nonce":1252167532}]},"public_addr":"172.21.15.155:6825/1252167532","cluster_addr":"172.21.15.155:6827/1252167532","heartbeat_back_addr":"172.21.15.155:6831/1252167532","heartbeat_front_addr":"172.21.15.155:6829/1252167532","state":["exists","up"]},{"osd":11,"uuid":"ec8bf58f-7d6f-4a86-b95c-8b104705fcaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6825","nonce":599992854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6827","nonce":599992854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6831","nonce":599992854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":599992854},{"type":"v1","addr":"172.21.15.187:6829","nonce":599992854}]},"public_addr":"172.21.15.187:6825/599992854","cluster_addr":"172.21.15.187:6827/599992854","heartbeat_back_addr":"172.21.15.187:6831/599992854","heartbeat_front_addr":"172.21.15.187:6829/599992854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:00.770305+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:21.533265+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:21:42.004058+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:03.457011+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:24.129975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:22:44.921272+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:05.791239+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:27.139626+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:23:48.264151+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:09.828830+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:30.328204+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T13:24:50.790993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":1}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.139:0/542053995":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/4107466857":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6801/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:6800/2305265719":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/1347436644":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6801/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6800/368295246":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/1490471359":"2023-10-09T13:20:08.525995+0000","172.21.15.139:0/3474112198":"2023-10-09T13:19:05.548203+0000","172.21.15.139:6800/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/1278886955":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/3196233301":"2023-10-09T13:18:43.030956+0000","172.21.15.139:6801/1721493169":"2023-10-09T13:19:05.548203+0000","172.21.15.139:0/4197784005":"2023-10-09T13:18:43.030956+0000","172.21.15.139:0/3589198312":"2023-10-09T13:18:43.030956+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 msgr2=0x7fb6fc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 0x7fb6fc0a3ab0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb708005950 tx=0x7fb7080058e0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 msgr2=0x7fb714196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b070 tx=0x7fb70c007870 comp rx=0 tx=0).stop 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 shutdown_connections 2023-10-08T13:38:06.782 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb6fc0a15f0 0x7fb6fc0a3ab0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb71410ac80 0x7fb714196a50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7141018b0 0x7fb71419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 --2- 172.21.15.139:0/2496218807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7141021d0 0x7fb71419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 >> 172.21.15.139:0/2496218807 conn(0x7fb7140fb030 msgr2=0x7fb7140fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 shutdown_connections 2023-10-08T13:38:06.783 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.782+0000 7fb6fa7fc700 1 -- 172.21.15.139:0/2496218807 wait complete. 2023-10-08T13:38:06.795 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T13:38:06.953 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 -- 172.21.15.139:0/3629416925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda50107d30 msgr2=0x7fda501081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 --2- 172.21.15.139:0/3629416925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda50107d30 0x7fda501081b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda4800b0a0 tx=0x7fda4800b3b0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 -- 172.21.15.139:0/3629416925 shutdown_connections 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 --2- 172.21.15.139:0/3629416925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50119fd0 0x7fda5011c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 --2- 172.21.15.139:0/3629416925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda5010ef80 0x7fda501077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 --2- 172.21.15.139:0/3629416925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda50107d30 0x7fda501081b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.954 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.953+0000 7fda57f23700 1 -- 172.21.15.139:0/3629416925 >> 172.21.15.139:0/3629416925 conn(0x7fda5006b830 msgr2=0x7fda5006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:06.955 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.955+0000 7fda57f23700 1 -- 172.21.15.139:0/3629416925 shutdown_connections 2023-10-08T13:38:06.956 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.956+0000 7fda57f23700 1 -- 172.21.15.139:0/3629416925 wait complete. 2023-10-08T13:38:06.957 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.957+0000 7fda57f23700 1 Processor -- start 2023-10-08T13:38:06.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 -- start start 2023-10-08T13:38:06.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 0x7fda50118350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda5010ef80 0x7fda501188d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.958 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 0x7fda501114f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda50111cc0 con 0x7fda50107d30 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda50111e30 con 0x7fda5010ef80 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda57f23700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda50111ff0 con 0x7fda50119fd0 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda55cbf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 0x7fda50118350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda55cbf700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 0x7fda50118350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43750/0 (socket says 172.21.15.139:43750) 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda55cbf700 1 -- 172.21.15.139:0/3614372184 learned_addr learned my addr 172.21.15.139:0/3614372184 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda564c0700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 0x7fda501114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.959 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.958+0000 7fda554be700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda5010ef80 0x7fda501188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 -- 172.21.15.139:0/3614372184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda5010ef80 msgr2=0x7fda501188d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda5010ef80 0x7fda501188d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 -- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 msgr2=0x7fda50118350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 0x7fda50118350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 -- 172.21.15.139:0/3614372184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009d00 con 0x7fda50119fd0 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.959+0000 7fda564c0700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 0x7fda501114f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda4000b3c0 tx=0x7fda4000b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.960+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40011830 con 0x7fda50119fd0 2023-10-08T13:38:06.960 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.960+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda4000be80 con 0x7fda50119fd0 2023-10-08T13:38:06.961 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.960+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40010de0 con 0x7fda50119fd0 2023-10-08T13:38:06.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.964+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda501122d0 con 0x7fda50119fd0 2023-10-08T13:38:06.964 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.964+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda501161e0 con 0x7fda50119fd0 2023-10-08T13:38:06.968 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.968+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5006ccb0 con 0x7fda50119fd0 2023-10-08T13:38:06.970 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.969+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fda40010480 con 0x7fda50119fd0 2023-10-08T13:38:06.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.970+0000 7fda46ffd700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 0x7fda3c0a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:06.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.970+0000 7fda55cbf700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 0x7fda3c0a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:06.971 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.970+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 9527+0+0 (secure 0 0 0) 0x7fda400ccce0 con 0x7fda50119fd0 2023-10-08T13:38:06.974 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.971+0000 7fda55cbf700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 0x7fda3c0a3cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d20 tx=0x7fda4c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:06.978 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:06.978+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fda40095cc0 con 0x7fda50119fd0 2023-10-08T13:38:07.190 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/550434233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1729494884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.191 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:06 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2496218807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/550434233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1729494884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:06 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2496218807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/550434233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1729494884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:06 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2496218807' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T13:38:07.421 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.421+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fda50112900 con 0x7fda50119fd0 2023-10-08T13:38:07.460 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.460+0000 7fda46ffd700 1 -- 172.21.15.139:0/3614372184 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7fda40015090 con 0x7fda50119fd0 2023-10-08T13:38:07.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.464+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 msgr2=0x7fda3c0a3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:07.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.464+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 0x7fda3c0a3cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d20 tx=0x7fda4c009260 comp rx=0 tx=0).stop 2023-10-08T13:38:07.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.464+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 msgr2=0x7fda501114f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:07.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.464+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 0x7fda501114f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda4000b3c0 tx=0x7fda4000b6d0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.464 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 shutdown_connections 2023-10-08T13:38:07.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fda3c0a1800 0x7fda3c0a3cc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda50119fd0 0x7fda501114f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda50107d30 0x7fda50118350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 --2- 172.21.15.139:0/3614372184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda5010ef80 0x7fda501188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.465 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.465+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 >> 172.21.15.139:0/3614372184 conn(0x7fda5006b830 msgr2=0x7fda5006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:07.471 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.468+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 shutdown_connections 2023-10-08T13:38:07.472 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.469+0000 7fda57f23700 1 -- 172.21.15.139:0/3614372184 wait complete. 2023-10-08T13:38:07.506 INFO:teuthology.orchestra.run.smithi139.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T13:38:07.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T13:38:07.689 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: starting mds.g at 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:38:07.423+0000 7f404a8d3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.690 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: starting mds.a at 2023-10-08T13:38:07.691 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.692 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.692 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: starting mds.d at 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 -- 172.21.15.139:0/201065077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 msgr2=0x7fb308107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 --2- 172.21.15.139:0/201065077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb308107e40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8007510 tx=0x7fb2f8007820 comp rx=0 tx=0).stop 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 -- 172.21.15.139:0/201065077 shutdown_connections 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 --2- 172.21.15.139:0/201065077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30810c500 0x7fb308114080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 --2- 172.21.15.139:0/201065077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb308107e40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 --2- 172.21.15.139:0/201065077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb308108410 0x7fb30810bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 -- 172.21.15.139:0/201065077 >> 172.21.15.139:0/201065077 conn(0x7fb30806bc80 msgr2=0x7fb30806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:07.770 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.768+0000 7fb30ea71700 1 -- 172.21.15.139:0/201065077 shutdown_connections 2023-10-08T13:38:07.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.769+0000 7fb30ea71700 1 -- 172.21.15.139:0/201065077 wait complete. 2023-10-08T13:38:07.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.769+0000 7fb30ea71700 1 Processor -- start 2023-10-08T13:38:07.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 -- start start 2023-10-08T13:38:07.771 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30810c500 0x7fb3081a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30819d170 0x7fb30819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30819ddf0 con 0x7fb308107a60 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30819df60 con 0x7fb30810c500 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30ea71700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081a1be0 con 0x7fb30819d170 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43792/0 (socket says 172.21.15.139:43792) 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 -- 172.21.15.139:0/1669762010 learned_addr learned my addr 172.21.15.139:0/1669762010 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 -- 172.21.15.139:0/1669762010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30819d170 msgr2=0x7fb30819d620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30819d170 0x7fb30819d620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.772 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 -- 172.21.15.139:0/1669762010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30810c500 msgr2=0x7fb3081a45d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30810c500 0x7fb3081a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.770+0000 7fb30c80d700 1 -- 172.21.15.139:0/1669762010 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80071c0 con 0x7fb308107a60 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.771+0000 7fb30c80d700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b370 tx=0x7fb2f8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.773+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800e040 con 0x7fb308107a60 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.773+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2f8003c70 con 0x7fb308107a60 2023-10-08T13:38:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.773+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800ba10 con 0x7fb308107a60 2023-10-08T13:38:07.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.774+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3081a1e60 con 0x7fb308107a60 2023-10-08T13:38:07.774 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.774+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3081a2290 con 0x7fb308107a60 2023-10-08T13:38:07.786 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.777+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7fb2f800bb70 con 0x7fb308107a60 2023-10-08T13:38:07.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.777+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308108a10 con 0x7fb308107a60 2023-10-08T13:38:07.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.778+0000 7fb305ffb700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 0x7fb2f40a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:07.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.778+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9869+0+0 (secure 0 0 0) 0x7fb2f80cd970 con 0x7fb308107a60 2023-10-08T13:38:07.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.778+0000 7fb307fff700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 0x7fb2f40a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:07.787 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.779+0000 7fb307fff700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 0x7fb2f40a3c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb30819e850 tx=0x7fb2f0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:07.791 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:07.791+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb2f80967e0 con 0x7fb308107a60 2023-10-08T13:38:07.847 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.848 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.848 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: starting mds.h at 2023-10-08T13:38:07.848 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.848 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.848 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: starting mds.b at 2023-10-08T13:38:07.849 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.849 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.849 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: starting mds.k at 2023-10-08T13:38:07.850 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.850 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.850 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: starting mds.e at 2023-10-08T13:38:07.895 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.895 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.895 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: starting mds.f at 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: pgmap v629: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/3614372184' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:38:07.898 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mon[104336]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-mds[142055]: -- 172.21.15.187:0/1111969447 <== mon.0 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b2962411e0 con 0x55b296217000 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: starting mds.c at 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: ignoring --setuser ceph since I am not root 2023-10-08T13:38:07.899 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: ignoring --setgroup ceph since I am not root 2023-10-08T13:38:07.900 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:38:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: starting mds.i at 2023-10-08T13:38:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: pgmap v629: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:38:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:38:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/3614372184' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:08.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:38:08.188 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:07 smithi139 ceph-mon[99506]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:38:08.247 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.244+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb308067530 con 0x7fb308107a60 2023-10-08T13:38:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: pgmap v629: 129 pgs: 129 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T13:38:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T13:38:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/3614372184' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-10-08T13:38:08.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-10-08T13:38:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:38:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2023-10-08T13:38:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-10-08T13:38:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T13:38:08.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:07 smithi155 ceph-mon[103467]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-10-08T13:38:08.440 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.440+0000 7fb305ffb700 1 -- 172.21.15.139:0/1669762010 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2f8099e00 con 0x7fb308107a60 2023-10-08T13:38:08.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 msgr2=0x7fb2f40a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:08.455 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 0x7fb2f40a3c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb30819e850 tx=0x7fb2f0009260 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 msgr2=0x7fb3081a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b370 tx=0x7fb2f8007f90 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 shutdown_connections 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7fb2f40a1770 0x7fb2f40a3c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb30819d170 0x7fb30819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb308107a60 0x7fb3081a4050 secure :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b370 tx=0x7fb2f8007f90 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 --2- 172.21.15.139:0/1669762010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30810c500 0x7fb3081a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.454+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 >> 172.21.15.139:0/1669762010 conn(0x7fb30806bc80 msgr2=0x7fb308070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:08.456 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.455+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 shutdown_connections 2023-10-08T13:38:08.458 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.458+0000 7fb30ea71700 1 -- 172.21.15.139:0/1669762010 wait complete. 2023-10-08T13:38:08.479 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/1788336425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281114d0 msgr2=0x7f8e281138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/1788336425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281114d0 0x7f8e281138c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009f90 tx=0x7f8e2000b330 comp rx=0 tx=0).stop 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/1788336425 shutdown_connections 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/1788336425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281114d0 0x7f8e281138c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/1788336425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281016f0 0x7f8e28100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.718 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/1788336425 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e28100720 0x7f8e28100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.717+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/1788336425 >> 172.21.15.139:0/1788336425 conn(0x7f8e28076780 msgr2=0x7f8e28076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.718+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/1788336425 shutdown_connections 2023-10-08T13:38:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.718+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/1788336425 wait complete. 2023-10-08T13:38:08.719 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 Processor -- start 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 -- start start 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e28100720 0x7f8e2819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 0x7f8e281a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a2330 con 0x7f8e28100720 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a24a0 con 0x7f8e281016f0 2023-10-08T13:38:08.720 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e2d5f3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281a2660 con 0x7f8e281114d0 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e1ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.719+0000 7f8e1ffff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:34100/0 (socket says 172.21.15.139:34100) 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 -- 172.21.15.139:0/57476034 learned_addr learned my addr 172.21.15.139:0/57476034 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e277fe700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 0x7f8e281a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 -- 172.21.15.139:0/57476034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 msgr2=0x7f8e281a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:08.721 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 0x7f8e281a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 -- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e28100720 msgr2=0x7f8e2819d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e28100720 0x7f8e2819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 -- 172.21.15.139:0/57476034 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e20009c40 con 0x7f8e281016f0 2023-10-08T13:38:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e277fe700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 0x7f8e281a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:38:08.722 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.720+0000 7f8e1ffff700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d980 tx=0x7f8e1800dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.725+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18009b40 con 0x7f8e281016f0 2023-10-08T13:38:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.725+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e1800de60 con 0x7f8e281016f0 2023-10-08T13:38:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.725+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800f620 con 0x7f8e281016f0 2023-10-08T13:38:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.725+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e281a2940 con 0x7f8e281016f0 2023-10-08T13:38:08.728 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.725+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2806a3f0 con 0x7f8e281016f0 2023-10-08T13:38:08.730 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.726+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e281a2b60 con 0x7f8e281016f0 2023-10-08T13:38:08.738 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.738+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f8e18010460 con 0x7f8e281016f0 2023-10-08T13:38:08.739 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.739+0000 7f8e24ff9700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 0x7f8e140a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.739+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 9869+0+0 (secure 0 0 0) 0x7f8e180cd490 con 0x7f8e281016f0 2023-10-08T13:38:08.740 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.739+0000 7f8e26ffd700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 0x7f8e140a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:08.741 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.740+0000 7f8e26ffd700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 0x7f8e140a3c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097b0 tx=0x7f8e10006d20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:08.743 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:08.743+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8e281a2b60 con 0x7f8e281016f0 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: Cluster is now healthy 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6838/2436892058,v1:172.21.15.139:6839/2436892058] up:boot 2023-10-08T13:38:08.898 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6836/2921041909,v1:172.21.15.139:6837/2921041909] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6834/558346652,v1:172.21.15.187:6835/558346652] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6832/1498836068,v1:172.21.15.155:6833/1498836068] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6834/3343988090,v1:172.21.15.155:6835/3343988090] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6836/1632640084,v1:172.21.15.187:6838/1632640084] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.139:6840/1333686721,v1:172.21.15.139:6841/1333686721] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6836/1487127851,v1:172.21.15.155:6837/1487127851] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.187:6837/2854440187,v1:172.21.15.187:6839/2854440187] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: mds.? [v2:172.21.15.155:6838/545080606,v1:172.21.15.155:6839/545080606] up:boot 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: fsmap 12 up:standby 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:38:08.899 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:38:08.900 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:08 smithi139 ceph-mon[99506]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:38:09.117 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.109+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e2819e710 con 0x7f8e281016f0 2023-10-08T13:38:09.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: Cluster is now healthy 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6838/2436892058,v1:172.21.15.139:6839/2436892058] up:boot 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6836/2921041909,v1:172.21.15.139:6837/2921041909] up:boot 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6834/558346652,v1:172.21.15.187:6835/558346652] up:boot 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6832/1498836068,v1:172.21.15.155:6833/1498836068] up:boot 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6834/3343988090,v1:172.21.15.155:6835/3343988090] up:boot 2023-10-08T13:38:09.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6836/1632640084,v1:172.21.15.187:6838/1632640084] up:boot 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.139:6840/1333686721,v1:172.21.15.139:6841/1333686721] up:boot 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6836/1487127851,v1:172.21.15.155:6837/1487127851] up:boot 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.187:6837/2854440187,v1:172.21.15.187:6839/2854440187] up:boot 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: mds.? [v2:172.21.15.155:6838/545080606,v1:172.21.15.155:6839/545080606] up:boot 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: fsmap 12 up:standby 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:38:09.228 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:38:09.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:38:09.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:38:09.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:08 smithi187 ceph-mon[104336]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:38:09.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T13:38:09.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-10-08T13:38:09.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-10-08T13:38:09.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: Cluster is now healthy 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/1669762010' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6838/2436892058,v1:172.21.15.139:6839/2436892058] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6836/2921041909,v1:172.21.15.139:6837/2921041909] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6834/558346652,v1:172.21.15.187:6835/558346652] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6832/1498836068,v1:172.21.15.155:6833/1498836068] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6834/3343988090,v1:172.21.15.155:6835/3343988090] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6836/1632640084,v1:172.21.15.187:6838/1632640084] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.139:6840/1333686721,v1:172.21.15.139:6841/1333686721] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6836/1487127851,v1:172.21.15.155:6837/1487127851] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.187:6837/2854440187,v1:172.21.15.187:6839/2854440187] up:boot 2023-10-08T13:38:09.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: mds.? [v2:172.21.15.155:6838/545080606,v1:172.21.15.155:6839/545080606] up:boot 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: fsmap 12 up:standby 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T13:38:09.349 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T13:38:09.350 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:08 smithi155 ceph-mon[103467]: from='mgr.14217 172.21.15.139:0/2298571449' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T13:38:09.912 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.911+0000 7f8e24ff9700 1 -- 172.21.15.139:0/57476034 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e180160d0 con 0x7f8e281016f0 2023-10-08T13:38:09.917 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.918+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 msgr2=0x7f8e140a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:09.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.918+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 0x7f8e140a3c80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097b0 tx=0x7f8e10006d20 comp rx=0 tx=0).stop 2023-10-08T13:38:09.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.918+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 msgr2=0x7f8e2819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:09.918 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.918+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800d980 tx=0x7f8e1800dd40 comp rx=0 tx=0).stop 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 shutdown_connections 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f8e140a17c0 0x7f8e140a3c80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e281114d0 0x7f8e281a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e28100720 0x7f8e2819d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 --2- 172.21.15.139:0/57476034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e281016f0 0x7f8e2819d950 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:09.925 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.925+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 >> 172.21.15.139:0/57476034 conn(0x7f8e28076780 msgr2=0x7f8e28107bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:09.936 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.935+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 shutdown_connections 2023-10-08T13:38:09.940 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:09.940+0000 7f8e2d5f3700 1 -- 172.21.15.139:0/57476034 wait complete. 2023-10-08T13:38:09.946 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_metadata' removed 2023-10-08T13:38:09.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T13:38:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:09 smithi139 ceph-mon[99506]: pgmap v632: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 68 KiB/s wr, 34 op/s 2023-10-08T13:38:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:09 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/57476034' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:09 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 -- 172.21.15.139:0/549509471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc068a90 msgr2=0x7ff8bc068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 --2- 172.21.15.139:0/549509471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc068a90 0x7ff8bc068e70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009990 tx=0x7ff8b0009ca0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.199 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 -- 172.21.15.139:0/549509471 shutdown_connections 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 --2- 172.21.15.139:0/549509471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 --2- 172.21.15.139:0/549509471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc068a90 0x7ff8bc068e70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 --2- 172.21.15.139:0/549509471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8bc0693b0 0x7ff8bc10cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.197+0000 7ff8c2018700 1 -- 172.21.15.139:0/549509471 >> 172.21.15.139:0/549509471 conn(0x7ff8bc076790 msgr2=0x7ff8bc076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.198+0000 7ff8c2018700 1 -- 172.21.15.139:0/549509471 shutdown_connections 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.198+0000 7ff8c2018700 1 -- 172.21.15.139:0/549509471 wait complete. 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.198+0000 7ff8c2018700 1 Processor -- start 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 -- start start 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8bc068a90 0x7ff8bc106170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:10.200 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc0693b0 0x7ff8bc1066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc101f70 con 0x7ff8bc0693b0 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1020e0 con 0x7ff8bc10d190 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8c2018700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1022a0 con 0x7ff8bc068a90 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8bbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8bbfff700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.139:34112/0 (socket says 172.21.15.139:34112) 2023-10-08T13:38:10.201 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.199+0000 7ff8bbfff700 1 -- 172.21.15.139:0/2150892524 learned_addr learned my addr 172.21.15.139:0/2150892524 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:10.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 -- 172.21.15.139:0/2150892524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8bc068a90 msgr2=0x7ff8bc106170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:38:10.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8bc068a90 0x7ff8bc106170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 -- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc0693b0 msgr2=0x7ff8bc1066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:10.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc0693b0 0x7ff8bc1066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.202 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 -- 172.21.15.139:0/2150892524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00095f0 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.200+0000 7ff8bbfff700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00b480 tx=0x7ff8ac00b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.201+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac011830 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.201+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ac011e50 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.201+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00f2e0 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.201+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc102580 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.201+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc10c0f0 con 0x7ff8bc10d190 2023-10-08T13:38:10.203 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.202+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc0ffc60 con 0x7ff8bc10d190 2023-10-08T13:38:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.203+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7ff8ac010380 con 0x7ff8bc10d190 2023-10-08T13:38:10.204 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.204+0000 7ff8b8ff9700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 0x7ff8a40a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:10.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.204+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 9315+0+0 (secure 0 0 0) 0x7ff8ac0cd2c0 con 0x7ff8bc10d190 2023-10-08T13:38:10.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.205+0000 7ff8bb7fe700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 0x7ff8a40a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:10.207 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.207+0000 7ff8bb7fe700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 0x7ff8a40a3c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0005b40 tx=0x7ff8b0005ab0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:10.209 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.209+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff8ac096450 con 0x7ff8bc10d190 2023-10-08T13:38:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:09 smithi187 ceph-mon[104336]: pgmap v632: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 68 KiB/s wr, 34 op/s 2023-10-08T13:38:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:09 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/57476034' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.229 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:09 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:09 smithi155 ceph-mon[103467]: pgmap v632: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 107 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 68 KiB/s wr, 34 op/s 2023-10-08T13:38:10.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:09 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/57476034' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:09 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:10.519 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.519+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8bc1028a0 con 0x7ff8bc10d190 2023-10-08T13:38:10.937 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.937+0000 7ff8b8ff9700 1 -- 172.21.15.139:0/2150892524 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff8ac015020 con 0x7ff8bc10d190 2023-10-08T13:38:10.942 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.943+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 msgr2=0x7ff8a40a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.943+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 0x7ff8a40a3c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0005b40 tx=0x7ff8b0005ab0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.943+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 msgr2=0x7ff8bc1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:10.943 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.943+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00b480 tx=0x7ff8ac00b840 comp rx=0 tx=0).stop 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 shutdown_connections 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7ff8a40a1740 0x7ff8a40a3c00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8bc10d190 0x7ff8bc1017f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8bc068a90 0x7ff8bc106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 --2- 172.21.15.139:0/2150892524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc0693b0 0x7ff8bc1066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.946+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 >> 172.21.15.139:0/2150892524 conn(0x7ff8bc076790 msgr2=0x7ff8bc10e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.947+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 shutdown_connections 2023-10-08T13:38:10.947 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:10.947+0000 7ff8c2018700 1 -- 172.21.15.139:0/2150892524 wait complete. 2023-10-08T13:38:10.949 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data' removed 2023-10-08T13:38:10.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-08T13:38:11.090 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 -- 172.21.15.139:0/2640267773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 msgr2=0x7f2e4c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 --2- 172.21.15.139:0/2640267773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0680c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0099c0 tx=0x7f2e3c009cd0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 -- 172.21.15.139:0/2640267773 shutdown_connections 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 --2- 172.21.15.139:0/2640267773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c105b80 0x7f2e4c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 --2- 172.21.15.139:0/2640267773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0680c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 --2- 172.21.15.139:0/2640267773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c1051c0 0x7f2e4c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 -- 172.21.15.139:0/2640267773 >> 172.21.15.139:0/2640267773 conn(0x7f2e4c076780 msgr2=0x7f2e4c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 -- 172.21.15.139:0/2640267773 shutdown_connections 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.089+0000 7f2e510c2700 1 -- 172.21.15.139:0/2640267773 wait complete. 2023-10-08T13:38:11.091 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 Processor -- start 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 -- start start 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c1051c0 0x7f2e4c0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c105b80 0x7f2e4c100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1a4f80 con 0x7f2e4c067ce0 2023-10-08T13:38:11.093 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1a50f0 con 0x7f2e4c105b80 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e510c2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1a52b0 con 0x7f2e4c1051c0 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:43838/0 (socket says 172.21.15.139:43838) 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 -- 172.21.15.139:0/371247881 learned_addr learned my addr 172.21.15.139:0/371247881 (peer_addr_for_me v2:172.21.15.139:0/0) 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4b59e700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c105b80 0x7f2e4c100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4a59c700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c1051c0 0x7f2e4c0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 -- 172.21.15.139:0/371247881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c1051c0 msgr2=0x7f2e4c0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c1051c0 0x7f2e4c0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 -- 172.21.15.139:0/371247881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c105b80 msgr2=0x7f2e4c100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c105b80 0x7f2e4c100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.094 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.090+0000 7f2e4ad9d700 1 -- 172.21.15.139:0/371247881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0095f0 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e4ad9d700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00b580 tx=0x7f2e3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c01d070 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e3c00fb30 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c1a5530 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c022c80 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.091+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c1a5950 con 0x7f2e4c067ce0 2023-10-08T13:38:11.095 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.092+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c108c70 con 0x7f2e4c067ce0 2023-10-08T13:38:11.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.093+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) v1 ==== 136135+0+0 (secure 0 0 0) 0x7f2e3c00fca0 con 0x7f2e4c067ce0 2023-10-08T13:38:11.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.094+0000 7f2e33fff700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 0x7f2e340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:38:11.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.094+0000 7f2e4a59c700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 0x7f2e340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:38:11.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.094+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8727+0+0 (secure 0 0 0) 0x7f2e3c0ce380 con 0x7f2e4c067ce0 2023-10-08T13:38:11.096 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.094+0000 7f2e4a59c700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 0x7f2e340a3ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c100de0 tx=0x7f2e4000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:38:11.098 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.097+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2e3c097660 con 0x7f2e4c067ce0 2023-10-08T13:38:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:10 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:10 smithi139 ceph-mon[99506]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:38:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:10 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/2150892524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.187 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:10 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:10 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:11.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:10 smithi187 ceph-mon[104336]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:38:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:10 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/2150892524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.227 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:10 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.290 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.289+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e4c101e70 con 0x7f2e4c067ce0 2023-10-08T13:38:11.346 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:10 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:11.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:10 smithi155 ceph-mon[103467]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T13:38:11.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:10 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/2150892524' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:10 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:11.935 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.934+0000 7f2e33fff700 1 -- 172.21.15.139:0/371247881 <== mon.0 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v107) v1 ==== 178+0+0 (secure 0 0 0) 0x7f2e3c09ac80 con 0x7f2e4c067ce0 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 msgr2=0x7f2e340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 0x7f2e340a3ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c100de0 tx=0x7f2e4000b410 comp rx=0 tx=0).stop 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 msgr2=0x7f2e4c0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00b580 tx=0x7f2e3c004730 comp rx=0 tx=0).stop 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 shutdown_connections 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:6800/4190664653,v1:172.21.15.139:6801/4190664653] conn(0x7f2e340a15f0 0x7f2e340a3ab0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.938 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e4c105b80 0x7f2e4c100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e4c067ce0 0x7f2e4c0ff6b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 --2- 172.21.15.139:0/371247881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c1051c0 0x7f2e4c0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.936+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 >> 172.21.15.139:0/371247881 conn(0x7f2e4c076780 msgr2=0x7f2e4c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.937+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 shutdown_connections 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:2023-10-08T13:38:11.937+0000 7f2e510c2700 1 -- 172.21.15.139:0/371247881 wait complete. 2023-10-08T13:38:11.939 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'cephfs_data_ec' removed 2023-10-08T13:38:11.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:38:11.995 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:38:12.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:38:12.079 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-08T13:38:12.079 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:38:12.096 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:38:12.116 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T13:38:12.133 INFO:tasks.cephadm:Stopping all daemons... 2023-10-08T13:38:12.133 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-08T13:38:12.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T13:38:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:11 smithi187 ceph-mon[104336]: pgmap v634: 97 pgs: 9 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 54 active+clean; 66 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:38:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:11 smithi187 ceph-mon[104336]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:11 smithi187 ceph-mon[104336]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:38:12.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:11 smithi187 ceph-mon[104336]: from='client.? 172.21.15.139:0/371247881' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:12.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:11 smithi155 ceph-mon[103467]: pgmap v634: 97 pgs: 9 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 54 active+clean; 66 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:38:12.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:11 smithi155 ceph-mon[103467]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:12.347 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:11 smithi155 ceph-mon[103467]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:38:12.348 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:11 smithi155 ceph-mon[103467]: from='client.? 172.21.15.139:0/371247881' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:12.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:11 smithi139 ceph-mon[99506]: pgmap v634: 97 pgs: 9 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 54 active+clean; 66 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T13:38:12.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:11 smithi139 ceph-mon[99506]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-10-08T13:38:12.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:11 smithi139 ceph-mon[99506]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T13:38:12.437 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:11 smithi139 ceph-mon[99506]: from='client.? 172.21.15.139:0/371247881' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2023-10-08T13:38:12.438 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:12 smithi139 systemd[1]: Stopping Ceph mon.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:12.833 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:38:12.500+0000 7f40500de700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:12.834 INFO:journalctl@ceph.mon.a.smithi139.stdout:Oct 08 13:38:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-a[99482]: 2023-10-08T13:38:12.500+0000 7f40500de700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-08T13:38:13.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-08T13:38:13.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:13.094 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-08T13:38:13.094 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-08T13:38:13.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.b 2023-10-08T13:38:13.469 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:13 smithi155 systemd[1]: Stopping Ceph mon.b for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:13.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-b[103443]: 2023-10-08T13:38:13.468+0000 7f52abcc1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:13.740 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-b[103443]: 2023-10-08T13:38:13.468+0000 7f52abcc1700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:38:14.819 INFO:journalctl@ceph.mon.b.smithi155.stdout:Oct 08 13:38:14 smithi155 bash[146478]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-b 2023-10-08T13:38:14.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-08T13:38:14.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:14.939 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-08T13:38:14.939 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-08T13:38:14.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.c 2023-10-08T13:38:15.226 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:14 smithi187 systemd[1]: Stopping Ceph mon.c for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:15.663 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-c[104312]: 2023-10-08T13:38:15.368+0000 7f81648bc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:15.663 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-c[104312]: 2023-10-08T13:38:15.368+0000 7f81648bc700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-08T13:38:16.586 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-08T13:38:16.610 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:16 smithi187 bash[147092]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mon-c 2023-10-08T13:38:16.610 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:16 smithi187 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mon.c.service: Succeeded. 2023-10-08T13:38:16.610 INFO:journalctl@ceph.mon.c.smithi187.stdout:Oct 08 13:38:16 smithi187 systemd[1]: Stopped Ceph mon.c for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:38:16.675 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:16.675 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-08T13:38:16.675 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-08T13:38:16.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T13:38:17.187 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:38:16 smithi139 systemd[1]: Stopping Ceph mgr.x for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:17.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:38:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:38:17.571+0000 7f8252a81700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:17.937 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:38:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x[99751]: 2023-10-08T13:38:17.571+0000 7f8252a81700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-08T13:38:18.270 INFO:journalctl@ceph.mgr.x.smithi139.stdout:Oct 08 13:38:17 smithi139 bash[201158]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-x 2023-10-08T13:38:18.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-08T13:38:18.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:18.316 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-08T13:38:18.316 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-08T13:38:18.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.y 2023-10-08T13:38:18.732 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:38:18 smithi155 systemd[1]: Stopping Ceph mgr.y for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:19.096 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:38:18 smithi155 bash[146620]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-y 2023-10-08T13:38:19.096 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Oct 08 13:38:18 smithi155 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:38:19.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-08T13:38:19.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:19.153 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-08T13:38:19.153 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-08T13:38:19.153 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.z 2023-10-08T13:38:19.476 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:38:19 smithi187 systemd[1]: Stopping Ceph mgr.z for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:19.859 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:38:19 smithi187 bash[147235]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mgr-z 2023-10-08T13:38:20.069 INFO:journalctl@ceph.mgr.z.smithi187.stdout:Oct 08 13:38:19 smithi187 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-08T13:38:20.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-08T13:38:20.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:20.111 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-08T13:38:20.112 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-08T13:38:20.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.0 2023-10-08T13:38:20.437 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:38:20 smithi139 systemd[1]: Stopping Ceph osd.0 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:20.937 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:38:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:38:20.473+0000 7f8bf85d8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:20.996 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:38:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:38:20.473+0000 7f8bf85d8700 -1 osd.0 107 *** Got signal Terminated *** 2023-10-08T13:38:20.996 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:38:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0[125384]: 2023-10-08T13:38:20.473+0000 7f8bf85d8700 -1 osd.0 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:26.687 INFO:journalctl@ceph.osd.0.smithi139.stdout:Oct 08 13:38:26 smithi139 bash[201296]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-0 2023-10-08T13:38:27.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-08T13:38:27.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:27.746 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-08T13:38:27.746 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-08T13:38:27.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.1 2023-10-08T13:38:28.092 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:27 smithi155 systemd[1]: Stopping Ceph osd.1 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:28.346 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:38:28.091+0000 7f466e35a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:28.346 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:38:28.091+0000 7f466e35a700 -1 osd.1 107 *** Got signal Terminated *** 2023-10-08T13:38:28.346 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1[109622]: 2023-10-08T13:38:28.091+0000 7f466e35a700 -1 osd.1 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:34.096 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:33 smithi155 bash[146776]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-1 2023-10-08T13:38:35.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-08T13:38:35.079 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:35 smithi155 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.1.service: Succeeded. 2023-10-08T13:38:35.079 INFO:journalctl@ceph.osd.1.smithi155.stdout:Oct 08 13:38:35 smithi155 systemd[1]: Stopped Ceph osd.1 for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:38:35.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:35.093 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-08T13:38:35.093 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-08T13:38:35.093 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.2 2023-10-08T13:38:35.448 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:38:35 smithi187 systemd[1]: Stopping Ceph osd.2 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:35.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:38:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:38:35.446+0000 7fbde72e1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:35.726 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:38:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:38:35.446+0000 7fbde72e1700 -1 osd.2 107 *** Got signal Terminated *** 2023-10-08T13:38:35.727 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:38:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2[111409]: 2023-10-08T13:38:35.446+0000 7fbde72e1700 -1 osd.2 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:41.476 INFO:journalctl@ceph.osd.2.smithi187.stdout:Oct 08 13:38:41 smithi187 bash[147383]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-2 2023-10-08T13:38:42.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-08T13:38:42.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:42.631 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-08T13:38:42.632 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-08T13:38:42.632 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.3 2023-10-08T13:38:42.937 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:42 smithi139 systemd[1]: Stopping Ceph osd.3 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:43.437 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:42 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:38:42.987+0000 7f9c65c63700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:43.437 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:42 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:38:42.987+0000 7f9c65c63700 -1 osd.3 107 *** Got signal Terminated *** 2023-10-08T13:38:43.437 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:42 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:38:42.987+0000 7f9c65c63700 -1 osd.3 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:47.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:47 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:47.074+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:47.437 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:46 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3[134045]: 2023-10-08T13:38:46.975+0000 7f9c61257700 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:25.250598+0000 front 2023-10-08T13:38:25.250623+0000 (oldest deadline 2023-10-08T13:38:46.350834+0000) 2023-10-08T13:38:48.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:47.897+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:48.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:48 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:48.064+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:49.187 INFO:journalctl@ceph.osd.3.smithi139.stdout:Oct 08 13:38:48 smithi139 bash[201575]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-3 2023-10-08T13:38:49.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:48 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:48.922+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:49.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:48 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:48.796+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:49.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:49 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:49.088+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:50.229 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:49 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:49.886+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:50.229 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:49 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:49.768+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:50.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:50 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:50.071+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:50.366 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-08T13:38:50.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:50.406 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-08T13:38:50.406 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-08T13:38:50.406 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.4 2023-10-08T13:38:50.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:50 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:50.433+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:50.754 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:50 smithi155 systemd[1]: Stopping Ceph osd.4 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:51.091 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:50 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:38:50.753+0000 7f8736f1a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:51.091 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:50 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:38:50.753+0000 7f8736f1a700 -1 osd.4 107 *** Got signal Terminated *** 2023-10-08T13:38:51.091 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:50 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:38:50.753+0000 7f8736f1a700 -1 osd.4 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:51.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:50 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:50.881+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:51.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:50 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:50.795+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:51.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:50 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:50.966+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:51.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:51 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:51.090+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:51.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:51 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:51.456+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:52.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:51 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:51.863+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:52.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:51 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:51.787+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:52.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:51 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:51.987+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:52.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:52 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:52.129+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:52.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:52 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:52.470+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:53.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:52 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:52.884+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:53.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:52 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:52.814+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:53.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:52 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:52.985+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:53.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:53 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:53.108+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:53.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:53 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:53.478+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:54.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:53 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:53.867+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:54.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:53 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:53.860+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:54.228 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:53 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:53.965+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:54.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:54 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:54.133+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:54.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:54 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:54.133+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:54.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:54 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:54.521+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:55.096 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:54 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:38:54.745+0000 7f872f508700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.852407+0000 front 2023-10-08T13:38:29.852453+0000 (oldest deadline 2023-10-08T13:38:53.952563+0000) 2023-10-08T13:38:55.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:54 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:54.865+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:55.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:54 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:54.819+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:55.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:54 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:54.917+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:55.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:55 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:55.105+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:55.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:55 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:55.096+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:55.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:55 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:55.552+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:56.096 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:55 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4[117509]: 2023-10-08T13:38:55.710+0000 7f872f508700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.852407+0000 front 2023-10-08T13:38:29.852453+0000 (oldest deadline 2023-10-08T13:38:53.952563+0000) 2023-10-08T13:38:56.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:55 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:55.891+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:56.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:55 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:55.953+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:56.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:55 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:55.785+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:56.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:55 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:55.785+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:38:56.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:56 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:56.066+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:56.546 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:56 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:56.131+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:56.546 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:56 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:56.131+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:38:56.846 INFO:journalctl@ceph.osd.4.smithi155.stdout:Oct 08 13:38:56 smithi155 bash[147036]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-4 2023-10-08T13:38:56.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:56 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:56.558+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:57.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:56 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:56.848+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:57.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:56 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:56.940+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:57.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:56 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:56.767+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:57.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:56 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:56.767+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:38:57.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:57 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:57.017+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:57.540 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:57 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:57.119+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:57.540 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:57 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:57.119+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:38:57.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:38:57 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:38:57.538+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:38:57.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:57 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:57.534+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:57.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:57 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:57.534+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:38:57.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-08T13:38:58.011 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:38:58.011 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-08T13:38:58.012 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-08T13:38:58.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.5 2023-10-08T13:38:58.041 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:57.865+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:58.041 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:57.865+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:38:58.041 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:57.785+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:58.041 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:57.785+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:38:58.042 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:57.908+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:58.042 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:57 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:57.908+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:38:58.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:58 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:58.083+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:58.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:58 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:58.083+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:38:58.377 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 systemd[1]: Stopping Ceph osd.5 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:38:58.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:58.005+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:58.726 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:58.375+0000 7fe02825c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:38:58.726 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:58.375+0000 7fe02825c700 -1 osd.5 107 *** Got signal Terminated *** 2023-10-08T13:38:58.726 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:58.375+0000 7fe02825c700 -1 osd.5 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:38:58.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:38:58 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:38:58.587+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:38:58.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:58.524+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:58.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:58.524+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:38:59.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:58.800+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:38:59.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:58.800+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:38:59.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:58.866+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:38:59.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:58.866+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:38:59.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:58.913+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:38:59.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:58 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:58.913+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:38:59.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:38:58 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:38:58.960+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:38:59.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:59 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:59.105+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:38:59.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:38:59 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:38:59.105+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:38:59.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:59.558+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:38:59.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:38:59 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:38:59.558+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:00.072 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:38:59 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:38:59.608+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:00.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:59.818+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:00.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:38:59.818+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:00.226 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:59.822+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:39:00.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:38:59.822+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:39:00.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:59.960+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:00.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:38:59 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:38:59.960+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:00.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:00 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:00.072+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:00.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:00 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:00.072+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:00.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:00.007+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:00.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:00.580+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:00.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:00.580+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:01.062 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:00 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:00.606+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:01.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:00.806+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:01.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:00.806+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:01.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:00.863+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:39:01.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:00.863+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:39:01.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:00.928+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:01.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:00 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:00.928+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:01.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:01 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:01.061+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:01.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:01 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:01.061+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:01.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:00.990+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:01.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:01.617+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:01.954 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:01.617+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:02.094 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:01 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:01.641+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:02.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:01.826+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:02.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:01.826+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:02.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:01.890+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:39:02.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:01.890+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:39:02.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:01.959+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:02.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:01.959+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:02.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:01 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:01.959+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:02.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:02 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:02.093+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:02.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:02 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:02.093+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:02.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:01 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:01.977+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:02.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:02.608+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:02.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:02 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:02.608+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:03.096 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:02 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:02.613+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:03.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:02.815+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:03.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:02.815+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:03.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:02.815+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:02.856+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:20.798145+0000 front 2023-10-08T13:38:20.798195+0000 (oldest deadline 2023-10-08T13:38:47.198846+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:02.856+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:27.199528+0000 front 2023-10-08T13:38:27.199378+0000 (oldest deadline 2023-10-08T13:38:57.700653+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5[119453]: 2023-10-08T13:39:02.856+0000 7fe02204d700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:37.701128+0000 front 2023-10-08T13:38:37.701115+0000 (oldest deadline 2023-10-08T13:39:02.401148+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:02.917+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:02.917+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:03.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:02 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:02.917+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:03.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:03.023+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:03.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:03 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:03.112+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:03.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:03 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:03.112+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:03.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:03.595+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:03.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:03.595+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:03.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:03 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:03.595+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:04.096 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:03 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:03.656+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:04.097 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:03 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:03.656+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:04.224 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:03.863+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:04.224 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:03.863+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:04.224 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:03.863+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:04.225 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:03.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:04.225 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:03.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:04.225 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:03 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:03.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:04.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:04.060+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:04.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:04.060+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:04.476 INFO:journalctl@ceph.osd.5.smithi187.stdout:Oct 08 13:39:04 smithi187 bash[147645]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-5 2023-10-08T13:39:04.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:04 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:04.107+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:04.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:04 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:04.107+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:04.597 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:04 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:04.107+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:04.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:04.591+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:04.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:04.591+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:04.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:04 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:04.591+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:05.064 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:04 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:04.657+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:05.064 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:04 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:04.657+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:05.202 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:04.890+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:05.202 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:04.890+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:05.202 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:04.890+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:05.202 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:04.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:05.202 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:04.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:05.203 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:04 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:04.881+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:05.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:05.063+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:05.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:05.063+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:05.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:05.063+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:05.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:05.074+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:05.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:05.074+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:05.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-08T13:39:05.594 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:05.594 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-08T13:39:05.595 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-08T13:39:05.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.6 2023-10-08T13:39:05.937 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 systemd[1]: Stopping Ceph osd.6 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:05.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:05.548+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:05.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:05.548+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:05.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:05.548+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:06.041 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:05.609+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:06.042 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:05.609+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:06.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:05.907+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:06.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:05.907+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:06.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:05.907+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:06.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:05.932+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:06.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:05.932+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:06.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:05 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:05.932+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:06.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.041+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:06.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.041+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:06.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.041+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:06.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:05.941+0000 7f8bdb5c6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:06.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:05.941+0000 7f8bdb5c6700 -1 osd.6 107 *** Got signal Terminated *** 2023-10-08T13:39:06.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:05 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:05.941+0000 7f8bdb5c6700 -1 osd.6 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:06.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:06.114+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:06.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:06.114+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:06.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:06.578+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:06.847 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:06.578+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:06.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:06.555+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:06.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:06.555+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:06.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:06 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:06.555+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:07.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:06.906+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:07.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:06.906+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:07.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:06.906+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:07.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:06.906+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:07.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:06.906+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:07.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:06 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:06.906+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:07.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.995+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:07.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.995+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:07.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:06 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:06.995+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:07.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:07.114+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:07.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:07.115+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:07.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:07.515+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:07.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:07.515+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:07.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:07 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:07.515+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:07.990 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:07.596+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:07.990 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:07.596+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:08.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:07.882+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:08.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:07.882+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:08.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:07.882+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:08.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:07.928+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:08.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:07.928+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:08.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:07 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:07.928+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:08.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:07.989+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:08.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:07.989+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:08.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:07 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:07.989+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:08.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:08.083+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:08.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:08.083+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:08.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:08.592+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:08.847 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:08.592+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:08.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:08.475+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:08.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:08.475+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:08.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:08 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:08.475+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:09.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:08.905+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:09.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:08.905+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:09.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:08.905+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:09.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:08.905+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:09.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:08.938+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:09.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:08.938+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:09.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:08 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:08.938+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:09.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.004+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:09.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.004+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:09.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.004+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:09.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:09.110+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:09.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:09.110+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:09.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:09.488+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:09.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:09.488+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:09.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:09.488+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:09.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:09 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:09.488+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:09.990 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:09.633+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:09.990 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:09.633+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:10.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:09.930+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:10.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:09.930+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:10.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:09.930+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:10.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:09.930+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:10.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:09.893+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:10.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:09.893+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:10.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:09 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:09.893+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:10.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.990+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:10.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.990+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:10.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.990+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:10.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:09 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:09.990+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:10.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:10.079+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.393966+0000 front 2023-10-08T13:38:30.393949+0000 (oldest deadline 2023-10-08T13:38:53.894027+0000) 2023-10-08T13:39:10.437 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6[141985]: 2023-10-08T13:39:10.079+0000 7f8bd5bb8700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.396629+0000 front 2023-10-08T13:38:38.396546+0000 (oldest deadline 2023-10-08T13:39:03.696507+0000) 2023-10-08T13:39:10.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:10.451+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:10.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:10.452+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:10.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:10.452+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:10.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:10 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:10.452+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:10.953 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:10.682+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:10.953 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:10.682+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:11.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:10.880+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:11.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:10.880+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:11.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:10.880+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:11.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:10.880+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:11.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:10.903+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:11.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:10.903+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:11.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:10 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:10.903+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:11.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:10.952+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:11.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:10.952+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:11.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:10.952+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:11.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:10 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:10.952+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:11.730 INFO:journalctl@ceph.osd.6.smithi139.stdout:Oct 08 13:39:11 smithi139 bash[201850]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-6 2023-10-08T13:39:11.731 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:11 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:11.444+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:11.731 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:11 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:11.444+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:11.731 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:11 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:11.444+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:11.731 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:11 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:11.444+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:12.096 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:11.716+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:12.097 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:11.716+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:12.097 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:11.947+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:12.097 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:11.947+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:12.097 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:11.947+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:12.097 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:11 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:11.947+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:12.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:11.875+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:12.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:11.875+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:12.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:11.875+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:12.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:11.875+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:12.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:11.894+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:12.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:11.894+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:12.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:11 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:11.894+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:12.658 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:12.471+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:12.659 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:12.471+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:12.659 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:12.471+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:12.659 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:12 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:12.471+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:12.989 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:12.667+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:12.989 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:12.667+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:12.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-08T13:39:13.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:13.032 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-08T13:39:13.032 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-08T13:39:13.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.7 2023-10-08T13:39:13.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:12.877+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:13.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:12.877+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:13.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:12.877+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:13.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:12.877+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:13.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:12.865+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:13.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:12.865+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:13.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:12 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:12.865+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:13.346 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 systemd[1]: Stopping Ceph osd.7 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:13.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:12.988+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:13.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:12.988+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:13.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:12.988+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:13.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:12.988+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:13.662 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.383+0000 7f8a81f8b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:13.662 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.383+0000 7f8a81f8b700 -1 osd.7 107 *** Got signal Terminated *** 2023-10-08T13:39:13.662 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.383+0000 7f8a81f8b700 -1 osd.7 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:13.662 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.661+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:13.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:13 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:13.425+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:13.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:13 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:13.425+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:13.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:13 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:13.425+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:13.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:13 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:13.425+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:13.958 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.661+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:13.959 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:13.661+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:46.784655+0000 front 2023-10-08T13:38:46.784599+0000 (oldest deadline 2023-10-08T13:39:12.684651+0000) 2023-10-08T13:39:14.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:13.839+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:14.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:13.839+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:14.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:13.839+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:14.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:13.839+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:14.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:13.835+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:14.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:13.835+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:14.228 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:13 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:13.835+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:14.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:13.958+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:14.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:13.958+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:14.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:13.958+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:14.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:13 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:13.958+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:14.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:14 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:14.404+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:14.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:14 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:14.404+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:14.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:14 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:14.404+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:14.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:14 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:14.404+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:15.006 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:14 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:14.621+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:15.006 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:14 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:14.621+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:15.006 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:14 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:14.621+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:46.784655+0000 front 2023-10-08T13:38:46.784599+0000 (oldest deadline 2023-10-08T13:39:12.684651+0000) 2023-10-08T13:39:15.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:14.868+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:15.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:14.868+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:15.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:14.868+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:15.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:14.868+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:15.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:14.787+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:15.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:14.787+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:15.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:14 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:14.787+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:15.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:15.005+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:15.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:15.005+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:15.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:15.005+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:15.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:15.005+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:15.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:15 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:15.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:15.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:15 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:15.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:15.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:15 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:15.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:15.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:15 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:15.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:15.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:15.581+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:15.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:15.581+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:15.847 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:15 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:15.581+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:46.784655+0000 front 2023-10-08T13:38:46.784599+0000 (oldest deadline 2023-10-08T13:39:12.684651+0000) 2023-10-08T13:39:16.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:15.809+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:16.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:15.809+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:16.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:15.809+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:16.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:15.864+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:16.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:15.864+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:16.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:15.864+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:16.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:15 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:15.864+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:16.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:16.007+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:16.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:16.007+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:16.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:16.007+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:16.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:16.007+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:16.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:16 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:16.412+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:16.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:16 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:16.412+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:16.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:16 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:16.412+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:16.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:16 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:16.412+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:16.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:16.595+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:16.846 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:16.595+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:16.847 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:16.595+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:46.784655+0000 front 2023-10-08T13:38:46.784599+0000 (oldest deadline 2023-10-08T13:39:12.684651+0000) 2023-10-08T13:39:17.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:16.911+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:17.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:16.911+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:17.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:16.911+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:17.226 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:16.911+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:17.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:16.760+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:17.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:16.760+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:17.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:16.760+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:17.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:16 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:16.760+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:17.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.006+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:17.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.006+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:17.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.006+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:17.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.006+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:17.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.006+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:17.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:17.396+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:17.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:17.396+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:17.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:17.396+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:17.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:17.396+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:17.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:17 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:17.396+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:17.969 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:17.643+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.882686+0000 front 2023-10-08T13:38:30.882625+0000 (oldest deadline 2023-10-08T13:38:56.782841+0000) 2023-10-08T13:39:17.969 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:17.643+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:36.783580+0000 front 2023-10-08T13:38:36.783382+0000 (oldest deadline 2023-10-08T13:39:02.683514+0000) 2023-10-08T13:39:17.970 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:17.643+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:46.784655+0000 front 2023-10-08T13:38:46.784599+0000 (oldest deadline 2023-10-08T13:39:12.684651+0000) 2023-10-08T13:39:17.970 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7[126166]: 2023-10-08T13:39:17.643+0000 7f8a7c57d700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.585393+0000 front 2023-10-08T13:38:55.585422+0000 (oldest deadline 2023-10-08T13:39:17.285586+0000) 2023-10-08T13:39:17.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:17.717+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:17.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:17.717+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:17.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:17.717+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:17.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:17.717+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:17.977 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:17.925+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:17.977 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:17.925+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:17.977 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:17.925+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:17.977 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:17 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:17.925+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:18.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.969+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:18.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.969+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:18.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.969+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:18.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.969+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:18.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:17 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:17.969+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:18.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:18.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:18.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:18.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:18.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:18.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:18.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:18.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:18.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:18 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:18.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:19.171 INFO:journalctl@ceph.osd.7.smithi155.stdout:Oct 08 13:39:19 smithi155 bash[147306]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-7 2023-10-08T13:39:19.172 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:18.945+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:19.172 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:18.945+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:19.172 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:18.945+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:19.172 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:18.945+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:19.172 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:18 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:18.945+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:19.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:18.754+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:19.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:18.754+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:19.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:18.754+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:19.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:18.754+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:19.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:18.970+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:19.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:18.970+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:19.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:18.970+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:19.227 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:18 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:18.970+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:19.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:19.401+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:19.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:19.401+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:19.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:19.401+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:19.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:19.401+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:19.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:19 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:19.401+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:19.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:19.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:19.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:19.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:19.977 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:19.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:19.977 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:19 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:19.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:20.325 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:19.965+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:20.325 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:19.965+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:20.325 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:19.965+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:20.325 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:19.965+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:20.325 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:19 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:19.965+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:20.332 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-08T13:39:20.371 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:20.372 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-08T13:39:20.372 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-08T13:39:20.373 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.8 2023-10-08T13:39:20.405 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:19.998+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:20.405 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:19.998+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:20.405 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:19.998+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:20.405 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:19.998+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:20.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:20.426+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:20.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:20.426+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:20.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:20.426+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:20.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:20.426+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:20.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:20 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:20.426+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:20.726 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 systemd[1]: Stopping Ceph osd.8 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:21.033 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:20.730+0000 7f7ef9519700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:21.033 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:20.730+0000 7f7ef9519700 -1 osd.8 107 *** Got signal Terminated *** 2023-10-08T13:39:21.033 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:20.730+0000 7f7ef9519700 -1 osd.8 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:21.033 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:20.769+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:21.033 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:20.769+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:21.034 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:20.769+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:21.034 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:20.769+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:21.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:20.985+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:21.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:20.985+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:21.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:20.985+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:21.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:20.985+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:21.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:20 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:20.985+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:21.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:21.031+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:21.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:21.031+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:21.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:21.031+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:21.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:21.031+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:21.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:21.465+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:21.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:21.465+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:21.937 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:21.465+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:21.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:21.465+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:21.938 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:21 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:21.465+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:22.009 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:21.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:22.009 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:21.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:22.009 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:21.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:22.009 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:21 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:21.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:22.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:21.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:22.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:21.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:22.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:21.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:22.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:21.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:22.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:21 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:21.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:22.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:22.008+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:22.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:22.008+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:22.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:22.008+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:22.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:22.008+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:22.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:22.430+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:22.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:22.430+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:22.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:22.430+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:22.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:22.430+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:22.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:22 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:22.430+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:23.038 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:22.765+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:23.038 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:22.765+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:23.038 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:22.766+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:23.038 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:22 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:22.766+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:23.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:22.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:23.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:22.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:23.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:22.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:23.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:22.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:23.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:22 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:22.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:23.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:23.036+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:23.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:23.036+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:23.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:23.036+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:23.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:23.036+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:23.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:23.395+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:23.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:23.395+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:23.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:23.395+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:23.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:23.395+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:23.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:23 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:23.395+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:23.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:23.724+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:23.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:23.724+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:23.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:23.724+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:23.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:23 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:23.724+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:24.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:23.925+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:24.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:23.925+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:24.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:23.925+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:24.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:23.925+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:24.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:23 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:23.925+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:24.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:24.062+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:24.476 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:24.062+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:24.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:24.062+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:24.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:24.062+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:24.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:24 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:24.358+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:24.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:24 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:24.358+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:24.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:24 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:24.358+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:24.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:24 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:24.358+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:24.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:24 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:24.358+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:24.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:24.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:24.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:24.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:24.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:24.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:24.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:24.722+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:25.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:24.887+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:25.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:24.887+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:25.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:24.887+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:25.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:24.887+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:25.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:24 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:24.887+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:25.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:25.040+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:19.856960+0000 front 2023-10-08T13:38:19.856885+0000 (oldest deadline 2023-10-08T13:38:48.057728+0000) 2023-10-08T13:39:25.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:25.040+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.359072+0000 front 2023-10-08T13:38:30.359118+0000 (oldest deadline 2023-10-08T13:38:55.658992+0000) 2023-10-08T13:39:25.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:25.040+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.660572+0000 front 2023-10-08T13:38:39.660433+0000 (oldest deadline 2023-10-08T13:39:01.960599+0000) 2023-10-08T13:39:25.477 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8[127984]: 2023-10-08T13:39:25.040+0000 7f7ef2308700 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:42.962455+0000 front 2023-10-08T13:38:42.962409+0000 (oldest deadline 2023-10-08T13:39:08.862246+0000) 2023-10-08T13:39:25.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:25 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:25.320+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:25.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:25 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:25.320+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:25.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:25 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:25.320+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:25.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:25 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:25.320+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:25.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:25 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:25.320+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:26.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:25.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:26.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:25.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:26.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:25.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:26.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:25.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:26.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:25 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:25.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:26.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:25 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:25.922+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:26.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:25 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:25.922+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:26.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:25 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:25.922+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:26.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:25 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:25.922+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:26.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:25 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:25.922+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:26.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:26.314+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:26.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:26.314+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:26.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:26.314+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:26.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:26.314+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:26.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:26 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:26.314+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:26.726 INFO:journalctl@ceph.osd.8.smithi187.stdout:Oct 08 13:39:26 smithi187 bash[147920]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-8 2023-10-08T13:39:27.045 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:26 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:26.782+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:27.045 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:26 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:26.782+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:27.046 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:26 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:26.782+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:27.046 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:26 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:26.782+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:27.046 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:26 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:26.782+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:27.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:27.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:27.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:27.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:27.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:27.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:26 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:26.921+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:27.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:27.359+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:27.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:27.359+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:27.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:27.359+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:27.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:27.359+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:27.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:27.359+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:27.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-08T13:39:27.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:27.810 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-08T13:39:27.810 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-08T13:39:27.810 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.9 2023-10-08T13:39:27.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:27 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:27.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:27.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:27 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:27.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:27.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:27 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:27.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:27.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:27 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:27.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:27.976 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:27 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:27.733+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:28.187 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:27 smithi139 systemd[1]: Stopping Ceph osd.9 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:28.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:28.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:28.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:28.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:28.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:28.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:27 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:27.936+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:28.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.196+0000 7ff3448ea700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:28.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.196+0000 7ff3448ea700 -1 osd.9 107 *** Got signal Terminated *** 2023-10-08T13:39:28.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.196+0000 7ff3448ea700 -1 osd.9 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:28.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:28.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:28.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:28.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:28.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:28.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:28 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:28.361+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.363315+0000 front 2023-10-08T13:39:03.363400+0000 (oldest deadline 2023-10-08T13:39:28.063288+0000) 2023-10-08T13:39:29.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:28.770+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:29.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:28.770+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:29.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:28.770+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:29.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:28.770+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:29.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:28.770+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:29.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:29.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:29.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:29.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:29.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:29.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:28 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:28.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:29.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:29.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:29.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:29.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:29.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:29.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:29 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:29.399+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.363315+0000 front 2023-10-08T13:39:03.363400+0000 (oldest deadline 2023-10-08T13:39:28.063288+0000) 2023-10-08T13:39:30.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:29 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:29.762+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:30.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:29 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:29.762+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:30.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:29 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:29.762+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:30.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:29 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:29.762+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:30.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:29 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:29.762+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:30.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:30.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:30.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:30.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:30.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:30.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:29 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:29.996+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:30.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:30.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:30.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:30.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:30.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:30.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:30 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:30.393+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.363315+0000 front 2023-10-08T13:39:03.363400+0000 (oldest deadline 2023-10-08T13:39:28.063288+0000) 2023-10-08T13:39:31.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:30 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:30.773+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:31.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:30 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:30.773+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:31.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:30 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:30.773+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:31.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:30 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:30.773+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:31.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:30 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:30.773+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:31.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:31.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:31.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:31.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:31.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:31.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:31.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:31.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:31.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:31.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:31.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:31.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:31 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:31.348+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.363315+0000 front 2023-10-08T13:39:03.363400+0000 (oldest deadline 2023-10-08T13:39:28.063288+0000) 2023-10-08T13:39:32.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:32.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:32.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:32.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:32.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:32.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:31 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:31.804+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:32.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:32.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:32.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:32.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:32.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:32.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:31 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:31.991+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:32.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.956462+0000 front 2023-10-08T13:38:24.956484+0000 (oldest deadline 2023-10-08T13:38:49.656651+0000) 2023-10-08T13:39:32.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:30.757819+0000 front 2023-10-08T13:38:30.757835+0000 (oldest deadline 2023-10-08T13:38:56.657800+0000) 2023-10-08T13:39:32.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:38.959034+0000 front 2023-10-08T13:38:38.959049+0000 (oldest deadline 2023-10-08T13:39:03.058883+0000) 2023-10-08T13:39:32.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:43.059235+0000 front 2023-10-08T13:38:43.059180+0000 (oldest deadline 2023-10-08T13:39:08.959347+0000) 2023-10-08T13:39:32.687 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:51.860642+0000 front 2023-10-08T13:38:51.860599+0000 (oldest deadline 2023-10-08T13:39:16.560566+0000) 2023-10-08T13:39:32.688 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:32 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9[150011]: 2023-10-08T13:39:32.390+0000 7ff33ced8700 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.363315+0000 front 2023-10-08T13:39:03.363400+0000 (oldest deadline 2023-10-08T13:39:28.063288+0000) 2023-10-08T13:39:33.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:33.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:33.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:33.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:33.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:33.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:32.825+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:33.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:33.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:33.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:33.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:33.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:33.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:33 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:33.011+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:34.187 INFO:journalctl@ceph.osd.9.smithi139.stdout:Oct 08 13:39:33 smithi139 bash[202118]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-9 2023-10-08T13:39:34.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:34.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:34.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:34.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:34.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:34.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:33 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:33.806+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:34.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:34.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:34.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:34.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:34.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:34.348 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:34.348 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:34 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:34.008+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:35.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-08T13:39:35.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:35.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:35.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:35.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:35.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:35.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:34 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:34.839+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:35.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:35.255 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-08T13:39:35.255 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-08T13:39:35.256 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.10 2023-10-08T13:39:35.285 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:35.286 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.018+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:35.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 systemd[1]: Stopping Ceph osd.10 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:35.975 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.604+0000 7ff6db1f8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:35.975 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.604+0000 7ff6db1f8700 -1 osd.10 107 *** Got signal Terminated *** 2023-10-08T13:39:35.975 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.604+0000 7ff6db1f8700 -1 osd.10 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:35.976 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:36.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:36.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:36.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:36.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:36.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:36.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:35 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:35.886+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:36.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:36.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:35 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:35.974+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:37.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:37.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:37.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:37.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:37.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:37.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:36 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:36.902+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:37.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:37.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:36 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:36.981+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:38.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:38.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:38.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:38.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:38.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:38.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:37 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:37.863+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:38.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:38.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:38.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:38.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:38.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:38.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:38.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:37 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:37.956+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:39.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:38 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:38.833+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:39.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:39.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:38 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:38.941+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:40.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:40.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:40.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:40.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:40.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:40.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:40.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:39 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:39.868+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:40.346 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:23.519479+0000 front 2023-10-08T13:38:23.519396+0000 (oldest deadline 2023-10-08T13:38:46.419387+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:29.721387+0000 front 2023-10-08T13:38:29.721503+0000 (oldest deadline 2023-10-08T13:38:55.621479+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:40.223177+0000 front 2023-10-08T13:38:40.223045+0000 (oldest deadline 2023-10-08T13:39:03.122940+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6814 osd.3 since back 2023-10-08T13:38:44.724364+0000 front 2023-10-08T13:38:44.724494+0000 (oldest deadline 2023-10-08T13:39:09.424321+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:55.325320+0000 front 2023-10-08T13:38:55.325303+0000 (oldest deadline 2023-10-08T13:39:16.425617+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.327951+0000 front 2023-10-08T13:39:03.328034+0000 (oldest deadline 2023-10-08T13:39:26.827778+0000) 2023-10-08T13:39:40.347 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:39 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10[134767]: 2023-10-08T13:39:39.971+0000 7ff6d37e6700 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.229230+0000 front 2023-10-08T13:39:10.229419+0000 (oldest deadline 2023-10-08T13:39:33.129227+0000) 2023-10-08T13:39:41.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:41.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:41.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:41.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:41.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:41.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:41.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:40 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:40.836+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:41.294 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:41 smithi155 bash[147571]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-10 2023-10-08T13:39:42.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:42.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:42.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:42.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:42.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:42.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:42.228 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:41 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:41.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:42.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-08T13:39:42.525 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:42 smithi155 systemd[1]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.10.service: Succeeded. 2023-10-08T13:39:42.525 INFO:journalctl@ceph.osd.10.smithi155.stdout:Oct 08 13:39:42 smithi155 systemd[1]: Stopped Ceph osd.10 for 0585722a-65dd-11ee-8db5-212e2dc638e7. 2023-10-08T13:39:42.538 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:42.539 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-08T13:39:42.539 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-08T13:39:42.539 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.11 2023-10-08T13:39:42.871 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 systemd[1]: Stopping Ceph osd.11 for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:43.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:43.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:43.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:43.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.869+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.892+0000 7ffb12529700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.892+0000 7ffb12529700 -1 osd.11 107 *** Got signal Terminated *** 2023-10-08T13:39:43.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:42 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:42.892+0000 7ffb12529700 -1 osd.11 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:39:44.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:44.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:44.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:44.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:44.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:44.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:44.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:43 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:43.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:45.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:45.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:45.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:45.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:45.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:45.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:45.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:44 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:44.832+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:46.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:46.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:46.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:46.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:46.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:46.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:46.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:45 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:45.874+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:47.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:47.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:47.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:47.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:47.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:47.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:47.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:46 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:46.883+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:48.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6806 osd.0 since back 2023-10-08T13:38:24.731011+0000 front 2023-10-08T13:38:24.730966+0000 (oldest deadline 2023-10-08T13:38:50.030793+0000) 2023-10-08T13:39:48.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2023-10-08T13:38:32.931986+0000 front 2023-10-08T13:38:32.932009+0000 (oldest deadline 2023-10-08T13:38:57.032000+0000) 2023-10-08T13:39:48.226 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6804 osd.2 since back 2023-10-08T13:38:39.833445+0000 front 2023-10-08T13:38:39.833405+0000 (oldest deadline 2023-10-08T13:39:01.533754+0000) 2023-10-08T13:39:48.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2023-10-08T13:38:54.336250+0000 front 2023-10-08T13:38:54.336277+0000 (oldest deadline 2023-10-08T13:39:16.636119+0000) 2023-10-08T13:39:48.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6812 osd.5 since back 2023-10-08T13:39:03.037364+0000 front 2023-10-08T13:39:03.037337+0000 (oldest deadline 2023-10-08T13:39:24.737501+0000) 2023-10-08T13:39:48.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.139:6822 osd.6 since back 2023-10-08T13:39:10.539169+0000 front 2023-10-08T13:39:10.539134+0000 (oldest deadline 2023-10-08T13:39:31.639024+0000) 2023-10-08T13:39:48.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2023-10-08T13:39:18.040443+0000 front 2023-10-08T13:39:18.040483+0000 (oldest deadline 2023-10-08T13:39:39.140355+0000) 2023-10-08T13:39:48.227 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:47 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11[135942]: 2023-10-08T13:39:47.882+0000 7ffb0b318700 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.187:6820 osd.8 since back 2023-10-08T13:39:24.341494+0000 front 2023-10-08T13:39:24.341470+0000 (oldest deadline 2023-10-08T13:39:47.841591+0000) 2023-10-08T13:39:48.777 INFO:journalctl@ceph.osd.11.smithi187.stdout:Oct 08 13:39:48 smithi187 bash[148192]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-osd-11 2023-10-08T13:39:50.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-08T13:39:50.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:50.087 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-08T13:39:50.087 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-08T13:39:50.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.a 2023-10-08T13:39:50.437 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:39:50 smithi139 systemd[1]: Stopping Ceph mds.a for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:50.937 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:39:50 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: 2023-10-08T13:39:50.451+0000 7fbe8deca700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:50.937 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:39:50 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a[158621]: 2023-10-08T13:39:50.451+0000 7fbe8deca700 -1 mds.a *** got signal Terminated *** 2023-10-08T13:39:51.937 INFO:journalctl@ceph.mds.a.smithi139.stdout:Oct 08 13:39:51 smithi139 bash[202383]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-a 2023-10-08T13:39:52.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-08T13:39:52.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:52.094 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-08T13:39:52.094 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-08T13:39:52.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.d 2023-10-08T13:39:52.437 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:39:52 smithi139 systemd[1]: Stopping Ceph mds.d for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:52.937 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:39:52 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: 2023-10-08T13:39:52.467+0000 7f2152137700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:52.937 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:39:52 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d[157624]: 2023-10-08T13:39:52.467+0000 7f2152137700 -1 mds.d *** got signal Terminated *** 2023-10-08T13:39:56.187 INFO:journalctl@ceph.mds.d.smithi139.stdout:Oct 08 13:39:55 smithi139 bash[202530]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-d 2023-10-08T13:39:56.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-08T13:39:56.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:39:56.346 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-08T13:39:56.346 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-08T13:39:56.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.g 2023-10-08T13:39:56.687 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:39:56 smithi139 systemd[1]: Stopping Ceph mds.g for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:39:57.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:39:56 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: 2023-10-08T13:39:56.716+0000 7f570197b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:39:57.187 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:39:56 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g[158235]: 2023-10-08T13:39:56.716+0000 7f570197b700 -1 mds.g *** got signal Terminated *** 2023-10-08T13:39:59.937 INFO:journalctl@ceph.mds.g.smithi139.stdout:Oct 08 13:39:59 smithi139 bash[202677]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-g 2023-10-08T13:39:59.977 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-08T13:40:00.011 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:00.011 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-08T13:40:00.011 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-08T13:40:00.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.j 2023-10-08T13:40:00.390 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:40:00 smithi139 systemd[1]: Stopping Ceph mds.j for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:00.687 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:40:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-j[157246]: 2023-10-08T13:40:00.389+0000 7f418c9cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:00.687 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:40:00 smithi139 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-j[157246]: 2023-10-08T13:40:00.389+0000 7f418c9cc700 -1 mds.j *** got signal Terminated *** 2023-10-08T13:40:04.687 INFO:journalctl@ceph.mds.j.smithi139.stdout:Oct 08 13:40:04 smithi139 bash[202818]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-j 2023-10-08T13:40:04.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-08T13:40:04.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:04.757 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-08T13:40:04.758 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-08T13:40:04.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.b 2023-10-08T13:40:05.096 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:40:04 smithi155 systemd[1]: Stopping Ceph mds.b for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:05.846 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:40:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:40:05.370+0000 7f3a09d31700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:05.846 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:40:05 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b[141278]: 2023-10-08T13:40:05.370+0000 7f3a09d31700 -1 mds.b *** got signal Terminated *** 2023-10-08T13:40:07.880 INFO:journalctl@ceph.mds.b.smithi155.stdout:Oct 08 13:40:07 smithi155 bash[147833]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-b 2023-10-08T13:40:08.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-08T13:40:08.104 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:08.104 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-08T13:40:08.104 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-08T13:40:08.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.e 2023-10-08T13:40:08.346 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:40:08 smithi155 systemd[1]: Stopping Ceph mds.e for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:08.846 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:40:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: 2023-10-08T13:40:08.475+0000 7fb13c72e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:08.846 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:40:08 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e[140587]: 2023-10-08T13:40:08.475+0000 7fb13c72e700 -1 mds.e *** got signal Terminated *** 2023-10-08T13:40:12.096 INFO:journalctl@ceph.mds.e.smithi155.stdout:Oct 08 13:40:11 smithi155 bash[147974]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-e 2023-10-08T13:40:12.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-08T13:40:12.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:12.207 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-08T13:40:12.207 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-08T13:40:12.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.h 2023-10-08T13:40:12.584 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:40:12 smithi155 systemd[1]: Stopping Ceph mds.h for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:12.846 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:40:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:40:12.583+0000 7ff5e0e7c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:12.846 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:40:12 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h[140930]: 2023-10-08T13:40:12.583+0000 7ff5e0e7c700 -1 mds.h *** got signal Terminated *** 2023-10-08T13:40:15.846 INFO:journalctl@ceph.mds.h.smithi155.stdout:Oct 08 13:40:15 smithi155 bash[148117]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-h 2023-10-08T13:40:16.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-08T13:40:16.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:16.073 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-08T13:40:16.073 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-08T13:40:16.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.k 2023-10-08T13:40:16.346 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:40:16 smithi155 systemd[1]: Stopping Ceph mds.k for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:16.846 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:40:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: 2023-10-08T13:40:16.447+0000 7f3fe0e84700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:16.847 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:40:16 smithi155 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k[140249]: 2023-10-08T13:40:16.447+0000 7f3fe0e84700 -1 mds.k *** got signal Terminated *** 2023-10-08T13:40:20.015 INFO:journalctl@ceph.mds.k.smithi155.stdout:Oct 08 13:40:19 smithi155 bash[148256]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-k 2023-10-08T13:40:20.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-08T13:40:20.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:20.054 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-08T13:40:20.054 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-08T13:40:20.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.c 2023-10-08T13:40:20.412 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:40:20 smithi187 systemd[1]: Stopping Ceph mds.c for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:20.726 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:40:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:40:20.411+0000 7f6f315bc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:20.726 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:40:20 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c[142031]: 2023-10-08T13:40:20.411+0000 7f6f315bc700 -1 mds.c *** got signal Terminated *** 2023-10-08T13:40:24.173 INFO:journalctl@ceph.mds.c.smithi187.stdout:Oct 08 13:40:23 smithi187 bash[148466]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-c 2023-10-08T13:40:24.179 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-08T13:40:24.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:24.217 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-08T13:40:24.217 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-08T13:40:24.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.f 2023-10-08T13:40:24.476 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:40:24 smithi187 systemd[1]: Stopping Ceph mds.f for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:24.976 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:40:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:40:24.601+0000 7fb58fbc7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:24.976 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:40:24 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f[141692]: 2023-10-08T13:40:24.601+0000 7fb58fbc7700 -1 mds.f *** got signal Terminated *** 2023-10-08T13:40:28.106 INFO:journalctl@ceph.mds.f.smithi187.stdout:Oct 08 13:40:27 smithi187 bash[148611]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-f 2023-10-08T13:40:28.112 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-08T13:40:28.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:28.146 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-08T13:40:28.146 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-08T13:40:28.146 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.i 2023-10-08T13:40:28.476 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:40:28 smithi187 systemd[1]: Stopping Ceph mds.i for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:28.976 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:40:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: 2023-10-08T13:40:28.526+0000 7f846abd6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:28.976 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:40:28 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i[142372]: 2023-10-08T13:40:28.526+0000 7f846abd6700 -1 mds.i *** got signal Terminated *** 2023-10-08T13:40:31.972 INFO:journalctl@ceph.mds.i.smithi187.stdout:Oct 08 13:40:31 smithi187 bash[148759]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-i 2023-10-08T13:40:31.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-08T13:40:32.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:32.012 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-08T13:40:32.012 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-08T13:40:32.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.l 2023-10-08T13:40:32.226 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:40:32 smithi187 systemd[1]: Stopping Ceph mds.l for 0585722a-65dd-11ee-8db5-212e2dc638e7... 2023-10-08T13:40:32.726 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:40:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-l[141343]: 2023-10-08T13:40:32.390+0000 7feea9004700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:40:32.726 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:40:32 smithi187 ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-l[141343]: 2023-10-08T13:40:32.390+0000 7feea9004700 -1 mds.l *** got signal Terminated *** 2023-10-08T13:40:36.349 INFO:journalctl@ceph.mds.l.smithi187.stdout:Oct 08 13:40:36 smithi187 bash[148896]: ceph-0585722a-65dd-11ee-8db5-212e2dc638e7-mds-l 2023-10-08T13:40:36.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0585722a-65dd-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-08T13:40:36.385 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:40:36.386 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-08T13:40:36.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:40:36.694 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:40:38.270 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:40:38.580 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:40:40.150 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:40:40.458 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:40:42.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:40:42.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:40:42.156 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:40:42.186 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-08T13:40:42.188 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi139/crash 2023-10-08T13:40:42.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:40:42.237 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:40:42.238 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:40:42.240 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi155/crash 2023-10-08T13:40:42.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:40:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:40:42.285 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:40:42.287 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi187/crash 2023-10-08T13:40:42.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:40:42.368 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:40:42.368 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:40:42.369 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-08T13:40:42.369 DEBUG:teuthology.orchestra.run.smithi139:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-08T13:40:42.404 INFO:teuthology.orchestra.run.smithi139.stderr:grep: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-08T13:40:42.406 INFO:tasks.cephadm:Compressing logs... 2023-10-08T13:40:42.407 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:40:42.450 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:40:42.452 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:40:42.479 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:40:42.479 INFO:teuthology.orchestra.run.smithi139.stderr:: No such file or directory 2023-10-08T13:40:42.480 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-10-08T13:40:42.480 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-08T13:40:42.480 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-08T13:40:42.480 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-08T13:40:42.480 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-08T13:40:42.484 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.g.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.a.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.6.log: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:40:42.484 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-08T13:40:42.484 INFO:teuthology.orchestra.run.smithi139.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-10-08T13:40:42.484 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-08T13:40:42.485 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-08T13:40:42.487 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:40:42.487 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2023-10-08T13:40:42.487 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-08T13:40:42.487 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-08T13:40:42.487 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-08T13:40:42.488 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.10.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-08T13:40:42.488 INFO:teuthology.orchestra.run.smithi155.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:40:42.488 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-08T13:40:42.488 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-08T13:40:42.488 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:40:42.489 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.d.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-08T13:40:42.490 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.k.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:40:42.490 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-08T13:40:42.490 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-08T13:40:42.493 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:40:42.493 INFO:teuthology.orchestra.run.smithi187.stderr:: No such file or directory 2023-10-08T13:40:42.495 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:40:42.500 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.7.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-08T13:40:42.500 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-08T13:40:42.502 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-08T13:40:42.502 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-08T13:40:42.502 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-08T13:40:42.502 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-08T13:40:42.502 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.8.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.c.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:40:42.504 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-08T13:40:42.506 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 92.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-08T13:40:42.506 INFO:teuthology.orchestra.run.smithi187.stderr: 94.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-08T13:40:42.512 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-08T13:40:42.513 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-08T13:40:42.526 INFO:teuthology.orchestra.run.smithi139.stderr: 91.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:40:42.538 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-08T13:40:42.539 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-08T13:40:42.543 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 92.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-08T13:40:42.814 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.a.log: 89.9% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-08T13:40:42.860 INFO:teuthology.orchestra.run.smithi187.stderr: 91.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:40:42.864 INFO:teuthology.orchestra.run.smithi139.stderr: 94.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-08T13:40:42.902 INFO:teuthology.orchestra.run.smithi139.stderr: 94.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-08T13:40:43.035 INFO:teuthology.orchestra.run.smithi139.stderr: 94.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-08T13:40:43.039 INFO:teuthology.orchestra.run.smithi155.stderr: 92.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-08T13:40:43.080 INFO:teuthology.orchestra.run.smithi155.stderr: 94.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-08T13:40:43.126 INFO:teuthology.orchestra.run.smithi187.stderr: 91.9% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-08T13:40:43.921 INFO:teuthology.orchestra.run.smithi139.stderr: 90.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-08T13:40:45.276 INFO:teuthology.orchestra.run.smithi155.stderr: 95.9% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-08T13:40:52.813 INFO:teuthology.orchestra.run.smithi139.stderr: 91.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-08T13:40:59.637 INFO:teuthology.orchestra.run.smithi187.stderr: 97.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-08T13:41:01.373 INFO:teuthology.orchestra.run.smithi139.stderr: 91.8% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-08T13:41:02.138 INFO:teuthology.orchestra.run.smithi155.stderr: 91.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-08T13:41:03.858 INFO:teuthology.orchestra.run.smithi139.stderr: 91.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-08T13:41:04.381 INFO:teuthology.orchestra.run.smithi155.stderr: 91.8% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-08T13:41:05.095 INFO:teuthology.orchestra.run.smithi187.stderr: 91.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-08T13:41:06.462 INFO:teuthology.orchestra.run.smithi155.stderr: 91.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-08T13:41:07.405 INFO:teuthology.orchestra.run.smithi155.stderr: 96.6% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-08T13:41:07.680 INFO:teuthology.orchestra.run.smithi187.stderr: 91.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-08T13:41:08.752 INFO:teuthology.orchestra.run.smithi155.stderr: 96.9% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-08T13:41:10.335 INFO:teuthology.orchestra.run.smithi139.stderr: 91.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-08T13:41:10.336 INFO:teuthology.orchestra.run.smithi139.stderr: 2023-10-08T13:41:10.337 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m27.871s 2023-10-08T13:41:10.337 INFO:teuthology.orchestra.run.smithi139.stderr:user 1m18.363s 2023-10-08T13:41:10.337 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m2.675s 2023-10-08T13:41:10.919 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-08T13:41:10.920 INFO:teuthology.orchestra.run.smithi155.stderr: 2023-10-08T13:41:10.920 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m28.453s 2023-10-08T13:41:10.921 INFO:teuthology.orchestra.run.smithi155.stderr:user 2m23.185s 2023-10-08T13:41:10.921 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m5.114s 2023-10-08T13:41:12.367 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-08T13:41:21.509 INFO:teuthology.orchestra.run.smithi187.stderr: 94.0% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-08T13:41:30.923 INFO:teuthology.orchestra.run.smithi187.stderr: 91.5% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-08T13:42:12.362 INFO:teuthology.orchestra.run.smithi187.stderr: 97.1% -- replaced with /var/log/ceph/0585722a-65dd-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-08T13:42:12.363 INFO:teuthology.orchestra.run.smithi187.stderr: 2023-10-08T13:42:12.363 INFO:teuthology.orchestra.run.smithi187.stderr:real 1m29.894s 2023-10-08T13:42:12.363 INFO:teuthology.orchestra.run.smithi187.stderr:user 3m43.807s 2023-10-08T13:42:12.363 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m8.606s 2023-10-08T13:42:12.363 INFO:tasks.cephadm:Archiving logs... 2023-10-08T13:42:12.363 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi139/log 2023-10-08T13:42:12.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:42:26.083 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi155/log 2023-10-08T13:42:26.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:42:42.150 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi187/log 2023-10-08T13:42:42.151 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:43:08.934 INFO:tasks.cephadm:Removing cluster... 2023-10-08T13:43:08.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:43:09.241 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:43:09.825 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:43:10.144 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:43:10.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0585722a-65dd-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:43:11.208 INFO:teuthology.orchestra.run.smithi187.stdout:Deleting cluster with fsid: 0585722a-65dd-11ee-8db5-212e2dc638e7 2023-10-08T13:43:11.919 INFO:tasks.cephadm:Removing cephadm ... 2023-10-08T13:43:11.920 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:43:11.941 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:43:11.962 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:43:11.994 INFO:tasks.cephadm:Teardown complete 2023-10-08T13:43:11.994 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T13:43:12.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T13:43:12.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:43:12.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:43:12.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:43:12.186 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T13:43:12.198 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T13:43:12.199 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:43:12.201 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:43:12.204 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:43:12.217 INFO:teuthology.orchestra.run.smithi139.stderr:bash: ntpq: command not found 2023-10-08T13:43:12.220 INFO:teuthology.orchestra.run.smithi155.stderr:bash: ntpq: command not found 2023-10-08T13:43:12.220 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 +323us[ +330us] +/- 80ms 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 +120us[ +128us] +/- 79ms 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -347us[ -339us] +/- 63ms 2023-10-08T13:43:12.223 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:43:12.224 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:43:12.224 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-10-08T13:43:12.224 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +329us[ +342us] +/- 80ms 2023-10-08T13:43:12.225 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 +128us[ +142us] +/- 79ms 2023-10-08T13:43:12.225 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -316us[ -316us] +/- 63ms 2023-10-08T13:43:12.225 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +324us[ +343us] +/- 80ms 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 +102us[ +121us] +/- 79ms 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -348us[ -348us] +/- 63ms 2023-10-08T13:43:12.241 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:43:12.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T13:43:12.279 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T13:43:12.279 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T13:43:12.295 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:43:12.403 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:43:12.506 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:43:12.621 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:43:12.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:12.656 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:43:12.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:12.690 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:43:12.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:12.722 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T13:43:12.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T13:43:12.748 INFO:teuthology.task.internal:Duration was 2288.338778 seconds 2023-10-08T13:43:12.748 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T13:43:12.764 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T13:43:12.764 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:43:12.767 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:43:12.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:43:12.812 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:43:12.815 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:43:12.853 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:43:13.246 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T13:43:13.246 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2023-10-08T13:43:13.246 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:43:13.269 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2023-10-08T13:43:13.269 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:43:13.291 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-10-08T13:43:13.291 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:43:13.319 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T13:43:13.319 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:43:13.321 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:43:13.333 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:43:13.412 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T13:43:13.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:43:13.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:43:13.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:43:13.528 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T13:43:13.542 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T13:43:13.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:43:13.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:43:13.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:43:13.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T13:43:13.664 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.690 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2023-10-08T13:43:13.692 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2023-10-08T13:43:13.697 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-10-08T13:43:13.743 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:13.760 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:13.777 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:43:13.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:13.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T13:43:13.811 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T13:43:13.812 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi139 2023-10-08T13:43:13.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:43:13.855 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi155 2023-10-08T13:43:13.855 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:43:13.894 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973/remote/smithi187 2023-10-08T13:43:13.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:43:13.934 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T13:43:13.934 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:43:13.938 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:43:13.940 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:43:13.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T13:43:13.999 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T13:43:13.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T13:43:14.011 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T13:43:14.012 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:43:14.015 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:43:14.018 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:43:14.029 INFO:teuthology.orchestra.run.smithi139.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:43 /home/ubuntu/cephtest 2023-10-08T13:43:14.032 INFO:teuthology.orchestra.run.smithi155.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:43 /home/ubuntu/cephtest 2023-10-08T13:43:14.041 INFO:teuthology.orchestra.run.smithi187.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:43 /home/ubuntu/cephtest 2023-10-08T13:43:14.043 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T13:43:14.076 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T13:43:14.214 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T13:43:14.244 DEBUG:teuthology.nuke:shortname: smithi139 2023-10-08T13:43:14.244 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:43:14.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.950319', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:43:14.275 DEBUG:teuthology.nuke:shortname: smithi155 2023-10-08T13:43:14.275 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:43:14.296 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-08T13:43:14.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:43:14.302 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.952343', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:43:14.319 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417973', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:59:49.954866', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:43:14.330 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-08T13:43:14.331 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:43:14.361 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-08T13:43:14.361 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:43:14.376 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-08T13:43:14.376 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:43:14.384 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-08T13:43:14.384 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:14.392 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-08T13:43:14.393 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:14.401 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-08T13:43:14.402 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:14.411 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-08T13:43:14.414 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-08T13:43:14.425 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-08T13:43:18.412 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:18.420 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:18.429 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:18.522 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-08T13:43:18.531 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-08T13:43:18.538 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-08T13:43:22.526 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:22.541 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:22.549 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:22.643 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-08T13:43:22.651 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-08T13:43:22.660 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-08T13:43:26.646 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:26.658 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:26.668 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:43:26.760 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-08T13:43:26.769 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-08T13:43:26.781 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-08T13:43:26.862 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-08T13:43:26.870 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-08T13:43:26.882 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-08T13:43:26.987 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/default mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} duration: 2288.3387780189514 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-08T13:43:26.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T13:43:27.075 INFO:teuthology.run:FAIL